What is LLM fine-tuning?

LLM fine-tuning is the process of taking an already pretrained language model and training it further on a smaller, more targeted dataset.

The goal is to adapt the model's behavior or capabilities without starting training from scratch.

Why fine-tune an LLM?

A pretrained model has broad language knowledge, but it may not behave exactly as needed for a particular task or domain.

Fine-tuning can help a model become better at:

• Following instructions
• Answering in a preferred format
• Working with domain-specific language
• Performing a specialized task
• Producing a particular response style

How does fine-tuning work?

The model starts with parameters learned during pretraining.

It is then trained on new examples:

pretrained model
      ↓
targeted training dataset
      ↓
additional training
      ↓
fine-tuned model

During training, the model makes predictions, a loss is calculated, and some or all of its parameters are updated.

Example

Suppose a base model is being adapted for customer-support responses.

A fine-tuning example might look like:

User:
I forgot my password.

Desired response:
Use the password-reset option on the sign-in page...

By learning from many examples like this, the model can become more consistent with the desired task and response style.

Does fine-tuning change all model parameters?

It can, but it does not have to.

Two broad approaches are:

• Full fine-tuning — updates most or all model parameters.
• Parameter-efficient fine-tuning (PEFT) — updates only a small set of additional or selected parameters.

PEFT methods can reduce training memory and compute requirements.

How much data is needed?

Usually far less than pretraining.

The amount depends on:

• The complexity of the task
• The quality of the examples
• How different the target behavior is from the base model
• Model size
• Fine-tuning method

A smaller, high-quality dataset can often be more useful than a large but noisy one.

Is fine-tuning the same as prompting?

No.

Prompting changes the instructions or context given to the model at inference time.

Fine-tuning changes the model's learned parameters through additional training.

So:

Prompting
→ change the input

Fine-tuning
→ change the model

Is fine-tuning the same as pretraining?

No.

Pretraining builds broad capabilities from a very large corpus.

Fine-tuning starts from that pretrained model and adapts it using a narrower dataset.

That distinction is covered separately in “What is the difference between pretraining and fine-tuning an LLM?”

Can fine-tuning hurt the model?

Yes.

Poorly designed fine-tuning can cause problems such as:

• Overfitting
• Reduced general capability
• Learning unwanted patterns
• Catastrophic forgetting

That is why dataset quality, training settings, and evaluation are important.

In short: LLM fine-tuning is additional training applied to a pretrained model so it becomes better suited to a particular task, domain, style, or behavior while reusing the capabilities learned during pretraining.