What is an instruction-tuned LLM?

An instruction-tuned LLM is a pretrained language model that has been further trained to follow human instructions more reliably.

A base LLM mainly learns to predict the next token. Instruction tuning adds another training stage where the model sees examples of instructions paired with suitable responses.

For example:

Instruction:
Summarize this paragraph in one sentence.

Response:
...

By training on many instruction-response examples, the model learns that a user prompt is not just text to continue—it is often a task to complete.

How instruction tuning works

A common approach is supervised fine-tuning (SFT).

The model is trained on datasets containing examples such as:

Question → Answer
Command → Completion
Task description → Desired output

During training, the model's parameters are adjusted so that its responses become more consistent with the target answers.

What does instruction tuning improve?

Instruction tuning can make a model better at:

• Following explicit requests
• Answering questions directly
• Producing requested formats
• Summarizing or rewriting text
• Performing classification or extraction from instructions
• Handling multi-step tasks more consistently

For example, a base model given:

Translate "Good morning" into French.

might simply continue the surrounding text pattern.

An instruction-tuned model is more likely to respond directly with:

Bonjour.

Is instruction tuning the same as alignment?

Not exactly.

Instruction tuning teaches the model how to follow tasks and response patterns.

Additional post-training methods may then optimize qualities such as helpfulness, safety, or preference alignment using human or model-generated feedback.

Instruction-tuned LLM vs. base LLM

A base LLM has general language capability from pretraining.

An instruction-tuned LLM starts from that base model and is further trained to interpret prompts as instructions and respond accordingly.

For the foundation model stage, see “What is a base LLM?”

In short: an instruction-tuned LLM is a pretrained language model that has undergone additional training on instruction-response examples so it can follow user requests more effectively.