AI ART Discover · Learn · Create
I AI Glossary Term • Term 108 of 224
Plain English Definition

What does “Instruction Tuning” mean?

Core Definition

Fine-tuning a model on instruction-response pairs to improve task following.

Operational Mechanism

How Instruction Tuning Works

1

Pre-trained model predicts next words

2

Train on instruction and response pairs

3

Model follows requests

4

Helpful assistant behavior.

Real-World Scenario

Practical Example

A raw pre-trained model given 'Summarize this article' might just continue the text. After training on many examples of instructions paired with good responses, it learns to actually produce a summary.

Core Significance

Why It Matters

Instruction tuning is a key step that turns a text predictor into something that responds to requests. It is usually followed by preference training to refine behavior.

Expert Q&A

Common Questions About Instruction Tuning

Q: Where does the training data come from?

Human-written examples, existing datasets reformatted as instructions, and sometimes model-generated examples that are filtered.

Q: Is it the same as RLHF?

No. Instruction tuning uses supervised examples; RLHF uses human preference ratings. They are often combined.

Q: Does it add knowledge?

Mostly it changes how the model responds, not what it knows.