What does “Distilled Model” mean?
A smaller model trained to imitate a larger model's behavior while using less compute at inference.
How Distilled Model Works
Large teacher
Generates answers or scores
Small student trained to match
Distilled model: cheaper to serve.
Practical Example
A provider releases a smaller 'mini' version of a large model that is trained to imitate it. It answers faster and costs less per request, with somewhat weaker results on hard questions.
Why It Matters
Distilled models make strong behavior affordable at scale. You trade some capability for speed and price.
Common Questions About Distilled Model
Q: Distilled model vs distillation?
Distillation is the process; a distilled model is the resulting smaller model.
Q: Is it as good as the teacher?
Usually close on common tasks but weaker on hard or rare ones.
Q: Why use one?
Lower latency, lower cost, and the ability to run on smaller hardware.