AI ART Discover · Learn · Create
D AI Glossary Term • Term 62 of 224
Plain English Definition

What does “Distilled Model” mean?

Core Definition

A smaller model trained to imitate a larger model's behavior while using less compute at inference.

Operational Mechanism

How Distilled Model Works

1

Large teacher

2

Generates answers or scores

3

Small student trained to match

4

Distilled model: cheaper to serve.

Real-World Scenario

Practical Example

A provider releases a smaller 'mini' version of a large model that is trained to imitate it. It answers faster and costs less per request, with somewhat weaker results on hard questions.

Core Significance

Why It Matters

Distilled models make strong behavior affordable at scale. You trade some capability for speed and price.

Expert Q&A

Common Questions About Distilled Model

Q: Distilled model vs distillation?

Distillation is the process; a distilled model is the resulting smaller model.

Q: Is it as good as the teacher?

Usually close on common tasks but weaker on hard or rare ones.

Q: Why use one?

Lower latency, lower cost, and the ability to run on smaller hardware.