What does “Temperature” mean?
A sampling setting controlling randomness in generated outputs.
How Temperature Works
At a low temperature, asking for a name for a bakery tends to return the same safe option each time. At a higher temperature, you get more varied and unusual suggestions, with a greater chance of odd ones.
Practical Example
At a low temperature, asking for a name for a bakery tends to return the same safe option each time. At a higher temperature, you get more varied and unusual suggestions, with a greater chance of odd ones.
Why It Matters
It lets you trade consistency for variety. Tasks needing accuracy generally use lower values.
Common Questions About Temperature
Q: Does temperature 0 give identical output?
Usually very close to deterministic, though small variations can remain in some systems.
Q: How does it work?
It rescales the probabilities of next tokens before one is sampled: lower sharpens the choice, higher flattens it.
Q: Does high temperature cause hallucinations?
It can raise the chance of odd or incorrect output, though models can be wrong at any setting.