What does “Test-Time Compute” mean?
Additional inference computation used during response generation to improve quality or reasoning.
How Test-Time Compute Works
Hard question
Model generates many reasoning steps or candidates
Pick or verify the best
Better answer, higher cost.
Practical Example
A reasoning model works through a puzzle for tens of seconds, trying approaches and checking them, rather than answering at once. The extra effort often raises accuracy on hard problems.
Why It Matters
It offers a route to better answers without a larger model. It makes each response slower and costlier.
Common Questions About Test-Time Compute
Q: Same as inference-time compute?
Yes, the terms are generally used interchangeably.
Q: Which tasks benefit?
Multi-step math, coding, and logic problems.
Q: Is it unlimited?
No. Gains taper off, and more thinking raises cost and delay.