What does “GSM8K” mean?
A benchmark of grade-school math word problems used to evaluate step-by-step reasoning in language models.
How GSM8K Works
Word problem in plain English
Model writes the steps
Final number
Compare with the correct answer.
Practical Example
A typical problem: a store sells pencils in packs, a student buys several packs and gives some away; how many remain? The model must work through two or three arithmetic steps.
Why It Matters
GSM8K checks multi-step reasoning on grade-school math. Strong models now score very high, so harder tests are used too.
Common Questions About GSM8K
Q: Who made it?
OpenAI researchers in 2021.
Q: How big is it?
About 8,500 problems, with roughly 7,500 for training and 1,300 for testing.
Q: Does a high score mean math ability?
It shows skill on this style of problem, and possible exposure to similar questions in training data should be considered.