What does “Factuality” mean?
How accurately a model's claims match verifiable real-world information.
How Factuality Works
Model claim: 'The Eiffel Tower is in Berlin'
Compare with trusted sources
Contradicted
Marked as false.
Practical Example
A checker splits a model's long answer into individual claims and compares each with reference sources, counting how many are supported, contradicted, or unverifiable.
Why It Matters
People rely on AI for facts, and fluent errors are easy to miss. Factuality measures help compare models and catch regressions.
Common Questions About Factuality
Q: Factuality vs groundedness?
Factuality compares claims with the real world; groundedness compares them with provided sources.
Q: How is it measured?
Question-answering benchmarks, human fact-checking, and automated claim checking against references.
Q: How can it be improved?
Retrieval from trusted sources, citations, and training methods that reward accuracy and uncertainty.