language benchmark
CSimpleQA
Chinese SimpleQA is the first comprehensive Chinese benchmark to evaluate the factuality ability of language models to answer short questions. It contains 3,000 high-quality questions spanning 6 major topics with 99 diverse subtopics, designed to assess Chinese factual knowledge across humanities, science, engineering, culture, and society.
Updated Aug 11, 2026
Models7
Model coverage7
MetricScore
EvidenceB
CSimpleQA Ranking
Higher score ranks better on this benchmark.
| 01 | DE | 84.4% | 100.0% | 7 | C | |
| 02 | AC | 84.3% | 83.3% | 7 | C | |
| 03 | AC | 83.4% | 66.7% | 7 | C | |
| 04 | DE | 78.9% | 50.0% | 7 | C | |
| 05 | MA | 78.4% | 33.3% | 7 | C | |
| 06 | MA | 77.6% | 16.7% | 7 | C | |
| 07 | DE | 64.8% | 0.0% | 7 | C |
CSimpleQA Score Distribution
A closer view of the leading scores on this benchmark.
CSimpleQA Highlights
The leading models and scores on this benchmark.
What is CSimpleQA?
What CSimpleQA measures and how its scores work.
Chinese SimpleQA is the first comprehensive Chinese benchmark to evaluate the factuality ability of language models to answer short questions. It contains 3,000 high-quality questions spanning 6 major topics with 99 diverse subtopics, designed to assess Chinese factual knowledge across humanities, science, engineering, culture, and society.
Scores are shown in ratio. This benchmark is not independently verified and has an evidence level of B.
- Family
- CSimpleQA
- Modality
- text
- Primary category
- language
- Score direction
- higher
- LLMBoard eligible
- Yes
- Evaluation key
- csimpleqa|llm-stats-current
Benchmark scores retain their original unit. Overall score eligibility is shown separately.
FAQ
Common questions about CSimpleQA.
Which model scores highest on CSimpleQA?
DeepSeek-V4-Pro-Max is currently ranked first with 84.4%.
What does CSimpleQA measure?
Chinese SimpleQA is the first comprehensive Chinese benchmark to evaluate the factuality ability of language models to answer short questions. It contains 3,000 high-quality questions spanning 6 major topics with 99 diverse subtopics, designed to assess Chinese factual knowledge across humanities, science, engineering, culture, and society.
Is a higher score better?
Yes. Higher values rank better for this benchmark.
How many models are compared?
7 model results are currently shown.
Does this benchmark affect the overall score?
Yes. This benchmark can contribute to the current LLMBoard capability score.