math benchmark
MGSM
MGSM (Multilingual Grade School Math) is a benchmark of grade-school math problems. Contains 250 grade-school math problems manually translated from the GSM8K dataset into ten typologically diverse languages: Spanish, French, German, Russian, Chinese, Japanese, Thai, Swahili, Bengali, and Telugu. Evaluates multilingual mathematical reasoning capabilities.
Updated Aug 11, 2026
Models31
Model coverage31
MetricScore
EvidenceB
MGSM Ranking
Higher score ranks better on this benchmark.
MGSM Score Distribution
A closer view of the leading scores on this benchmark.
MGSM Highlights
The leading models and scores on this benchmark.
What is MGSM?
What MGSM measures and how its scores work.
MGSM (Multilingual Grade School Math) is a benchmark of grade-school math problems. Contains 250 grade-school math problems manually translated from the GSM8K dataset into ten typologically diverse languages: Spanish, French, German, Russian, Chinese, Japanese, Thai, Swahili, Bengali, and Telugu. Evaluates multilingual mathematical reasoning capabilities.
Scores are shown in ratio. This benchmark is not independently verified and has an evidence level of B.
- Family
- MGSM
- Modality
- text
- Primary category
- math
- Score direction
- higher
- LLMBoard eligible
- Yes
- Evaluation key
- mgsm|llm-stats-current
Benchmark scores retain their original unit. Overall score eligibility is shown separately.
FAQ
Common questions about MGSM.
Which model scores highest on MGSM?
Llama 4 Maverick is currently ranked first with 92.3%.
What does MGSM measure?
MGSM (Multilingual Grade School Math) is a benchmark of grade-school math problems. Contains 250 grade-school math problems manually translated from the GSM8K dataset into ten typologically diverse languages: Spanish, French, German, Russian, Chinese, Japanese, Thai, Swahili, Bengali, and Telugu. Evaluates multilingual mathematical reasoning capabilities.
Is a higher score better?
Yes. Higher values rank better for this benchmark.
How many models are compared?
31 model results are currently shown.
Does this benchmark affect the overall score?
Yes. This benchmark can contribute to the current LLMBoard capability score.