reasoning benchmark
MBPP+ is an enhanced version of MBPP (Mostly Basic Python Problems) with significantly more test cases (35x) for more rigorous evaluation. MBPP is a benchmark of 974 crowd-sourced Python programming problems designed to be solvable by entry-level programmers, covering programming fundamentals and standard library functionality.
Updated Aug 11, 2026
Higher score ranks better on this benchmark.
| 01 | XI | 74.1% | 100.0% | 4 | C | |
| 02 | AC | 67.2% | 66.7% | 4 | C | |
| 03 | AC | 63.2% | 33.3% | 4 | C | |
| 04 | BA | 40.2% | 0.0% | 4 | C |
A closer view of the leading scores on this benchmark.
The leading models and scores on this benchmark.
What MBPP+ measures and how its scores work.
MBPP+ is an enhanced version of MBPP (Mostly Basic Python Problems) with significantly more test cases (35x) for more rigorous evaluation. MBPP is a benchmark of 974 crowd-sourced Python programming problems designed to be solvable by entry-level programmers, covering programming fundamentals and standard library functionality.
Scores are shown in ratio. This benchmark is not independently verified and has an evidence level of B.
Benchmark scores retain their original unit. Overall score eligibility is shown separately.
Common questions about MBPP+.
MiMo-V2.5-Pro is currently ranked first with 74.1%.
MBPP+ is an enhanced version of MBPP (Mostly Basic Python Problems) with significantly more test cases (35x) for more rigorous evaluation. MBPP is a benchmark of 974 crowd-sourced Python programming problems designed to be solvable by entry-level programmers, covering programming fundamentals and standard library functionality.
Yes. Higher values rank better for this benchmark.
4 model results are currently shown.
Yes. This benchmark can contribute to the current LLMBoard capability score.