Benchmark category
Multimodal evaluations, model coverage and rankings. Each benchmark keeps its original scale and methodology.
Data as of 2026-08-11
Select a benchmark to inspect model results, evidence fields and scoring direction.
| MMMU-Pro | MMMU-Pro | multimodal | Score | 66 | featured | B | Yes |
| MMMU | MMMU | multimodal | Score | 63 | featured | B | Yes |
| CharXiv-R | CharXiv-R | multimodal | Score | 48 | featured | B | Yes |
| MathVista | MathVista | multimodal | Score | 39 | featured | B | Yes |
| AI2D | AI2D | multimodal | Score | 32 | featured | B | Yes |
| MathVision | MathVision | multimodal | Score | 32 | featured | B | Yes |
| DocVQA | DocVQA | multimodal | Score | 26 | featured | B | Yes |
| VideoMMMU | VideoMMMU | multimodal | Score | 26 | featured | B | Yes |
| ScreenSpot Pro | ScreenSpot Pro | multimodal | Score | 25 | featured | C | Yes |
| ChartQA | ChartQA | multimodal | Score | 24 | featured | B | Yes |
| LVBench | LVBench | multimodal | Score | 24 | featured | B | Yes |
| MathVista-Mini | MathVista-Mini | multimodal | Score | 23 | featured | B | Yes |
| OSWorld-Verified | OSWorld-Verified | multimodal | Score | 23 | featured | B | Yes |
| PolyMATH | PolyMATH | multimodal | Score | 23 | featured | B | Yes |
| MMStar | MMStar | multimodal | Score | 22 | featured | B | Yes |
| OSWorld | OSWorld | multimodal | Score | 20 | featured | B | Yes |
| CC-OCR | CC-OCR | multimodal | Score | 18 | featured | B | Yes |
| MMBench-V1.1 | MMBench-V1.1 | multimodal | Score | 18 | featured | B | Yes |
| MM-MT-Bench | MM-MT-Bench | multimodal | Score | 17 | featured | B | Yes |
| MVBench | MVBench | multimodal | Score | 17 | featured | B | Yes |
| OmniDocBench 1.5 | OmniDocBench 1.5 | multimodal | Score | 17 | featured | B | Yes |
| Video-MME | Video-MME | multimodal | Score | 17 | featured | B | Yes |
| CharXiv-D | CharXiv-D | multimodal | Score | 16 | featured | B | Yes |
| ScreenSpot | ScreenSpot | multimodal | Score | 16 | featured | B | Yes |
| TextVQA | TextVQA | multimodal | Score | 15 | featured | B | Yes |
| BLINK | BLINK | multimodal | Score | 13 | featured | B | Yes |
| SimpleVQA | SimpleVQA | multimodal | Score | 13 | featured | B | Yes |
| CharadesSTA | CharadesSTA | multimodal | Score | 12 | featured | B | Yes |
| InfoVQAtest | InfoVQAtest | multimodal | Score | 12 | featured | B | Yes |
| MedXpertQA | MedXpertQA | multimodal | Score | 12 | featured | B | Yes |
| DocVQAtest | DocVQAtest | multimodal | Score | 11 | featured | B | Yes |
| MMMU (val) | MMMU (val) | multimodal | Score | 11 | featured | B | Yes |
| MuirBench | MuirBench | multimodal | Score | 11 | featured | B | Yes |
| MLVU | MLVU | multimodal | Score | 10 | featured | B | Yes |
| VideoMME w sub. | VideoMME w sub. | multimodal | Score | 10 | featured | B | Yes |
| VideoMME w/o sub. | VideoMME w/o sub. | multimodal | Score | 10 | featured | B | Yes |
Leading results from high-coverage benchmarks with at least two models.
How this category is assembled on llmboard.ai.
This page groups benchmarks whose primary or display category matches multimodal. It does not average incompatible metrics into a new category score.
Open an individual benchmark to inspect score direction, evidence level, participant count and model results.
Benchmarks are grouped by their primary and display categories.