llmboard.aiLeaderboard Center
Overall
Overall RankingOpen Models
Tools
Model DirectoryCompare Models
Capabilities
CodingReasoningMathKnowledgeInstruction Following
Price & Efficiency
Price & ValueCapability vs. PriceRuntime Performance
Modalities
Image GenerationVideo GenerationSpeech ModelsEmbeddings
Core Benchmarks
GPQAMMLU-ProAIME 2025SWE-Bench VerifiedMMLUHumanity's Last ExamLiveCodeBenchMATHHumanEvalMMMU-ProView all benchmarks
Methods
Scoring & Data
393 models668 benchmarks

Leaderboard Center

Overall RankingCodingCore BenchmarksPrice & ValueRuntime Performance

Modalities

All ModelsImage GenerationImage EditingVideo GenerationImage-to-VideoVideo EditingText-to-SpeechSpeech-to-TextEmbeddings

Data & Methods

Scoring MethodAll BenchmarksReasoningMath

Vendors

All VendorsOpenAIAnthropicGoogle
llmboard.aiCopyright 2026 llmboard.ai

multimodal benchmark

MMMU (val)

Validation set of the Massive Multi-discipline Multimodal Understanding and Reasoning benchmark. Features college-level multimodal questions across 6 core disciplines (Art & Design, Business, Science, Health & Medicine, Humanities & Social Science, Tech & Engineering) spanning 30 subjects and 183 subfields with diverse image types including charts, diagrams, maps, and tables.

Updated Aug 11, 2026

Models11
Model coverage11
MetricScore
EvidenceB

On this page

  • Ranking
  • Distribution
  • Highlights
  • About
  • FAQ

MMMU (val) Ranking

Higher score ranks better on this benchmark.

11 rows
Columns

Show columns

01ACQwen3 VL 32B ThinkingAlibaba Cloud / Qwen Team78.1%100.0%11CAug 11, 2026
02ACQwen3 VL 30B A3B ThinkingAlibaba Cloud / Qwen Team76.0%90.0%11CAug 11, 2026
03ACQwen3 VL 32B InstructAlibaba Cloud / Qwen Team76.0%80.0%11CAug 11, 2026
04ACQwen3 VL 30B A3B InstructAlibaba Cloud / Qwen Team74.2%70.0%11CAug 11, 2026
05ACQwen3 VL 8B ThinkingAlibaba Cloud / Qwen Team74.1%60.0%11CAug 11, 2026
06ACQwen3 VL 4B ThinkingAlibaba Cloud / Qwen Team70.8%50.0%11CAug 11, 2026
07ACQwen3 VL 8B InstructAlibaba Cloud / Qwen Team69.6%40.0%11CAug 11, 2026
08ACQwen3 VL 4B InstructAlibaba Cloud / Qwen Team67.4%30.0%11CAug 11, 2026
09GOGemma 3 27BGoogle64.9%20.0%11CAug 11, 2026
10GOGemma 3 12BGoogle59.6%10.0%11CAug 11, 2026
11GOGemma 3 4BGoogle48.8%0.0%11CAug 11, 2026

MMMU (val) Score Distribution

A closer view of the leading scores on this benchmark.

MMMU (val)

MMMU (val) Highlights

The leading models and scores on this benchmark.

Rank #1Qwen3 VL 32B Thinking78.1%Rank #2Qwen3 VL 30B A3B Thinking76.0%Rank #3Qwen3 VL 32B Instruct76.0%Rank #4Qwen3 VL 30B A3B Instruct74.2%

What is MMMU (val)?

What MMMU (val) measures and how its scores work.

Validation set of the Massive Multi-discipline Multimodal Understanding and Reasoning benchmark. Features college-level multimodal questions across 6 core disciplines (Art & Design, Business, Science, Health & Medicine, Humanities & Social Science, Tech & Engineering) spanning 30 subjects and 183 subfields with diverse image types including charts, diagrams, maps, and tables.

Scores are shown in ratio. This benchmark is not independently verified and has an evidence level of B.

Family
MMMU (val)
Modality
multimodal
Primary category
multimodal
Score direction
higher
LLMBoard eligible
Yes
Evaluation key
mmmu-(val)|llm-stats-current

Benchmark scores retain their original unit. Overall score eligibility is shown separately.

FAQ

Common questions about MMMU (val).

Which model scores highest on MMMU (val)?

Qwen3 VL 32B Thinking is currently ranked first with 78.1%.

What does MMMU (val) measure?

Validation set of the Massive Multi-discipline Multimodal Understanding and Reasoning benchmark. Features college-level multimodal questions across 6 core disciplines (Art & Design, Business, Science, Health & Medicine, Humanities & Social Science, Tech & Engineering) spanning 30 subjects and 183 subfields with diverse image types including charts, diagrams, maps, and tables.

Is a higher score better?

Yes. Higher values rank better for this benchmark.

How many models are compared?

11 model results are currently shown.

Does this benchmark affect the overall score?

Yes. This benchmark can contribute to the current LLMBoard capability score.