llmboard.aiAI model intelligence
Home

Model Rankings

OverallOpen ModelsAgentCodingReasoningMathKnowledgeInstruction FollowingTextVision
Image GenerationImage Editing
Video GenerationImage to VideoVideo Editing
Text to SpeechSpeech to Text
Embeddings

Efficiency

Chat Token PricingImage PricingVideo PricingAudio Pricing
Chat Speed & LatencyProvider Reliability

Benchmarks

GPQAMMLU-ProAIME 2025SWE-Bench VerifiedMMLUHumanity's Last ExamLiveCodeBenchMATHHumanEvalMMMU-Pro
All Benchmarks

Tools

Model DirectoryCompare Models

Scoring & Data

Scoring & Data
393 models668 benchmarks

Leaderboard Center

Overall RankingCodingCore BenchmarksPrice & ValueRuntime Performance

Modalities

All ModelsImage GenerationImage EditingVideo GenerationImage-to-VideoVideo EditingText-to-SpeechSpeech-to-TextEmbeddings

Data & Methods

Scoring MethodAll BenchmarksReasoningMath

Vendors

All VendorsOpenAIAnthropicGoogle
llmboard.aiCopyright 2026 llmboard.ai

Benchmark category

Multimodal Benchmarks

Multimodal evaluations, model coverage and rankings. Each benchmark keeps its original scale and methodology.

Data as of 2026-08-17

Benchmarks171
Highest coverage83
Score eligible87

Multimodal Benchmark Directory

Select a benchmark to inspect model results, evidence fields and scoring direction.

30 of 39 rows
Columns

Show columns

Sort by
Benchmark
Family
Modality
Metric
Coverage
Coverage tier
Evidence
Score eligible
BenchmarkMIEB(eng) MultimodalFamilyMIEB(eng):multimodalModalitymultimodalMetricOfficial leaderboard task-type meanCoverage83Coverage tierfeaturedEvidenceAScore eligibleYes
BenchmarkMMMU-ProFamilyMMMU-ProModalitymultimodalMetricScoreCoverage68Coverage tierfeaturedEvidenceBScore eligibleYes
BenchmarkMMMUFamilyMMMUModalitymultimodalMetricScoreCoverage63Coverage tierfeaturedEvidenceBScore eligibleYes
BenchmarkCharXiv-RFamilyCharXiv-RModalitymultimodalMetricScoreCoverage51Coverage tierfeaturedEvidenceBScore eligibleYes
BenchmarkMathVistaFamilyMathVistaModalitymultimodalMetricScoreCoverage39Coverage tierfeaturedEvidenceBScore eligibleYes
BenchmarkAI2DFamilyAI2DModalitymultimodalMetricScoreCoverage33Coverage tierfeaturedEvidenceBScore eligibleYes
BenchmarkMathVisionFamilyMathVisionModalitymultimodalMetricScoreCoverage33Coverage tierfeaturedEvidenceBScore eligibleYes
BenchmarkDocVQAFamilyDocVQAModalitymultimodalMetricScoreCoverage28Coverage tierfeaturedEvidenceBScore eligibleYes
BenchmarkChartQAFamilyChartQAModalitymultimodalMetricScoreCoverage26Coverage tierfeaturedEvidenceBScore eligibleYes
BenchmarkVideoMMMUFamilyVideoMMMUModalitymultimodalMetricScoreCoverage26Coverage tierfeaturedEvidenceBScore eligibleYes
BenchmarkLVBenchFamilyLVBenchModalitymultimodalMetricScoreCoverage25Coverage tierfeaturedEvidenceBScore eligibleYes
BenchmarkScreenSpot ProFamilyScreenSpot ProModalitymultimodalMetricScoreCoverage25Coverage tierfeaturedEvidenceCScore eligibleYes
BenchmarkMathVista-MiniFamilyMathVista-MiniModalitymultimodalMetricScoreCoverage24Coverage tierfeaturedEvidenceBScore eligibleYes
BenchmarkMMStarFamilyMMStarModalitymultimodalMetricScoreCoverage24Coverage tierfeaturedEvidenceBScore eligibleYes
BenchmarkOSWorld-VerifiedFamilyOSWorld-VerifiedModalitymultimodalMetricScoreCoverage24Coverage tierfeaturedEvidenceBScore eligibleYes
BenchmarkPolyMATHFamilyPolyMATHModalitymultimodalMetricScoreCoverage23Coverage tierfeaturedEvidenceBScore eligibleYes
BenchmarkMMBench-V1.1FamilyMMBench-V1.1ModalitymultimodalMetricScoreCoverage20Coverage tierfeaturedEvidenceBScore eligibleYes
BenchmarkOSWorldFamilyOSWorldModalitymultimodalMetricScoreCoverage20Coverage tierfeaturedEvidenceBScore eligibleYes
BenchmarkCC-OCRFamilyCC-OCRModalitymultimodalMetricScoreCoverage18Coverage tierfeaturedEvidenceBScore eligibleYes
BenchmarkOmniDocBench 1.5FamilyOmniDocBench 1.5ModalitymultimodalMetricScoreCoverage18Coverage tierfeaturedEvidenceBScore eligibleYes
BenchmarkCharXiv-DFamilyCharXiv-DModalitymultimodalMetricScoreCoverage17Coverage tierfeaturedEvidenceBScore eligibleYes
BenchmarkMM-MT-BenchFamilyMM-MT-BenchModalitymultimodalMetricScoreCoverage17Coverage tierfeaturedEvidenceBScore eligibleYes
BenchmarkMVBenchFamilyMVBenchModalitymultimodalMetricScoreCoverage17Coverage tierfeaturedEvidenceBScore eligibleYes
BenchmarkVideo-MMEFamilyVideo-MMEModalitymultimodalMetricScoreCoverage17Coverage tierfeaturedEvidenceBScore eligibleYes
BenchmarkScreenSpotFamilyScreenSpotModalitymultimodalMetricScoreCoverage16Coverage tierfeaturedEvidenceBScore eligibleYes
BenchmarkTextVQAFamilyTextVQAModalitymultimodalMetricScoreCoverage16Coverage tierfeaturedEvidenceBScore eligibleYes
BenchmarkBLINKFamilyBLINKModalitymultimodalMetricScoreCoverage15Coverage tierfeaturedEvidenceBScore eligibleYes
BenchmarkSimpleVQAFamilySimpleVQAModalitymultimodalMetricScoreCoverage14Coverage tierfeaturedEvidenceBScore eligibleYes
BenchmarkMMMU (val)FamilyMMMU (val)ModalitymultimodalMetricScoreCoverage13Coverage tierfeaturedEvidenceBScore eligibleYes
BenchmarkCharadesSTAFamilyCharadesSTAModalitymultimodalMetricScoreCoverage12Coverage tierfeaturedEvidenceBScore eligibleYes
BenchmarkInfoVQAtestFamilyInfoVQAtestModalitymultimodalMetricScoreCoverage12Coverage tierfeaturedEvidenceBScore eligibleYes
BenchmarkMedXpertQAFamilyMedXpertQAModalitymultimodalMetricScoreCoverage12Coverage tierfeaturedEvidenceBScore eligibleYes
BenchmarkMuirBenchFamilyMuirBenchModalitymultimodalMetricScoreCoverage12Coverage tierfeaturedEvidenceBScore eligibleYes
BenchmarkDocVQAtestFamilyDocVQAtestModalitymultimodalMetricScoreCoverage11Coverage tierfeaturedEvidenceBScore eligibleYes
BenchmarkBabyVisionFamilyBabyVisionModalitymultimodalMetricScoreCoverage10Coverage tierfeaturedEvidenceBScore eligibleYes
BenchmarkInfoVQAFamilyInfoVQAModalitymultimodalMetricScoreCoverage10Coverage tierfeaturedEvidenceBScore eligibleYes
BenchmarkMLVUFamilyMLVUModalitymultimodalMetricScoreCoverage10Coverage tierfeaturedEvidenceBScore eligibleYes
BenchmarkVideoMME w sub.FamilyVideoMME w sub.ModalitymultimodalMetricScoreCoverage10Coverage tierfeaturedEvidenceBScore eligibleYes
BenchmarkVideoMME w/o sub.FamilyVideoMME w/o sub.ModalitymultimodalMetricScoreCoverage10Coverage tierfeaturedEvidenceBScore eligibleYes

Multimodal Benchmark Rankings

Leading results from high-coverage benchmarks with at least two models.

MIEB(eng) Multimodal

View benchmark

MMMU-Pro

View benchmark

MMMU

View benchmark

CharXiv-R

View benchmark

What are multimodal benchmarks?

How this category is assembled on llmboard.ai.

This page groups benchmarks whose primary or display category matches multimodal. It does not average incompatible metrics into a new category score.

Open an individual benchmark to inspect score direction, evidence level, participant count and model results.

Benchmarks are grouped by their primary and display categories.