multimodal benchmark
Video-MME is the first-ever comprehensive evaluation benchmark for Multi-modal Large Language Models (MLLMs) in video analysis. This variant focuses on long-term videos (30min-60min) without subtitle inputs, testing robust contextual dynamics across 6 primary visual domains with 30 subfields including knowledge, film & television, sports competition, life record, and multilingual content.
Updated Aug 11, 2026
Higher score ranks better on this benchmark.
| 01 | OP | 72.0% | 100.0% | 1 | C |
The leading models and scores on this benchmark.
What Video-MME (long, no subtitles) measures and how its scores work.
Video-MME is the first-ever comprehensive evaluation benchmark for Multi-modal Large Language Models (MLLMs) in video analysis. This variant focuses on long-term videos (30min-60min) without subtitle inputs, testing robust contextual dynamics across 6 primary visual domains with 30 subfields including knowledge, film & television, sports competition, life record, and multilingual content.
Scores are shown in ratio. This benchmark is not independently verified and has an evidence level of B.
Benchmark scores retain their original unit. Overall score eligibility is shown separately.
Common questions about Video-MME (long, no subtitles).
GPT-4.1 is currently ranked first with 72.0%.
Video-MME is the first-ever comprehensive evaluation benchmark for Multi-modal Large Language Models (MLLMs) in video analysis. This variant focuses on long-term videos (30min-60min) without subtitle inputs, testing robust contextual dynamics across 6 primary visual domains with 30 subfields including knowledge, film & television, sports competition, life record, and multilingual content.
Yes. Higher values rank better for this benchmark.
1 model results are currently shown.
No. This benchmark is shown for reference but does not contribute to the overall score.