llmboard.aiLeaderboard Center
Overall
Overall RankingOpen Models
Tools
Model DirectoryCompare Models
Capabilities
CodingReasoningMathKnowledgeInstruction Following
Price & Efficiency
Price & ValueCapability vs. PriceRuntime Performance
Modalities
Image GenerationVideo GenerationSpeech ModelsEmbeddings
Core Benchmarks
GPQAMMLU-ProAIME 2025SWE-Bench VerifiedMMLUHumanity's Last ExamLiveCodeBenchMATHHumanEvalMMMU-ProView all benchmarks
Methods
Scoring & Data
393 models668 benchmarks

Leaderboard Center

Overall RankingCodingCore BenchmarksPrice & ValueRuntime Performance

Modalities

All ModelsImage GenerationImage EditingVideo GenerationImage-to-VideoVideo EditingText-to-SpeechSpeech-to-TextEmbeddings

Data & Methods

Scoring MethodAll BenchmarksReasoningMath

Vendors

All VendorsOpenAIAnthropicGoogle
llmboard.aiCopyright 2026 llmboard.ai

multimodal benchmark

OSWorld Screenshot-only

OSWorld Screenshot-only: A variant of the OSWorld benchmark that evaluates multimodal AI agents using only screenshot observations to complete open-ended computer tasks across real operating systems (Ubuntu, Windows, macOS). Tests agents' ability to perform complex workflows involving web apps, desktop applications, file I/O, and multi-application tasks through visual interface understanding and GUI grounding.

Updated Aug 11, 2026

Models1
Model coverage1
MetricScore
EvidenceB

On this page

  • Ranking
  • Highlights
  • About
  • FAQ

OSWorld Screenshot-only Ranking

Higher score ranks better on this benchmark.

1 rows
Columns

Show columns

01ANClaude 3.5 SonnetAnthropic14.9%100.0%1CAug 11, 2026

OSWorld Screenshot-only Highlights

The leading models and scores on this benchmark.

Rank #1Claude 3.5 Sonnet14.9%

What is OSWorld Screenshot-only?

What OSWorld Screenshot-only measures and how its scores work.

OSWorld Screenshot-only: A variant of the OSWorld benchmark that evaluates multimodal AI agents using only screenshot observations to complete open-ended computer tasks across real operating systems (Ubuntu, Windows, macOS). Tests agents' ability to perform complex workflows involving web apps, desktop applications, file I/O, and multi-application tasks through visual interface understanding and GUI grounding.

Scores are shown in ratio. This benchmark is not independently verified and has an evidence level of B.

Family
OSWorld Screenshot-only
Modality
multimodal
Primary category
multimodal
Score direction
higher
LLMBoard eligible
No
Evaluation key
osworld-screenshot-only|llm-stats-current

Benchmark scores retain their original unit. Overall score eligibility is shown separately.

FAQ

Common questions about OSWorld Screenshot-only.

Which model scores highest on OSWorld Screenshot-only?

Claude 3.5 Sonnet is currently ranked first with 14.9%.

What does OSWorld Screenshot-only measure?

OSWorld Screenshot-only: A variant of the OSWorld benchmark that evaluates multimodal AI agents using only screenshot observations to complete open-ended computer tasks across real operating systems (Ubuntu, Windows, macOS). Tests agents' ability to perform complex workflows involving web apps, desktop applications, file I/O, and multi-application tasks through visual interface understanding and GUI grounding.

Is a higher score better?

Yes. Higher values rank better for this benchmark.

How many models are compared?

1 model results are currently shown.

Does this benchmark affect the overall score?

No. This benchmark is shown for reference but does not contribute to the overall score.