llmboard.aiAI model intelligence
Home

Model Rankings

OverallOpen ModelsAgentCodingReasoningMathKnowledgeInstruction FollowingTextVision
Image GenerationImage Editing
Video GenerationImage to VideoVideo Editing
Text to SpeechSpeech to Text
Embeddings

Efficiency

Chat Token PricingImage PricingVideo PricingAudio Pricing
Chat Speed & LatencyProvider Reliability

Benchmarks

GPQAMMLU-ProAIME 2025SWE-Bench VerifiedMMLUHumanity's Last ExamLiveCodeBenchMATHHumanEvalMMMU-Pro
All Benchmarks

Tools

Model DirectoryCompare Models

Scoring & Data

Scoring & Data
393 models668 benchmarks

Leaderboard Center

Overall RankingCodingCore BenchmarksPrice & ValueRuntime Performance

Modalities

All ModelsImage GenerationImage EditingVideo GenerationImage-to-VideoVideo EditingText-to-SpeechSpeech-to-TextEmbeddings

Data & Methods

Scoring MethodAll BenchmarksReasoningMath

Vendors

All VendorsOpenAIAnthropicGoogle
llmboard.aiCopyright 2026 llmboard.ai

reasoning benchmark

ARC-C Leaderboard

The AI2 Reasoning Challenge (ARC) Challenge Set is a multiple-choice question-answering benchmark containing grade-school level science questions that require advanced reasoning capabilities. ARC-C specifically contains questions that were answered incorrectly by both retrieval-based and word co-occurrence algorithms, making it a particularly challenging subset designed to test commonsense reasoning abilities in AI systems.

Updated Aug 17, 2026

Models34
Model coverage34
MetricScore
EvidenceB

On this page

  • Ranking
  • Highlights
  • Distribution
  • Top models
  • About
  • FAQ

ARC-C Ranking

Higher score ranks better on this benchmark.

30 of 34 rows
Columns

Show columns

Sort by
Rank
Model
Score
Percentile
Participants
Evidence
Evaluated
Rank01ModelXIMiMo-V2.5-ProXiaomiScore97.2%Percentile100.0%Participants34EvidenceCEvaluatedAug 17, 2026
Rank02ModelMELlama 3.1 405B InstructMetaScore96.9%Percentile97.0%Participants34EvidenceCEvaluatedAug 17, 2026
Rank03ModelANClaude 3 OpusAnthropicScore96.4%Percentile93.9%Participants34EvidenceCEvaluatedAug 17, 2026
Rank04ModelMELlama 3.1 70B InstructMetaScore94.8%Percentile90.9%Participants34EvidenceCEvaluatedAug 17, 2026
Rank05ModelAMNova ProAmazonScore94.8%Percentile87.9%Participants34EvidenceCEvaluatedAug 17, 2026
Rank06ModelANClaude 3 SonnetAnthropicScore93.2%Percentile84.8%Participants34EvidenceCEvaluatedAug 17, 2026
Rank07ModelALJamba 1.5 LargeAI21 LabsScore93.0%Percentile81.8%Participants34EvidenceCEvaluatedAug 17, 2026
Rank08ModelAMNova LiteAmazonScore92.4%Percentile78.8%Participants34EvidenceCEvaluatedAug 17, 2026
Rank09ModelMAMistral Small 3 24B BaseMistral AIScore91.3%Percentile75.8%Participants34EvidenceCEvaluatedAug 17, 2026
Rank10ModelMIPhi-3.5-MoE-instructMicrosoftScore91.0%Percentile72.7%Participants34EvidenceCEvaluatedAug 17, 2026
Rank11ModelAMNova MicroAmazonScore90.2%Percentile69.7%Participants34EvidenceCEvaluatedAug 17, 2026
Rank12ModelANClaude 3 HaikuAnthropicScore89.2%Percentile66.7%Participants34EvidenceCEvaluatedAug 17, 2026
Rank13ModelALJamba 1.5 MiniAI21 LabsScore85.7%Percentile63.6%Participants34EvidenceCEvaluatedAug 17, 2026
Rank14ModelMIPhi-3.5-mini-instructMicrosoftScore84.6%Percentile60.6%Participants34EvidenceCEvaluatedAug 17, 2026
Rank15ModelMIPhi 4 MiniMicrosoftScore83.7%Percentile57.6%Participants34EvidenceCEvaluatedAug 17, 2026
Rank16ModelMELlama 3.1 8B InstructMetaScore83.4%Percentile54.5%Participants34EvidenceCEvaluatedAug 17, 2026
Rank17ModelMELlama 3.2 3B InstructMetaScore78.6%Percentile51.5%Participants34EvidenceCEvaluatedAug 17, 2026
Rank18ModelMAMinistral 8B InstructMistral AIScore71.9%Percentile48.5%Participants34EvidenceCEvaluatedAug 17, 2026
Rank19ModelGOGemma 2 27BGoogleScore71.4%Percentile45.5%Participants34EvidenceCEvaluatedAug 17, 2026
Rank20ModelCOCommand R+CohereScore71.0%Percentile42.4%Participants34EvidenceCEvaluatedAug 17, 2026
Rank21ModelACQwen2.5-Coder 32B InstructAlibaba Cloud / Qwen TeamScore70.5%Percentile39.4%Participants34EvidenceCEvaluatedAug 17, 2026
Rank22ModelACQwen2.5 32B InstructAlibaba Cloud / Qwen TeamScore70.4%Percentile36.4%Participants34EvidenceCEvaluatedAug 17, 2026
Rank23ModelNVLlama 3.1 Nemotron 70B InstructNVIDIAScore69.2%Percentile33.3%Participants34EvidenceCEvaluatedAug 17, 2026
Rank24ModelACQwen2 72B InstructAlibaba Cloud / Qwen TeamScore68.9%Percentile30.3%Participants34EvidenceCEvaluatedAug 17, 2026
Rank25ModelGOGemma 2 9BGoogleScore68.4%Percentile27.3%Participants34EvidenceCEvaluatedAug 17, 2026
Rank26ModelACQwen2.5 14B InstructAlibaba Cloud / Qwen TeamScore67.3%Percentile24.2%Participants34EvidenceCEvaluatedAug 17, 2026
Rank27ModelNRHermes 3 70BNous ResearchScore65.5%Percentile21.2%Participants34EvidenceCEvaluatedAug 17, 2026
Rank28ModelGOGemma 3n E4BGoogleScore61.6%Percentile18.2%Participants34EvidenceCEvaluatedAug 17, 2026
Rank29ModelGOGemma 3n E4B Instructed LiteRT PreviewGoogleScore61.6%Percentile15.2%Participants34EvidenceCEvaluatedAug 17, 2026
Rank30ModelACQwen2.5-Coder 7B InstructAlibaba Cloud / Qwen TeamScore60.9%Percentile12.1%Participants34EvidenceCEvaluatedAug 17, 2026
Rank31ModelGOGemma 3n E2BGoogleScore51.7%Percentile9.1%Participants34EvidenceCEvaluatedAug 17, 2026
Rank32ModelGOGemma 3n E2B Instructed LiteRT (Preview)GoogleScore51.7%Percentile6.1%Participants34EvidenceCEvaluatedAug 17, 2026
Rank33ModelIBGranite 3.3 8B BaseIBMScore50.8%Percentile3.0%Participants34EvidenceCEvaluatedAug 17, 2026
Rank34ModelBAERNIE 4.5BaiduScore40.6%Percentile0.0%Participants34EvidenceCEvaluatedAug 17, 2026

ARC-C Highlights

The leading models and scores on this benchmark.

Rank #1MiMo-V2.5-Pro97.2%Rank #2Llama 3.1 405B Instruct96.9%Rank #3Claude 3 Opus96.4%Rank #4Llama 3.1 70B Instruct94.8%

ARC-C Score Distribution

A closer view of the leading scores on this benchmark.

ARC-C

The Top AI Models for ARC-C

The first five results on this benchmark, with official price and output speed added where the model identity can be matched.

Ranking basisThis arc-c AI model leaderboard uses descending score in the benchmark's original unit. The leaderboard ranking keeps matched price and speed data separate from benchmark evidence.

  1. 01
    XI
    MiMo-V2.5-ProXiaomi
    Score
    97.2%
    Price
    $0.43 input / $0.87 output per 1M tokens
    Speed
    Up to 69 tok/s via Novita

    Strengths

    • Ranks #1 of 34 compared models
    • 100th percentile on this benchmark
    • C evidence result

    Considerations

    • This result measures ARC-C, not total model capability
  2. 02
    ME
    Llama 3.1 405B InstructMeta
    Score
    96.9%
    Speed
    Up to 100 tok/s via Bedrock

    Strengths

    • Ranks #2 of 34 compared models
    • 97th percentile on this benchmark
    • C evidence result

    Considerations

    • This result measures ARC-C, not total model capability
  3. 03
    AN
    Claude 3 OpusAnthropic
    Score
    96.4%
    Speed
    Up to 120 tok/s via Bedrock

    Strengths

    • Ranks #3 of 34 compared models
    • 94th percentile on this benchmark
    • C evidence result

    Considerations

    • This result measures ARC-C, not total model capability
  4. 04
    ME
    Llama 3.1 70B InstructMeta
    Score
    94.8%
    Speed
    Up to 1,204 tok/s via Cerebras

    Strengths

    • Ranks #4 of 34 compared models
    • 91th percentile on this benchmark
    • C evidence result

    Considerations

    • This result measures ARC-C, not total model capability
  5. 05
    AM
    Nova ProAmazon
    Score
    94.8%
    Price
    $0.80 input / $3.2 output per 1M tokens
    Speed
    Up to 100 tok/s via Bedrock

    Strengths

    • Ranks #5 of 34 compared models
    • 88th percentile on this benchmark
    • C evidence result

    Considerations

    • This result measures ARC-C, not total model capability

Selection summary

Best AI Models for ARC-C

MiMo-V2.5-Pro currently leads ARC-C with 97.2%. It is the top model on this specific benchmark, while the best LLM for the broader task should also be checked against other benchmarks, price and runtime.

Use this leaderboard with the supporting benchmark results and coverage details above. A leaderboard position summarizes the selected ranking signal; it does not replace workload-specific testing.

Benchmark rank #1MiMo-V2.5-Pro97.2% · $0.43 input / $0.87 output per 1M tokensBenchmark rank #2Llama 3.1 405B Instruct96.9% · Up to 100 tok/s via BedrockBenchmark rank #3Claude 3 Opus96.4% · Up to 120 tok/s via Bedrock

What is ARC-C?

What ARC-C measures and how its scores work.

The AI2 Reasoning Challenge (ARC) Challenge Set is a multiple-choice question-answering benchmark containing grade-school level science questions that require advanced reasoning capabilities. ARC-C specifically contains questions that were answered incorrectly by both retrieval-based and word co-occurrence algorithms, making it a particularly challenging subset designed to test commonsense reasoning abilities in AI systems.

Scores are shown in ratio. This benchmark is not independently verified and has an evidence level of B.

Family
ARC-C
Modality
text
Primary category
reasoning
Score direction
higher
LLMBoard eligible
Yes
Evaluation key
arc-c|llm-stats-current

Benchmark scores retain their original unit. Overall score eligibility is shown separately.

FAQ

Common questions about ARC-C.

Which model scores highest on ARC-C?

MiMo-V2.5-Pro is currently ranked first with 97.2%.

What does ARC-C measure?

The AI2 Reasoning Challenge (ARC) Challenge Set is a multiple-choice question-answering benchmark containing grade-school level science questions that require advanced reasoning capabilities. ARC-C specifically contains questions that were answered incorrectly by both retrieval-based and word co-occurrence algorithms, making it a particularly challenging subset designed to test commonsense reasoning abilities in AI systems.

Is a higher score better?

Yes. Higher values rank better for this benchmark.

How many models are compared?

34 model results are currently shown.

Does this benchmark affect the overall score?

Yes. This benchmark can contribute to the current LLMBoard capability score.