llmboard.aiAI model intelligence
Home

Model Rankings

OverallOpen ModelsAgentCodingReasoningMathKnowledgeInstruction FollowingTextVision
Image GenerationImage Editing
Video GenerationImage to VideoVideo Editing
Text to SpeechSpeech to Text
Embeddings

Efficiency

Chat Token PricingImage PricingVideo PricingAudio Pricing
Chat Speed & LatencyProvider Reliability

Benchmarks

GPQAMMLU-ProAIME 2025SWE-Bench VerifiedMMLUHumanity's Last ExamLiveCodeBenchMATHHumanEvalMMMU-Pro
All Benchmarks

Tools

Model DirectoryCompare Models

Scoring & Data

Scoring & Data
393 models668 benchmarks

Leaderboard Center

Overall RankingCodingCore BenchmarksPrice & ValueRuntime Performance

Modalities

All ModelsImage GenerationImage EditingVideo GenerationImage-to-VideoVideo EditingText-to-SpeechSpeech-to-TextEmbeddings

Data & Methods

Scoring MethodAll BenchmarksReasoningMath

Vendors

All VendorsOpenAIAnthropicGoogle
llmboard.aiCopyright 2026 llmboard.ai

reasoning benchmark

HumanEval Leaderboard

A benchmark that measures functional correctness for synthesizing programs from docstrings, consisting of 164 original programming problems assessing language comprehension, algorithms, and simple mathematics

Updated Aug 17, 2026

Models66
Model coverage66
MetricScore
EvidenceB

On this page

  • Ranking
  • Highlights
  • Distribution
  • Top models
  • About
  • FAQ

HumanEval Ranking

Higher score ranks better on this benchmark.

30 of 66 rows
Columns

Show columns

Sort by
Rank
Model
Score
Percentile
Participants
Evidence
Evaluated
Rank01ModelOPMiniCPM-SALAOpenBMBScore95.1%Percentile100.0%Participants66EvidenceCEvaluatedAug 17, 2026
Rank02ModelMAKimi K2 0905Moonshot AIScore94.5%Percentile98.5%Participants66EvidenceCEvaluatedAug 17, 2026
Rank03ModelANClaude 3.5 SonnetAnthropicScore93.7%Percentile96.9%Participants66EvidenceCEvaluatedAug 17, 2026
Rank04ModelOPGPT-5OpenAIScore93.4%Percentile95.4%Participants66EvidenceCEvaluatedAug 17, 2026
Rank05ModelMAKimi K2 InstructMoonshot AIScore93.3%Percentile93.8%Participants66EvidenceCEvaluatedAug 17, 2026
Rank06ModelACQwen2.5-Coder 32B InstructAlibaba Cloud / Qwen TeamScore92.7%Percentile92.3%Participants66EvidenceCEvaluatedAug 17, 2026
Rank07ModelOPo1-miniOpenAIScore92.4%Percentile90.8%Participants66EvidenceCEvaluatedAug 17, 2026
Rank08ModelSASarvam-30BSarvam AIScore92.1%Percentile89.2%Participants66EvidenceCEvaluatedAug 17, 2026
Rank09ModelANClaude 3.5 SonnetAnthropicScore92.0%Percentile87.7%Participants66EvidenceCEvaluatedAug 17, 2026
Rank10ModelMAMistral Large 2Mistral AIScore92.0%Percentile86.2%Participants66EvidenceCEvaluatedAug 17, 2026
Rank11ModelACQwen2.5 VL 32B InstructAlibaba Cloud / Qwen TeamScore91.5%Percentile84.6%Participants66EvidenceCEvaluatedAug 17, 2026
Rank12ModelOPGPT-4oOpenAIScore90.2%Percentile83.1%Participants66EvidenceCEvaluatedAug 17, 2026
Rank13ModelIBGranite 3.3 8B BaseIBMScore89.7%Percentile81.5%Participants66EvidenceCEvaluatedAug 17, 2026
Rank14ModelIBGranite 3.3 8B InstructIBMScore89.7%Percentile80.0%Participants66EvidenceCEvaluatedAug 17, 2026
Rank15ModelGOGemini DiffusionGoogleScore89.6%Percentile78.5%Participants66EvidenceCEvaluatedAug 17, 2026
Rank16ModelDEDeepSeek-V2.5DeepSeekScore89.0%Percentile76.9%Participants66EvidenceCEvaluatedAug 17, 2026
Rank17ModelMELlama 3.1 405B InstructMetaScore89.0%Percentile75.4%Participants66EvidenceCEvaluatedAug 17, 2026
Rank18ModelAMNova ProAmazonScore89.0%Percentile73.8%Participants66EvidenceCEvaluatedAug 17, 2026
Rank19ModelMELongCat-Flash-ChatMeituanScore88.4%Percentile72.3%Participants66EvidenceCEvaluatedAug 17, 2026
Rank20ModelMAMistral Small 3.1 24B InstructMistral AIScore88.4%Percentile70.8%Participants66EvidenceCEvaluatedAug 17, 2026
Rank21ModelXAGrok-2xAIScore88.4%Percentile69.2%Participants66EvidenceCEvaluatedAug 17, 2026
Rank22ModelMELlama 3.3 70B InstructMetaScore88.4%Percentile67.7%Participants66EvidenceCEvaluatedAug 17, 2026
Rank23ModelACQwen2.5 32B InstructAlibaba Cloud / Qwen TeamScore88.4%Percentile66.2%Participants66EvidenceCEvaluatedAug 17, 2026
Rank24ModelACQwen2.5-Coder 7B InstructAlibaba Cloud / Qwen TeamScore88.4%Percentile64.6%Participants66EvidenceCEvaluatedAug 17, 2026
Rank25ModelANClaude 3.5 HaikuAnthropicScore88.1%Percentile63.1%Participants66EvidenceCEvaluatedAug 17, 2026
Rank26ModelOPo1OpenAIScore88.1%Percentile61.5%Participants66EvidenceCEvaluatedAug 17, 2026
Rank27ModelOPGPT-4.5OpenAIScore88.0%Percentile60.0%Participants66EvidenceCEvaluatedAug 17, 2026
Rank28ModelGOGemma 3 27BGoogleScore87.8%Percentile58.5%Participants66EvidenceCEvaluatedAug 17, 2026
Rank29ModelOPGPT-4o miniOpenAIScore87.2%Percentile56.9%Participants66EvidenceCEvaluatedAug 17, 2026
Rank30ModelOPGPT-4 TurboOpenAIScore87.1%Percentile55.4%Participants66EvidenceCEvaluatedAug 17, 2026
Rank31ModelACQwen2.5 72B InstructAlibaba Cloud / Qwen TeamScore86.6%Percentile53.9%Participants66EvidenceCEvaluatedAug 17, 2026
Rank32ModelACQwen2 72B InstructAlibaba Cloud / Qwen TeamScore86.0%Percentile52.3%Participants66EvidenceCEvaluatedAug 17, 2026
Rank33ModelXAGrok-2 minixAIScore85.7%Percentile50.8%Participants66EvidenceCEvaluatedAug 17, 2026
Rank34ModelGOGemma 3 12BGoogleScore85.4%Percentile49.2%Participants66EvidenceCEvaluatedAug 17, 2026
Rank35ModelAMNova LiteAmazonScore85.4%Percentile47.7%Participants66EvidenceCEvaluatedAug 17, 2026
Rank36ModelANClaude 3 OpusAnthropicScore84.9%Percentile46.1%Participants66EvidenceCEvaluatedAug 17, 2026
Rank37ModelMAMistral Small 3 24B InstructMistral AIScore84.8%Percentile44.6%Participants66EvidenceCEvaluatedAug 17, 2026
Rank38ModelACQwen2.5 7B InstructAlibaba Cloud / Qwen TeamScore84.8%Percentile43.1%Participants66EvidenceCEvaluatedAug 17, 2026
Rank39ModelGOGemini 1.5 ProGoogleScore84.1%Percentile41.5%Participants66EvidenceCEvaluatedAug 17, 2026
Rank40ModelACQwen2.5 14B InstructAlibaba Cloud / Qwen TeamScore83.5%Percentile40.0%Participants66EvidenceCEvaluatedAug 17, 2026
Rank41ModelMIPhi 4MicrosoftScore82.6%Percentile38.5%Participants66EvidenceCEvaluatedAug 17, 2026
Rank42ModelIBIBM Granite 4.0 Tiny PreviewIBMScore82.4%Percentile36.9%Participants66EvidenceCEvaluatedAug 17, 2026
Rank43ModelMACodestral-22BMistral AIScore81.1%Percentile35.4%Participants66EvidenceCEvaluatedAug 17, 2026
Rank44ModelAMNova MicroAmazonScore81.1%Percentile33.9%Participants66EvidenceCEvaluatedAug 17, 2026
Rank45ModelMELlama 3.1 70B InstructMetaScore80.5%Percentile32.3%Participants66EvidenceCEvaluatedAug 17, 2026
Rank46ModelACQwen2 7B InstructAlibaba Cloud / Qwen TeamScore79.9%Percentile30.8%Participants66EvidenceCEvaluatedAug 17, 2026
Rank47ModelACQwen2.5-Omni-7BAlibaba Cloud / Qwen TeamScore78.7%Percentile29.2%Participants66EvidenceCEvaluatedAug 17, 2026
Rank48ModelANClaude 3 HaikuAnthropicScore75.9%Percentile27.7%Participants66EvidenceCEvaluatedAug 17, 2026
Rank49ModelGOGemma 3n E4B InstructedGoogleScore75.0%Percentile26.1%Participants66EvidenceCEvaluatedAug 17, 2026
Rank50ModelGOGemma 3n E4B Instructed LiteRT PreviewGoogleScore75.0%Percentile24.6%Participants66EvidenceCEvaluatedAug 17, 2026
Rank51ModelGOGemini 1.5 FlashGoogleScore74.3%Percentile23.1%Participants66EvidenceCEvaluatedAug 17, 2026
Rank52ModelXAGrok-1.5xAIScore74.1%Percentile21.5%Participants66EvidenceCEvaluatedAug 17, 2026
Rank53ModelANClaude 3 SonnetAnthropicScore73.0%Percentile20.0%Participants66EvidenceCEvaluatedAug 17, 2026
Rank54ModelMELlama 3.1 8B InstructMetaScore72.6%Percentile18.5%Participants66EvidenceCEvaluatedAug 17, 2026
Rank55ModelMAPixtral-12BMistral AIScore72.0%Percentile16.9%Participants66EvidenceCEvaluatedAug 17, 2026
Rank56ModelGOGemma 3 4BGoogleScore71.3%Percentile15.4%Participants66EvidenceCEvaluatedAug 17, 2026
Rank57ModelMIPhi-3.5-MoE-instructMicrosoftScore70.7%Percentile13.8%Participants66EvidenceCEvaluatedAug 17, 2026
Rank58ModelOPGPT-3.5 TurboOpenAIScore68.0%Percentile12.3%Participants66EvidenceBEvaluatedAug 17, 2026
Rank59ModelOPGPT-4OpenAIScore67.0%Percentile10.8%Participants66EvidenceCEvaluatedAug 17, 2026
Rank60ModelGOGemma 3n E2B InstructedGoogleScore66.5%Percentile9.2%Participants66EvidenceCEvaluatedAug 17, 2026
Rank61ModelGOGemma 3n E2B Instructed LiteRT (Preview)GoogleScore66.5%Percentile7.7%Participants66EvidenceCEvaluatedAug 17, 2026
Rank62ModelMIPhi-3.5-mini-instructMicrosoftScore62.8%Percentile6.2%Participants66EvidenceCEvaluatedAug 17, 2026
Rank63ModelGOGemma 2 27BGoogleScore51.8%Percentile4.6%Participants66EvidenceCEvaluatedAug 17, 2026
Rank64ModelGOGemma 3 1BGoogleScore41.5%Percentile3.1%Participants66EvidenceCEvaluatedAug 17, 2026
Rank65ModelGOGemma 2 9BGoogleScore40.2%Percentile1.5%Participants66EvidenceCEvaluatedAug 17, 2026
Rank66ModelMAMinistral 8B InstructMistral AIScore34.8%Percentile0.0%Participants66EvidenceCEvaluatedAug 17, 2026

HumanEval Highlights

The leading models and scores on this benchmark.

Rank #1MiniCPM-SALA95.1%Rank #2Kimi K2 090594.5%Rank #3Claude 3.5 Sonnet93.7%Rank #4GPT-593.4%

HumanEval Score Distribution

A closer view of the leading scores on this benchmark.

HumanEval

The Top AI Models for HumanEval

The first five results on this benchmark, with official price and output speed added where the model identity can be matched.

Ranking basisThis humaneval AI model leaderboard uses descending score in the benchmark's original unit. The leaderboard ranking keeps matched price and speed data separate from benchmark evidence.

  1. 01
    OP
    MiniCPM-SALAOpenBMB
    Score
    95.1%

    Strengths

    • Ranks #1 of 66 compared models
    • 100th percentile on this benchmark
    • C evidence result

    Considerations

    • This result measures HumanEval, not total model capability
  2. 02
    MA
    Kimi K2 0905Moonshot AI
    Score
    94.5%
    Price
    $0.60 input / $2.5 output per 1M tokens
    Speed
    Up to 45 tok/s via Novita

    Strengths

    • Ranks #2 of 66 compared models
    • 98th percentile on this benchmark
    • C evidence result

    Considerations

    • This result measures HumanEval, not total model capability
  3. 03
    AN
    Claude 3.5 SonnetAnthropic
    Score
    93.7%
    Speed
    Up to 101 tok/s via Bedrock

    Strengths

    • Ranks #3 of 66 compared models
    • 97th percentile on this benchmark
    • C evidence result

    Considerations

    • This result measures HumanEval, not total model capability
  4. 04
    OP
    GPT-5OpenAI
    Score
    93.4%
    Price
    $1.3 input / $10 output per 1M tokens
    Speed
    Up to 100 tok/s via OpenAI

    Strengths

    • Ranks #4 of 66 compared models
    • 95th percentile on this benchmark
    • C evidence result

    Considerations

    • This result measures HumanEval, not total model capability
  5. 05
    MA
    Kimi K2 InstructMoonshot AI
    Score
    93.3%
    Price
    $0.60 input / $2.5 output per 1M tokens
    Speed
    Up to 45 tok/s via Novita

    Strengths

    • Ranks #5 of 66 compared models
    • 94th percentile on this benchmark
    • C evidence result

    Considerations

    • This result measures HumanEval, not total model capability

Selection summary

Best AI Models for HumanEval

MiniCPM-SALA currently leads HumanEval with 95.1%. It is the top model on this specific benchmark, while the best LLM for the broader task should also be checked against other benchmarks, price and runtime.

Use this leaderboard with the supporting benchmark results and coverage details above. A leaderboard position summarizes the selected ranking signal; it does not replace workload-specific testing.

Benchmark rank #1MiniCPM-SALA95.1%Benchmark rank #2Kimi K2 090594.5% · $0.60 input / $2.5 output per 1M tokensBenchmark rank #3Claude 3.5 Sonnet93.7% · Up to 101 tok/s via Bedrock

What is HumanEval?

What HumanEval measures and how its scores work.

A benchmark that measures functional correctness for synthesizing programs from docstrings, consisting of 164 original programming problems assessing language comprehension, algorithms, and simple mathematics

Scores are shown in ratio. This benchmark is not independently verified and has an evidence level of B.

Family
HumanEval
Modality
text
Primary category
reasoning
Score direction
higher
LLMBoard eligible
Yes
Evaluation key
humaneval|llm-stats-current

Benchmark scores retain their original unit. Overall score eligibility is shown separately.

FAQ

Common questions about HumanEval.

Which model scores highest on HumanEval?

MiniCPM-SALA is currently ranked first with 95.1%.

What does HumanEval measure?

A benchmark that measures functional correctness for synthesizing programs from docstrings, consisting of 164 original programming problems assessing language comprehension, algorithms, and simple mathematics

Is a higher score better?

Yes. Higher values rank better for this benchmark.

How many models are compared?

66 model results are currently shown.

Does this benchmark affect the overall score?

Yes. This benchmark can contribute to the current LLMBoard capability score.