Capability ranking
Best LLMs Ranked by Capability
Updated 2026-08-11
A quick reading of the current overall ranking before the full data table.
Claude Opus 5 leads this page at 97.4, 1.6 points ahead of Claude Fable 5.
Kimi K3 is the highest-ranked open-weight option at #5. Nova Micro has the lowest official input price among ranked models.
The leading overall scores, with the axis focused on the competitive range rather than zero.
Compare each leading model's overall score with its weakest measured capability.
The table combines core capability scores, specifications, official pricing and featured benchmark results. Use Columns to show additional benchmarks.
| 01 | AN | Claude Opus 5 | 97.4 | 100.0 | 99.5 | N/A | 85.9 | N/A | 60.0% | 1M | Closed weights | $5 | $25 | N/A | N/A | N/A | N/A | N/A | 64.7% | N/A | N/A | N/A | N/A |
| 02 | AN | Claude Fable 5 | 95.8 | N/A | 97.8 | N/A | 94.1 | N/A | 40.0% | 1M | Closed weights | $10 | $50 | N/A | N/A | N/A | 95.0% | N/A | 64.5% | N/A | N/A | N/A | N/A |
| 03 | OP | GPT-5.6 Sol | 95.1 | 99.8 | 86.3 | 100.0 | 93.6 | N/A | 80.0% | 1.1M | Closed weights | $5 | $30 | 94.6% | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | 83.0% |
| 04 | AN | Claude Mythos Preview | 93.6 | 99.8 | 99.7 | 100.0 | 98.7 | N/A | 80.0% | N/A | Closed weights | N/A | N/A | 94.6% | N/A | N/A | 93.9% | N/A | 64.7% | N/A | N/A | N/A | N/A |
| 05 | MA | Kimi K3 | 93.0 | 97.4 | 91.3 | N/A | 90.5 | N/A | 60.0% | 1M | Open weights | $3 | $15 | 93.5% | N/A | N/A | N/A | N/A | 56.0% | N/A | N/A | N/A | 81.6% |
| 06 | AC | Qwen3.8 Max | 89.3 | 97.6 | 70.7 | N/A | 80.1 | 100.0 | 80.0% | 1M | Closed weights | $2 | $6 | 92.6% | N/A | N/A | N/A | N/A | 43.6% | N/A | N/A | N/A | 82.3% |
| 07 | ME | Muse Spark 1.1 | 88.3 | N/A | 96.7 | N/A | 52.1 | N/A | 40.0% | 1M | Closed weights | $1.25 | $4.25 | N/A | N/A | N/A | N/A | N/A | 62.1% | N/A | N/A | N/A | N/A |
| 08 | AN | Claude Opus 4.8 | 87.9 | 99.0 | 94.6 | N/A | 85.7 | N/A | 60.0% | 1M | Closed weights | $5 | $25 | 93.6% | N/A | N/A | 88.6% | N/A | 57.9% | N/A | N/A | N/A | N/A |
| 09 | OP | GPT-5.6 Terra | 87.6 | 96.1 | 56.3 | 93.8 | 78.8 | N/A | 80.0% | 1.1M | Closed weights | $2 | $12 | 92.9% | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | 80.7% |
| 10 | AN | Claude Opus 4.7 | 84.2 | 98.7 | 90.1 | N/A | 71.5 | N/A | 60.0% | 1M | Closed weights | $5 | $25 | 94.2% | N/A | N/A | 87.6% | N/A | 54.7% | N/A | N/A | N/A | N/A |
| 11 | AN | Claude Sonnet 5 | 84.0 | N/A | 93.5 | 50.0 | 79.2 | N/A | 60.0% | 1M | Closed weights | $2 | $10 | N/A | N/A | N/A | 85.2% | N/A | 57.4% | N/A | N/A | N/A | N/A |
| 12 | OP | GPT-5.5 | 84.0 | 99.0 | 83.7 | 62.5 | 74.3 | N/A | 80.0% | 1.1M | Closed weights | $5 | $30 | 93.6% | N/A | N/A | N/A | N/A | 52.2% | N/A | N/A | N/A | 83.2% |
| 13 | ME | Muse Spark 1.2 | 82.3 | N/A | N/A | N/A | 62.1 | N/A | 20.0% | 1M | Closed weights | $1.25 | $4.25 | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 14 | XA | Grok 4.5 | 82.2 | 96.6 | N/A | N/A | 64.9 | N/A | 40.0% | 500K | Closed weights | $2 | $6 | 93.0% | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 15 | AN | Claude Opus 4.6 | 79.6 | 83.2 | 87.7 | 95.6 | 74.7 | N/A | 80.0% | 1M | Closed weights | $5 | $25 | 91.3% | N/A | 99.8% | 80.8% | N/A | 53.1% | N/A | N/A | N/A | 77.3% |
| 16 | GO | Gemini 3.6 Flash | 79.3 | N/A | N/A | N/A | 44.5 | N/A | 20.0% | 1M | Closed weights | $1.5 | $7.5 | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 17 | ZA | GLM-5.2 | 79.3 | 92.7 | 88.6 | 89.8 | 56.0 | N/A | 80.0% | 1M | Open weights | $1.4 | $4.4 | 91.2% | N/A | N/A | N/A | N/A | 54.7% | N/A | N/A | N/A | N/A |
| 18 | GO | Gemini 3.5 Flash | 79.2 | 80.0 | 65.2 | N/A | 45.7 | N/A | 60.0% | 1M | Closed weights | $1.5 | $9 | N/A | N/A | N/A | N/A | N/A | 40.2% | N/A | N/A | N/A | 83.6% |
| 19 | AC | Qwen3.7 Max | 78.8 | 91.5 | 89.1 | 93.1 | 85.6 | 92.2 | 100.0% | 1M | Closed weights | $2.5 | $7.5 | 92.4% | 89.6% | N/A | 80.4% | N/A | 41.4% | N/A | N/A | N/A | N/A |
| 20 | BY | Seed 2.1 Pro | 78.7 | 95.5 | 90.6 | 33.3 | 54.3 | N/A | 80.0% | N/A | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | N/A | 55.7% | N/A | N/A | N/A | 82.7% |
| 21 | DE | DeepSeek-V4-Flash-0731 | 78.3 | N/A | N/A | N/A | 66.9 | N/A | 20.0% | 1M | Open weights | $0.14 | $0.28 | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 22 | GO | Gemini 3.1 Pro | 77.5 | 96.2 | 90.3 | N/A | 54.0 | N/A | 60.0% | 1M | Closed weights | $2 | $12 | 94.3% | N/A | N/A | 80.6% | N/A | 51.4% | N/A | N/A | N/A | 80.5% |
| 23 | OP | GPT-5.4 | 77.1 | 91.2 | 63.0 | 81.3 | 55.2 | N/A | 80.0% | 1.1M | Closed weights | $2.5 | $15 | 92.8% | N/A | N/A | N/A | N/A | 39.8% | N/A | N/A | N/A | 81.2% |
| 24 | OP | GPT-5.6 Luna | 76.4 | 94.0 | 35.0 | 87.5 | 67.8 | N/A | 80.0% | 1.1M | Closed weights | $0.20 | $1.2 | 92.3% | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | 78.4% |
| 25 | OP | GPT-5.5 Pro | 75.8 | N/A | 92.4 | 68.8 | N/A | N/A | 40.0% | 1.1M | Closed weights | $30 | $180 | N/A | N/A | N/A | N/A | N/A | 57.2% | N/A | N/A | N/A | N/A |
| 26 | MA | Kimi K2.6 | 75.5 | 92.3 | 58.7 | 72.7 | 71.2 | N/A | 80.0% | 262.1K | Open weights | $0.95 | $4 | 90.5% | N/A | N/A | 80.2% | N/A | 36.4% | N/A | N/A | N/A | 80.1% |
| 27 | DE | DeepSeek-V4-Pro-Max | 73.8 | 90.1 | 84.8 | 83.9 | 63.7 | N/A | 80.0% | 1M | Closed weights | $0.435 | $0.87 | 90.1% | 87.5% | N/A | 80.6% | N/A | 48.2% | 93.5% | N/A | N/A | N/A |
| 28 | AC | Qwen3.7-Plus | 73.8 | 84.7 | 83.5 | 66.9 | 61.6 | 87.8 | 100.0% | 1M | Closed weights | $0.50 | $3 | 90.3% | 88.5% | N/A | 77.7% | N/A | 34.7% | N/A | N/A | N/A | 79.0% |
| 29 | ME | Muse Spark | 73.2 | 68.0 | 97.8 | N/A | 47.2 | N/A | 60.0% | N/A | Closed weights | N/A | N/A | 89.5% | N/A | N/A | 77.4% | N/A | 58.4% | N/A | N/A | N/A | 80.4% |
| 30 | BY | Seed 2.1 Turbo | 73.1 | 90.9 | 85.9 | 39.6 | 42.5 | N/A | 80.0% | N/A | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | N/A | 54.6% | N/A | N/A | N/A | 82.2% |
| 31 | AN | Claude Sonnet 4.6 | 72.6 | 78.2 | 77.7 | N/A | 48.7 | N/A | 60.0% | 1M | Closed weights | $3 | $15 | 89.9% | N/A | N/A | 79.6% | N/A | 49.0% | N/A | N/A | N/A | 75.6% |
| 32 | OP | GPT-5.2 Pro | 71.6 | 78.5 | 59.8 | 99.1 | N/A | N/A | 60.0% | 400K | Closed weights | $21 | $168 | 93.2% | N/A | 100.0% | N/A | N/A | 36.6% | N/A | N/A | N/A | N/A |
| 33 | OP | GPT-5.2 | 71.4 | 74.0 | 69.9 | 90.0 | 87.5 | N/A | 80.0% | 400K | Closed weights | $1.75 | $14 | 92.4% | N/A | 100.0% | 80.0% | N/A | 34.5% | N/A | N/A | N/A | 79.5% |
| 34 | MI | MiniMax M3 | 71.3 | N/A | N/A | 100.0 | 44.8 | N/A | 40.0% | 512K | Open weights | $0.30 | $1.2 | N/A | N/A | N/A | 80.5% | N/A | N/A | N/A | N/A | N/A | 78.1% |
| 35 | TE | Hy3 | 71.0 | 91.4 | 0.0 | 86.1 | 53.5 | N/A | 80.0% | 256K | Open weights | N/A | N/A | 90.4% | N/A | N/A | 78.0% | N/A | N/A | N/A | N/A | N/A | N/A |
| 36 | ZA | GLM-5.1 | 69.6 | 80.7 | 84.8 | 68.1 | 53.8 | N/A | 80.0% | 200K | Open weights | $1.4 | $4.4 | 86.2% | N/A | N/A | N/A | N/A | 52.3% | N/A | N/A | N/A | N/A |
| 37 | BY | Seed 2.0 Pro | 69.5 | 88.8 | N/A | 89.4 | 83.2 | N/A | 60.0% | 256K | Closed weights | N/A | N/A | 88.9% | N/A | 98.3% | 76.5% | N/A | N/A | N/A | N/A | N/A | N/A |
| 38 | AN | Claude Opus 4.5 | 69.5 | 61.3 | 87.5 | N/A | 76.2 | N/A | 60.0% | 200K | Closed weights | $5 | $25 | 87.0% | N/A | N/A | 80.9% | N/A | N/A | N/A | N/A | N/A | N/A |
| 39 | GO | Gemini 3.5 Flash Cyber | 68.9 | N/A | N/A | N/A | N/A | N/A | 0.0% | N/A | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 40 | XA | Grok-4 Heavy | 68.2 | 88.2 | 80.4 | 99.1 | 86.1 | N/A | 80.0% | N/A | Closed weights | N/A | N/A | 88.4% | N/A | 100.0% | N/A | N/A | 50.7% | 79.4% | N/A | N/A | N/A |
| 41 | AC | Qwen3.6 Plus | 67.5 | 80.9 | 87.3 | 73.3 | 51.8 | 72.7 | 100.0% | 1M | Closed weights | $0.50 | $3 | 90.4% | 88.5% | N/A | 78.8% | N/A | 28.8% | N/A | N/A | N/A | 78.8% |
| 42 | GO | Gemini 3 Pro | 67.3 | 73.4 | 74.5 | 98.2 | 54.4 | N/A | 80.0% | 1M | Closed weights | N/A | N/A | 91.9% | N/A | 100.0% | 76.2% | N/A | 45.8% | N/A | N/A | N/A | 81.0% |
| 43 | ZA | GLM-5 | 67.2 | N/A | N/A | N/A | 61.8 | N/A | 20.0% | 204.8K | Open weights | $1 | $3.2 | N/A | N/A | N/A | 77.8% | N/A | N/A | N/A | N/A | N/A | N/A |
| 44 | MA | Kimi K2.7 Code | 66.8 | N/A | N/A | N/A | 19.6 | N/A | 20.0% | 262.1K | Open weights | $0.95 | $4 | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 45 | AC | Qwen3.5-397B-A17B | 66.3 | 81.3 | 82.8 | 50.1 | 57.4 | 81.9 | 100.0% | 262.1K | Open weights | $0.60 | $3.6 | 88.4% | 87.8% | N/A | 76.4% | N/A | 28.7% | N/A | N/A | N/A | N/A |
| 46 | MA | Kimi K2.5 | 66.0 | 84.1 | 87.3 | 67.3 | 47.3 | N/A | 80.0% | 262.1K | Open weights | $0.60 | $3 | 87.6% | 87.1% | 96.1% | 76.8% | N/A | 50.2% | N/A | N/A | N/A | 78.5% |
| 47 | GO | Gemini 3 Flash | 64.8 | 72.1 | 69.0 | 94.7 | 53.4 | N/A | 80.0% | 1M | Closed weights | $0.50 | $3 | 90.4% | N/A | 99.7% | 78.0% | N/A | 43.5% | N/A | N/A | N/A | 81.2% |
| 48 | XI | MiMo-V2-Pro | 64.0 | N/A | N/A | N/A | 62.6 | N/A | 20.0% | 1M | Closed weights | $0.435 | $0.87 | N/A | N/A | N/A | 78.0% | N/A | N/A | N/A | N/A | N/A | N/A |
| 49 | OP | GPT-5.3 Codex | 62.9 | N/A | N/A | N/A | 69.6 | N/A | 20.0% | 400K | Closed weights | $1.75 | $14 | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 50 | NV | Nemotron 3 Ultra (550B A55B) | 62.9 | 82.6 | 77.3 | 100.0 | 49.3 | 85.3 | 100.0% | 1M | Open weights | $0.50 | $2.5 | 87.0% | 86.8% | N/A | 70.7% | N/A | 37.4% | N/A | N/A | N/A | N/A |
| 51 | OP | GPT-5.1 | 62.1 | 86.5 | N/A | 63.9 | 71.2 | N/A | 60.0% | 400K | Closed weights | $1.25 | $10 | 88.1% | N/A | 94.0% | 76.3% | N/A | N/A | N/A | N/A | N/A | N/A |
| 52 | XI | MiMo-V2.5 | 61.8 | N/A | N/A | N/A | 52.6 | N/A | 20.0% | 1M | Open weights | $0.14 | $0.28 | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | 77.9% |
| 53 | OP | GPT-5.1 Instant | 61.3 | 86.5 | N/A | 63.9 | 71.2 | N/A | 60.0% | 400K | Closed weights | N/A | N/A | 88.1% | N/A | 94.0% | 76.3% | N/A | N/A | N/A | N/A | N/A | N/A |
| 54 | MA | Kimi K2-Thinking-0905 | 61.0 | 75.5 | 82.0 | 65.7 | 61.0 | 0.0 | 100.0% | 262.1K | Closed weights | $0.60 | $2.5 | 84.5% | 84.6% | 100.0% | 71.3% | N/A | 51.0% | N/A | N/A | N/A | N/A |
| 55 | ME | LongCat-Flash-Thinking-2601 | 60.8 | 63.5 | 48.9 | 50.9 | 68.4 | N/A | 80.0% | 128K | Closed weights | N/A | N/A | 80.5% | N/A | 99.6% | 70.0% | N/A | 25.2% | 82.8% | N/A | N/A | N/A |
| 56 | AC | Qwen3.6-27B | 60.5 | 71.8 | 71.4 | 49.9 | 49.0 | N/A | 80.0% | 262.1K | Open weights | $0.60 | $3.6 | 87.8% | 86.2% | N/A | 77.2% | N/A | 24.0% | N/A | N/A | N/A | 75.8% |
| 57 | OP | GPT-5.4 mini | 60.5 | 85.0 | 51.1 | N/A | 43.9 | N/A | 60.0% | 400K | Closed weights | $0.75 | $4.5 | 88.0% | N/A | N/A | N/A | N/A | 28.2% | N/A | N/A | N/A | 76.6% |
| 58 | ST | Step-3.5-Flash | 60.4 | N/A | N/A | 72.0 | 60.4 | N/A | 40.0% | 256K | Open weights | $0.10 | $0.30 | N/A | N/A | 97.3% | 74.4% | N/A | N/A | N/A | N/A | N/A | N/A |
| 59 | GO | Gemma 4 31B | 60.1 | 87.6 | 67.4 | 35.3 | 61.5 | N/A | 80.0% | 262.1K | Open weights | N/A | N/A | 84.3% | 85.2% | N/A | N/A | N/A | 26.5% | N/A | N/A | N/A | 76.9% |
| 60 | ZA | GLM-4.7 | 59.7 | 79.4 | 74.5 | 60.6 | 47.2 | N/A | 80.0% | 204.8K | Open weights | $0.60 | $2.2 | 85.7% | 84.3% | 95.7% | 73.8% | N/A | 42.8% | N/A | N/A | N/A | N/A |
| 61 | AC | Qwen3.5-122B-A10B | 59.2 | 67.4 | 84.6 | 56.3 | 54.2 | 69.8 | 100.0% | 262.1K | Open weights | $0.40 | $3.2 | 86.6% | 86.7% | N/A | 72.0% | N/A | 47.5% | N/A | N/A | N/A | 76.9% |
| 62 | OP | GPT-5.2 Codex | 58.9 | N/A | N/A | N/A | 52.8 | N/A | 20.0% | 400K | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 63 | BA | ERNIE 5.0 | 58.7 | 77.3 | 82.5 | 50.9 | N/A | N/A | 60.0% | N/A | Closed weights | N/A | N/A | 85.0% | 87.0% | 87.0% | N/A | N/A | 39.0% | N/A | N/A | N/A | N/A |
| 64 | ME | Muse Glimmer-30B | 58.5 | 72.5 | 40.8 | 76.5 | 31.6 | 78.6 | 100.0% | 131.1K | Open weights | N/A | N/A | 83.5% | N/A | N/A | 76.0% | N/A | 22.0% | N/A | N/A | N/A | 74.0% |
| 65 | MI | MiniMax M2.7 | 58.4 | N/A | N/A | N/A | 47.9 | N/A | 20.0% | 204.8K | Open weights | $0.30 | $1.2 | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 66 | DE | DeepSeek-V3.2-Speciale | 58.1 | N/A | 54.4 | 88.5 | 54.1 | N/A | 60.0% | 131.1K | Closed weights | $0.14 | $0.28 | N/A | N/A | 96.0% | 73.1% | N/A | 30.6% | N/A | N/A | N/A | N/A |
| 67 | AC | Qwen3.5-27B | 57.2 | 62.5 | 78.0 | 59.4 | 47.9 | 70.6 | 100.0% | 262.1K | Open weights | $0.30 | $2.4 | 85.5% | 86.1% | N/A | 72.4% | N/A | 48.5% | N/A | N/A | N/A | 75.0% |
| 68 | XA | Grok-4.20 Beta Reasoning | 57.1 | N/A | N/A | N/A | N/A | N/A | 0.0% | 2M | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 69 | ZA | GLM-5V-Turbo | 57.0 | N/A | 16.7 | N/A | N/A | N/A | 20.0% | 200K | Closed weights | $5 | $22 | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 70 | GO | Gemini 3.5 Flash-Lite | 57.0 | N/A | N/A | N/A | 14.7 | N/A | 20.0% | 1M | Closed weights | $0.30 | $2.5 | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 71 | XA | Grok-4 | 56.5 | 51.9 | 64.1 | 72.3 | 83.3 | N/A | 80.0% | 256K | Closed weights | N/A | N/A | 87.5% | N/A | 91.7% | N/A | N/A | 40.0% | 79.0% | N/A | N/A | N/A |
| 72 | AN | Claude Sonnet 4.5 | 56.0 | 72.1 | 75.0 | 50.9 | 100.0 | N/A | 80.0% | 200K | Closed weights | $3 | $15 | 83.4% | N/A | 87.0% | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 73 | MI | MiniMax M2.5 | 55.6 | N/A | N/A | N/A | 61.0 | N/A | 20.0% | 204.8K | Open weights | $0.30 | $1.2 | N/A | N/A | N/A | 80.2% | N/A | N/A | N/A | N/A | N/A | N/A |
| 74 | AC | Qwen3.6-35B-A3B | 55.3 | 80.3 | 61.6 | 40.9 | 32.3 | N/A | 80.0% | 262.1K | Open weights | $0.248 | $1.49 | 86.0% | 85.2% | N/A | 73.4% | N/A | 21.4% | N/A | N/A | N/A | 75.3% |
| 75 | MI | MAI-Thinking-1 | 55.1 | 74.5 | 71.1 | 58.8 | 45.8 | 38.4 | 100.0% | N/A | Closed weights | N/A | N/A | 84.2% | 85.0% | 97.0% | 73.5% | N/A | N/A | N/A | N/A | N/A | N/A |
| 76 | XA | Grok-3 | 54.8 | 76.2 | N/A | 75.2 | 86.1 | N/A | 60.0% | 128K | Closed weights | N/A | N/A | 84.6% | N/A | 93.3% | N/A | N/A | N/A | 79.4% | N/A | N/A | N/A |
| 77 | ZA | GLM-4.6 | 54.2 | 65.2 | 29.9 | 76.1 | 60.8 | N/A | 80.0% | 204.8K | Open weights | $0.60 | $2.2 | 81.0% | N/A | 93.9% | 68.0% | N/A | 17.2% | N/A | N/A | N/A | N/A |
| 78 | XA | Grok 4 Fast | 54.0 | 79.4 | 67.4 | 65.2 | 88.9 | N/A | 80.0% | 2M | Closed weights | N/A | N/A | 85.7% | N/A | 92.0% | N/A | N/A | 20.0% | 80.0% | N/A | N/A | N/A |
| 79 | OP | GPT-5.5 Instant | 53.7 | 78.5 | 12.5 | 40.7 | N/A | N/A | 60.0% | 400K | Closed weights | N/A | N/A | 85.6% | N/A | 81.2% | N/A | N/A | N/A | N/A | N/A | N/A | 76.0% |
| 80 | MI | MiniMax M2.1 | 53.7 | 65.2 | 69.2 | 39.8 | 60.9 | 39.3 | 100.0% | 204.8K | Open weights | $0.30 | $1.2 | 81.0% | 88.0% | 81.0% | 67.0% | N/A | 22.0% | 78.0% | N/A | N/A | N/A |
| 81 | BY | Seed 2.0 Lite | 53.6 | 77.7 | N/A | 72.6 | 65.6 | N/A | 60.0% | N/A | Closed weights | N/A | N/A | 85.1% | N/A | 93.0% | 73.5% | N/A | N/A | N/A | N/A | N/A | N/A |
| 82 | XI | MiMo-V2-Omni | 53.3 | N/A | N/A | N/A | 66.3 | N/A | 20.0% | 262.1K | Closed weights | $0.14 | $0.28 | N/A | N/A | N/A | 74.8% | N/A | N/A | N/A | N/A | N/A | N/A |
| 83 | GO | Gemma 4 26B-A4B | 52.6 | 79.2 | 52.8 | 26.5 | 57.7 | N/A | 80.0% | 262.1K | Open weights | N/A | N/A | 82.3% | 82.6% | N/A | N/A | N/A | 17.2% | N/A | N/A | N/A | 73.8% |
| 84 | OP | o3 | 52.6 | 47.3 | 22.3 | 37.3 | 64.5 | 67.9 | 100.0% | 200K | Closed weights | $2 | $8 | 83.3% | N/A | 86.4% | 69.1% | N/A | 14.7% | N/A | N/A | N/A | 76.4% |
| 85 | AM | Nova 2 Pro | 52.5 | 66.7 | 68.0 | 68.6 | 67.8 | 94.7 | 100.0% | N/A | Closed weights | N/A | N/A | 81.4% | 81.6% | 92.3% | 70.0% | N/A | N/A | 74.6% | N/A | N/A | 63.5% |
| 86 | AN | Claude Opus 4.1 | 52.4 | 64.2 | 80.2 | 34.5 | 74.1 | N/A | 80.0% | 200K | Closed weights | N/A | N/A | 80.9% | N/A | 78.0% | 74.5% | N/A | N/A | N/A | N/A | N/A | N/A |
| 87 | AC | Qwen3.5-35B-A3B | 52.0 | 61.8 | 71.2 | 43.8 | 44.2 | 54.4 | 100.0% | 262.1K | Open weights | $0.25 | $2 | 84.2% | 85.3% | N/A | 69.2% | N/A | 47.4% | N/A | N/A | N/A | 75.1% |
| 88 | GO | Gemini 3.1 Flash-Lite | 51.9 | 82.0 | 41.6 | N/A | N/A | N/A | 40.0% | 1M | Closed weights | $0.25 | $1.5 | 86.9% | N/A | N/A | N/A | N/A | 16.0% | N/A | N/A | N/A | 76.8% |
| 89 | XI | MiMo-V2-Flash | 51.3 | 73.0 | 63.0 | 57.0 | 46.5 | N/A | 80.0% | 262.1K | Open weights | $0.14 | $0.28 | 83.7% | 84.9% | 94.1% | 73.4% | N/A | 22.1% | N/A | N/A | N/A | N/A |
| 90 | XA | Grok-4.1 Thinking | 51.2 | N/A | N/A | N/A | N/A | 75.0 | 20.0% | 256K | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 91 | MI | MAI-Code-1-Flash | 50.4 | 76.2 | 33.7 | 26.7 | 32.2 | 64.3 | 100.0% | 256K | Closed weights | N/A | N/A | 84.6% | N/A | N/A | 71.6% | N/A | 18.0% | N/A | N/A | N/A | N/A |
| 92 | GO | Gemini 2.5 Pro Preview 06-05 | 49.9 | 81.1 | 78.7 | 54.9 | 66.1 | 100.0 | 100.0% | 1M | Closed weights | $1.25 | $10 | 86.4% | N/A | 88.0% | 67.2% | N/A | 21.6% | 69.0% | N/A | N/A | N/A |
| 93 | OP | GPT-5 Medium | 49.8 | 86.5 | N/A | 55.8 | N/A | N/A | 40.0% | 400K | Closed weights | $1.25 | $10 | 88.1% | N/A | 88.9% | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 94 | OP | GPT-5.1 Codex | 49.5 | N/A | N/A | N/A | 49.5 | N/A | 20.0% | 400K | Closed weights | N/A | N/A | N/A | N/A | N/A | 73.7% | N/A | N/A | N/A | N/A | N/A | N/A |
| 95 | ZA | GLM-4.5 | 49.3 | 61.4 | 51.3 | 90.0 | 49.6 | N/A | 80.0% | 131.1K | Open weights | $0.60 | $2.2 | 79.1% | 84.6% | N/A | 64.2% | N/A | 14.4% | 72.9% | N/A | N/A | N/A |
| 96 | MA | Mistral Medium 3.5 | 49.2 | N/A | N/A | 48.7 | 77.9 | 30.4 | 60.0% | 262.1K | Open weights | $1.5 | $7.5 | N/A | N/A | 86.3% | 77.6% | N/A | N/A | N/A | N/A | N/A | N/A |
| 97 | OP | GPT-5.4 nano | 49.1 | 70.6 | 45.6 | N/A | 14.6 | N/A | 60.0% | 400K | Closed weights | $0.20 | $1.25 | 82.8% | N/A | N/A | N/A | N/A | 24.3% | N/A | N/A | N/A | 66.1% |
| 98 | AC | Qwen3-235B-A22B-Thinking-2507 | 48.5 | 71.4 | 61.9 | 63.5 | 53.9 | 84.9 | 100.0% | 262.1K | Closed weights | N/A | N/A | 81.1% | 84.4% | 92.3% | N/A | N/A | 18.2% | N/A | N/A | N/A | N/A |
| 99 | XA | Grok-3 Mini | 48.4 | 73.6 | N/A | 61.1 | 90.3 | N/A | 60.0% | 128K | Closed weights | N/A | N/A | 84.0% | N/A | 90.8% | N/A | N/A | N/A | 80.4% | N/A | N/A | N/A |
| 100 | XI | MiMo-V2.5-Pro | 46.7 | 84.0 | 62.8 | 92.8 | 49.7 | N/A | 80.0% | 1M | Open weights | $0.435 | $0.87 | 66.7% | 68.5% | N/A | 78.9% | 89.4% | 34.0% | N/A | 86.2% | N/A | N/A |
| 101 | XA | Grok-4.1 | 46.6 | N/A | N/A | N/A | N/A | 50.0 | 20.0% | 256K | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 102 | OP | GPT OSS 20B High | 46.5 | 52.6 | N/A | 91.2 | N/A | N/A | 40.0% | 131.1K | Closed weights | N/A | N/A | 74.2% | N/A | 98.7% | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 103 | AN | Claude Opus 4 | 46.4 | 37.7 | 68.8 | 31.9 | 57.2 | N/A | 80.0% | 200K | Closed weights | N/A | N/A | 79.6% | N/A | 75.5% | 72.5% | N/A | N/A | N/A | N/A | N/A | N/A |
| 104 | AC | Qwen3 VL 235B A22B Thinking | 45.8 | 58.6 | 55.9 | 53.8 | 46.1 | 77.7 | 100.0% | 262.1K | Closed weights | N/A | N/A | N/A | 83.8% | 89.7% | N/A | 90.6% | 13.6% | N/A | N/A | N/A | 69.3% |
| 105 | AN | Claude Haiku 4.5 | 45.5 | 48.9 | 27.1 | 38.9 | 65.9 | N/A | 80.0% | 200K | Closed weights | $1 | $5 | 73.0% | N/A | 80.7% | 73.3% | N/A | N/A | N/A | N/A | N/A | N/A |
| 106 | OP | o4-mini | 45.0 | 66.7 | 22.3 | 70.8 | 58.5 | 28.6 | 100.0% | 200K | Closed weights | $1.1 | $4.4 | 81.4% | N/A | 92.7% | 68.1% | N/A | 14.7% | N/A | N/A | N/A | N/A |
| 107 | OP | GPT-5 mini | 44.9 | 68.5 | 28.3 | 45.0 | N/A | N/A | 60.0% | 400K | Closed weights | $0.25 | $2 | 82.3% | N/A | 91.1% | N/A | N/A | 16.7% | N/A | N/A | N/A | N/A |
| 108 | LA | K-EXAONE-236B-A23B | 44.9 | N/A | 79.3 | 71.7 | 68.3 | 21.4 | 80.0% | 32.8K | Closed weights | N/A | N/A | N/A | 83.8% | 92.8% | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 109 | NV | Nemotron 3 Super (120B A12B) | 44.8 | 70.0 | 60.8 | 68.7 | 31.9 | 71.4 | 100.0% | 262.1K | Open weights | $0.20 | $0.80 | 82.7% | 83.7% | 90.2% | 53.7% | N/A | 22.8% | 81.2% | N/A | N/A | N/A |
| 110 | SA | Sarvam-105B | 44.6 | 60.1 | 42.0 | 73.4 | 31.7 | 40.6 | 100.0% | 131.1K | Open weights | N/A | N/A | 78.7% | 81.7% | 96.7% | 45.0% | 90.6% | 11.2% | N/A | N/A | N/A | N/A |
| 111 | DE | DeepSeek-R1-0528 | 44.2 | 65.2 | 70.3 | 38.6 | 30.0 | N/A | 80.0% | 131.1K | Closed weights | N/A | N/A | 81.0% | 85.0% | 87.5% | 44.6% | N/A | 17.7% | 73.3% | N/A | N/A | N/A |
| 112 | OP | GPT OSS 120B High | 44.0 | 64.2 | 62.1 | 69.9 | 73.1 | 35.7 | 100.0% | 131.1K | Closed weights | N/A | N/A | 80.9% | 80.7% | 92.5% | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 113 | MI | MiniMax M2 | 43.9 | 59.4 | 43.9 | 34.5 | 49.8 | N/A | 80.0% | 196.6K | Open weights | $0.30 | $1.2 | 78.0% | 82.0% | 78.0% | 69.4% | N/A | 12.5% | 83.0% | N/A | N/A | N/A |
| 114 | AM | Nova 2 Omni | 43.9 | N/A | 62.1 | 67.3 | N/A | 58.9 | 60.0% | N/A | Closed weights | N/A | N/A | N/A | 80.7% | 92.1% | N/A | N/A | N/A | N/A | N/A | N/A | 61.4% |
| 115 | OP | GPT-5 Codex | 43.6 | N/A | N/A | N/A | 64.9 | N/A | 20.0% | 400K | Closed weights | N/A | N/A | N/A | N/A | N/A | 74.5% | N/A | N/A | N/A | N/A | N/A | N/A |
| 116 | ST | Step3-VL-10B | 43.6 | N/A | N/A | 53.1 | N/A | 78.6 | 40.0% | N/A | Closed weights | N/A | N/A | N/A | N/A | 87.7% | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 117 | AC | Qwen3 VL 235B A22B Instruct | 43.2 | 54.0 | 64.8 | 28.0 | 53.2 | 76.8 | 100.0% | 262.1K | Closed weights | N/A | N/A | N/A | 81.8% | 74.7% | N/A | 88.8% | N/A | N/A | N/A | N/A | 68.1% |
| 118 | AM | Nova 2 Lite | 43.0 | 62.0 | 63.3 | 62.0 | 45.6 | 71.4 | 100.0% | 1M | Closed weights | $0.33 | $2.75 | 79.6% | 80.9% | 91.0% | 64.5% | N/A | N/A | 71.0% | N/A | N/A | 61.8% |
| 119 | AC | Qwen3-235B-A22B-Instruct-2507 | 42.4 | 61.1 | 70.6 | 21.5 | 51.2 | 72.8 | 100.0% | 262.1K | Open weights | $0.70 | $2.8 | 77.5% | 83.0% | 70.3% | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 120 | OP | GPT-5.3 Chat | 42.2 | N/A | 31.3 | N/A | N/A | N/A | 20.0% | 128K | Closed weights | $1.75 | $14 | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 121 | CO | Command A+ | 41.9 | N/A | N/A | 58.4 | 19.4 | 64.9 | 60.0% | 128K | Open weights | $2.5 | $10 | N/A | N/A | 90.0% | N/A | N/A | N/A | N/A | N/A | N/A | 63.0% |
| 122 | ZA | GLM-4.5-Air | 41.5 | 54.3 | 39.6 | 86.5 | 30.9 | N/A | 80.0% | 131.1K | Open weights | $0.20 | $1.1 | 75.0% | 81.4% | N/A | 57.6% | N/A | 10.6% | 70.7% | N/A | N/A | N/A |
| 123 | AC | Qwen3.5-9B | 41.4 | 47.6 | 52.0 | 28.1 | 33.6 | 44.6 | 100.0% | 262.1K | Open weights | N/A | N/A | 81.7% | 82.5% | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 124 | AC | Qwen3-Next-80B-A3B-Thinking | 40.9 | 58.2 | 65.2 | 45.7 | 38.5 | 62.7 | 100.0% | 131.1K | Open weights | $0.50 | $6 | 77.2% | 82.7% | 87.8% | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 125 | XA | Grok 4.3 | 40.7 | N/A | N/A | N/A | N/A | N/A | 0.0% | 1M | Closed weights | $1.25 | $2.5 | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 126 | AC | Qwen3 Max | 40.7 | 33.0 | 72.7 | 42.5 | 41.1 | N/A | 80.0% | 262.1K | Closed weights | $1.2 | $6 | 62.0% | N/A | 81.6% | 69.6% | N/A | N/A | N/A | N/A | N/A | N/A |
| 127 | AC | Qwen3 VL 32B Thinking | 40.5 | 47.9 | 66.5 | 45.1 | 33.6 | 63.4 | 100.0% | N/A | Closed weights | N/A | N/A | 73.1% | 82.1% | 83.7% | N/A | 88.7% | N/A | N/A | N/A | N/A | 68.1% |
| 128 | DE | DeepSeek-V3.1 | 39.9 | 53.6 | 66.3 | 7.5 | 36.8 | N/A | 80.0% | 131.1K | Open weights | N/A | N/A | 74.9% | 83.7% | 49.8% | 66.0% | N/A | 15.9% | 56.4% | N/A | N/A | N/A |
| 129 | AN | Claude Sonnet 4 | 39.5 | 56.2 | 54.2 | 23.0 | 51.4 | N/A | 80.0% | 200K | Closed weights | N/A | N/A | 75.4% | N/A | 70.5% | 72.7% | N/A | N/A | N/A | N/A | N/A | N/A |
| 130 | IN | Mercury 2 | 39.3 | 51.7 | N/A | 63.3 | 43.8 | 50.0 | 80.0% | 128K | Closed weights | $0.25 | $0.75 | 74.0% | N/A | 91.1% | N/A | N/A | N/A | 67.0% | N/A | N/A | N/A |
| 131 | AN | Claude 3.7 Sonnet | 38.7 | 76.8 | 50.0 | 34.9 | 45.5 | 90.6 | 100.0% | 200K | Closed weights | N/A | N/A | 84.8% | N/A | 54.8% | 70.3% | N/A | N/A | N/A | N/A | N/A | N/A |
| 132 | ZA | GLM-4.7-Flash | 38.5 | 55.8 | 20.1 | 64.6 | 23.1 | N/A | 80.0% | 200K | Open weights | N/A | N/A | 75.2% | N/A | 91.6% | 59.2% | N/A | 14.4% | N/A | N/A | N/A | N/A |
| 133 | GO | Gemma 4 12B | 38.2 | 70.3 | 30.2 | 17.6 | 29.3 | 36.7 | 100.0% | N/A | Closed weights | N/A | N/A | 78.8% | 77.2% | N/A | N/A | N/A | 5.2% | N/A | N/A | N/A | 69.1% |
| 134 | GO | Gemini 2.5 Flash | 38.1 | 70.6 | 58.2 | 24.8 | 46.1 | 71.4 | 100.0% | 1M | Closed weights | $0.30 | $2.5 | 82.8% | N/A | 72.0% | 60.4% | N/A | 11.0% | N/A | N/A | N/A | N/A |
| 135 | CO | North Mini Code 1.0 | 37.4 | N/A | N/A | N/A | 22.5 | N/A | 20.0% | N/A | Closed weights | N/A | N/A | N/A | N/A | N/A | 67.6% | N/A | N/A | N/A | N/A | N/A | N/A |
| 136 | MA | Kimi K2-Instruct-0905 | 37.2 | 55.1 | 38.0 | 34.5 | 35.3 | 63.4 | 100.0% | N/A | Closed weights | $0.60 | $2.5 | 75.1% | 81.1% | 49.5% | 65.8% | 89.5% | 4.7% | 53.7% | N/A | N/A | N/A |
| 137 | MI | MiniMax M1 80K | 37.0 | 45.1 | 32.7 | 51.0 | 42.5 | 37.5 | 100.0% | 1M | Closed weights | N/A | N/A | 70.0% | 81.1% | 76.9% | 56.0% | N/A | 8.4% | 65.0% | N/A | N/A | N/A |
| 138 | ME | LongCat-Flash-Chat | 36.9 | 49.3 | 75.0 | 38.2 | 49.6 | 70.3 | 100.0% | 128K | Closed weights | N/A | N/A | 73.2% | 82.7% | 61.3% | 60.4% | 89.7% | N/A | 48.0% | N/A | 88.4% | N/A |
| 139 | AC | Qwen3-Next-80B-A3B-Instruct | 36.6 | 53.4 | 53.0 | 18.9 | 49.0 | 62.7 | 100.0% | 131.1K | Open weights | $0.50 | $2 | 72.9% | 80.6% | 69.5% | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 140 | OP | o1 | 36.3 | 59.4 | 81.7 | 57.2 | 36.0 | N/A | 80.0% | 200K | Closed weights | $15 | $60 | 78.0% | N/A | N/A | 41.0% | 91.8% | N/A | N/A | 96.4% | 88.1% | N/A |
| 141 | OP | o3-mini | 36.3 | 58.1 | 46.9 | 63.8 | 51.7 | 70.0 | 100.0% | 200K | Closed weights | $1.1 | $4.4 | 77.2% | N/A | N/A | 49.3% | 86.9% | N/A | N/A | 97.9% | N/A | N/A |
| 142 | OP | GPT-4.5 | 36.2 | 43.8 | 91.0 | 48.7 | 33.4 | 38.7 | 100.0% | 128K | Closed weights | N/A | N/A | 69.5% | N/A | N/A | 38.0% | 90.8% | N/A | N/A | N/A | 88.0% | N/A |
| 143 | XA | Grok Code Fast 1 | 36.0 | N/A | N/A | N/A | 47.1 | N/A | 20.0% | 256K | Closed weights | N/A | N/A | N/A | N/A | N/A | 70.8% | N/A | N/A | N/A | N/A | N/A | N/A |
| 144 | AC | Qwen3-Coder 480B A35B Instruct | 35.5 | N/A | N/A | N/A | 29.1 | N/A | 20.0% | 262.1K | Open weights | $1.5 | $7.5 | N/A | N/A | N/A | 69.6% | N/A | N/A | N/A | N/A | N/A | N/A |
| 145 | MI | MiniMax M1 40K | 35.3 | 43.4 | 30.1 | 40.9 | 38.6 | 37.5 | 100.0% | N/A | Closed weights | N/A | N/A | 69.2% | 80.6% | 74.6% | 55.6% | N/A | 7.2% | 62.3% | N/A | N/A | N/A |
| 146 | AC | Qwen3 VL 32B Instruct | 35.2 | 39.3 | 43.3 | 19.5 | 9.6 | 41.0 | 100.0% | N/A | Closed weights | N/A | N/A | 68.9% | 78.6% | 66.2% | N/A | 86.4% | N/A | N/A | N/A | N/A | 65.3% |
| 147 | NV | Nemotron 3 Nano (30B A3B) | 35.2 | 54.3 | 40.2 | 92.0 | 12.1 | 56.7 | 100.0% | 262.1K | Open weights | N/A | N/A | 75.0% | 78.3% | 99.2% | 38.8% | N/A | 15.5% | N/A | N/A | N/A | N/A |
| 148 | SA | Sarvam-30B | 34.3 | 39.1 | 57.8 | 59.1 | 59.8 | N/A | 80.0% | 128K | Open weights | N/A | N/A | 66.5% | 80.0% | 96.7% | 34.0% | 85.1% | N/A | N/A | N/A | 92.1% | N/A |
| 149 | OP | o1-pro | 34.2 | 60.9 | N/A | 71.2 | N/A | N/A | 40.0% | 200K | Closed weights | $150 | $600 | 79.0% | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 150 | GO | DiffusionGemma 26B-A4B | 34.2 | 59.9 | 37.9 | 11.8 | 21.2 | N/A | 80.0% | N/A | Closed weights | N/A | N/A | 73.2% | 77.6% | N/A | N/A | N/A | 11.9% | N/A | N/A | N/A | 54.3% |
| 151 | MA | Mistral Small 4 | 33.4 | 47.2 | 53.9 | 46.0 | 61.1 | 10.7 | 100.0% | 256K | Open weights | $0.15 | $0.60 | 71.2% | 78.0% | 83.8% | N/A | N/A | N/A | 63.6% | N/A | N/A | 60.0% |
| 152 | ME | LongCat-Flash-Lite | 33.0 | 40.3 | 54.7 | 43.5 | 21.0 | N/A | 80.0% | 256K | Closed weights | N/A | N/A | 66.8% | 78.3% | 63.2% | 54.4% | 85.5% | N/A | N/A | N/A | N/A | N/A |
| 153 | AC | Qwen3.5-4B | 32.4 | 35.8 | 36.9 | 18.8 | 25.0 | 36.3 | 100.0% | N/A | Closed weights | N/A | N/A | 76.2% | 79.1% | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 154 | NV | Nemotron Nano 9B v2 | 32.4 | 34.3 | N/A | 56.6 | 75.0 | 79.7 | 80.0% | 131.1K | Open weights | N/A | N/A | 64.0% | N/A | 72.1% | N/A | N/A | N/A | 71.1% | N/A | N/A | N/A |
| 155 | AN | Claude 3.5 Sonnet | 32.1 | 77.8 | 52.0 | 79.9 | 55.7 | N/A | 80.0% | 200K | Closed weights | N/A | N/A | 67.2% | 77.6% | N/A | 49.0% | 90.4% | N/A | N/A | 78.3% | 93.7% | N/A |
| 156 | AC | Qwen3 30B A3B | 32.1 | 37.5 | N/A | 23.9 | 58.3 | 36.8 | 80.0% | 128K | Closed weights | N/A | N/A | 65.8% | N/A | 70.9% | N/A | N/A | N/A | 62.6% | N/A | N/A | N/A |
| 157 | OP | GPT-4.1 | 31.9 | 38.6 | 49.0 | 3.5 | 32.3 | 29.3 | 100.0% | 1M | Closed weights | $2 | $8 | 66.3% | N/A | 46.4% | 54.6% | 90.2% | 5.4% | N/A | N/A | N/A | N/A |
| 158 | AC | Qwen3 VL 30B A3B Thinking | 31.8 | 37.8 | 43.4 | 38.8 | 30.8 | 39.9 | 100.0% | 262.1K | Closed weights | N/A | N/A | 74.4% | 80.5% | 83.1% | N/A | 87.6% | N/A | N/A | N/A | N/A | 63.0% |
| 159 | AC | Qwen3 32B | 31.2 | N/A | N/A | 28.3 | 42.6 | N/A | 40.0% | 131.1K | Open weights | $0.70 | $2.8 | N/A | N/A | 72.9% | N/A | N/A | N/A | 65.7% | N/A | N/A | N/A |
| 160 | OP | GPT-5 nano | 31.1 | 47.2 | 9.8 | 29.5 | N/A | N/A | 60.0% | 400K | Closed weights | $0.05 | $0.40 | 71.2% | N/A | 85.2% | N/A | N/A | 8.7% | N/A | N/A | N/A | N/A |
| 161 | NV | Llama 3.1 Nemotron Ultra 253B v1 | 30.5 | 57.1 | N/A | 51.6 | 66.7 | 68.8 | 80.0% | N/A | Closed weights | N/A | N/A | 76.0% | N/A | 72.5% | N/A | N/A | N/A | 66.3% | N/A | N/A | N/A |
| 162 | MA | Kimi-k1.5 | 30.1 | N/A | 61.4 | 47.9 | N/A | 47.7 | 60.0% | N/A | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | 87.4% | N/A | N/A | N/A | N/A | N/A |
| 163 | GO | Gemini 2.0 Flash Thinking | 29.9 | 52.6 | N/A | 30.8 | N/A | N/A | 40.0% | N/A | Closed weights | N/A | N/A | 74.2% | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 164 | MA | Ministral 3 (8B Reasoning 2512) | 29.0 | 40.8 | N/A | 37.2 | 55.6 | N/A | 60.0% | 262.1K | Closed weights | $0.10 | $0.10 | 66.8% | N/A | 78.7% | N/A | N/A | N/A | 61.6% | N/A | N/A | N/A |
| 165 | AC | Qwen3 VL 30B A3B Instruct | 28.8 | 30.6 | 41.6 | 14.3 | 7.7 | 37.6 | 100.0% | 262.1K | Closed weights | N/A | N/A | 70.4% | 77.8% | 69.3% | N/A | 85.0% | N/A | N/A | N/A | N/A | 60.4% |
| 166 | AC | Qwen3 VL 8B Thinking | 28.5 | 32.5 | 47.0 | 33.6 | 28.9 | 41.3 | 100.0% | 262.1K | Closed weights | N/A | N/A | 69.9% | 77.3% | 80.3% | N/A | 85.2% | N/A | N/A | N/A | N/A | 60.4% |
| 167 | GO | Gemini 2.0 Flash | 28.1 | 33.7 | 60.0 | 97.2 | 27.8 | 61.9 | 100.0% | 1M | Closed weights | N/A | N/A | 62.1% | 76.4% | N/A | N/A | N/A | N/A | 35.1% | 89.7% | N/A | N/A |
| 168 | MI | Phi 4 Reasoning Plus | 26.8 | 42.7 | 47.7 | 34.5 | 66.3 | 42.2 | 100.0% | N/A | Closed weights | $0.125 | $0.50 | 68.9% | 76.0% | 78.0% | N/A | N/A | N/A | 53.1% | N/A | N/A | N/A |
| 169 | DE | DeepSeek-V3 0324 | 26.0 | 42.1 | 66.4 | 24.8 | 36.1 | N/A | 80.0% | 163.8K | Closed weights | N/A | N/A | 68.4% | 81.2% | N/A | N/A | N/A | N/A | 49.2% | N/A | N/A | N/A |
| 170 | AC | Qwen2-VL-72B-Instruct | 25.5 | N/A | N/A | N/A | N/A | N/A | 0.0% | N/A | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | 46.2% |
| 171 | ME | Llama 4 Maverick | 24.9 | 44.2 | 59.0 | 35.7 | 43.2 | N/A | 80.0% | 1M | Closed weights | N/A | N/A | 69.8% | 80.5% | N/A | N/A | 85.5% | N/A | 43.4% | 61.2% | N/A | 59.6% |
| 172 | AC | QwQ-32B | 24.8 | 36.5 | N/A | 31.6 | 59.7 | 34.4 | 80.0% | N/A | Closed weights | $0.287 | $0.861 | 65.2% | N/A | N/A | N/A | N/A | N/A | 63.4% | N/A | N/A | N/A |
| 173 | AC | Qwen3 VL 8B Instruct | 24.8 | 22.4 | 25.4 | 5.2 | 3.9 | 36.0 | 100.0% | 262.1K | Closed weights | N/A | N/A | N/A | 71.6% | 45.9% | N/A | 80.7% | N/A | N/A | N/A | N/A | 55.9% |
| 174 | OP | GPT-4.1 mini | 24.8 | 35.6 | 38.6 | 5.3 | 13.1 | 21.1 | 100.0% | 1M | Closed weights | $0.40 | $1.6 | 65.0% | N/A | 40.2% | 23.6% | 87.5% | 3.7% | N/A | N/A | N/A | N/A |
| 175 | ME | Llama 3.1 405B Instruct | 24.5 | 67.2 | 41.4 | 75.0 | 75.4 | 62.5 | 100.0% | 128K | Closed weights | N/A | N/A | 50.7% | 73.3% | N/A | N/A | 87.3% | N/A | N/A | 73.8% | 89.0% | N/A |
| 176 | GO | Gemma 4 E4B | 24.4 | 45.2 | 27.1 | 5.9 | 18.3 | N/A | 80.0% | 131.1K | Open weights | N/A | N/A | 58.6% | 69.4% | N/A | N/A | N/A | N/A | N/A | N/A | N/A | 52.6% |
| 177 | MA | Devstral Medium | 24.0 | N/A | N/A | N/A | 26.9 | N/A | 20.0% | 128K | Closed weights | $0.40 | $2 | N/A | N/A | N/A | 61.6% | N/A | N/A | N/A | N/A | N/A | N/A |
| 178 | OP | GPT-4o | 23.9 | 22.8 | 35.2 | 0.0 | 8.5 | 17.4 | 100.0% | 128K | Closed weights | $2.5 | $10 | 70.1% | 74.7% | N/A | 33.2% | 85.7% | 5.3% | N/A | N/A | N/A | 59.9% |
| 179 | AC | Qwen3 VL 4B Thinking | 23.0 | 28.4 | 30.2 | 20.9 | 13.5 | 29.2 | 100.0% | 262.1K | Closed weights | N/A | N/A | 64.1% | 73.6% | 74.5% | N/A | 81.5% | N/A | N/A | N/A | N/A | 57.0% |
| 180 | NV | Llama-3.3 Nemotron Super 49B v1 | 23.0 | 39.5 | N/A | 39.3 | 96.9 | 90.9 | 80.0% | 131.1K | Open weights | N/A | N/A | 66.7% | N/A | 58.4% | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 181 | AC | Qwen2.5 VL 72B Instruct | 22.7 | N/A | N/A | N/A | N/A | N/A | 0.0% | 131.1K | Open weights | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | 51.1% |
| 182 | OP | MiniCPM-SALA | 22.3 | 36.4 | 26.6 | 36.3 | 69.6 | 12.5 | 100.0% | N/A | Closed weights | N/A | N/A | N/A | 67.0% | 78.3% | N/A | N/A | N/A | N/A | N/A | 95.1% | N/A |
| 183 | ME | Llama 3.3 70B Instruct | 22.1 | 24.9 | 32.8 | 68.6 | 66.9 | 86.7 | 100.0% | 128K | Open weights | N/A | N/A | 50.5% | 68.9% | N/A | N/A | 86.0% | N/A | N/A | 77.0% | 88.4% | N/A |
| 184 | MI | Phi 4 Reasoning | 22.0 | 37.5 | 43.4 | 16.8 | 73.6 | 31.3 | 100.0% | N/A | Closed weights | $0.125 | $0.50 | 65.8% | 74.3% | 62.9% | N/A | N/A | N/A | 53.8% | N/A | N/A | N/A |
| 185 | AC | Qwen2.5 72B Instruct | 21.4 | 22.5 | 37.5 | 80.1 | 60.3 | 68.4 | 100.0% | 131.1K | Closed weights | $1.4 | $5.6 | 49.0% | 71.1% | N/A | N/A | N/A | N/A | 55.5% | 83.1% | 86.6% | N/A |
| 186 | MA | Pixtral Large | 21.2 | N/A | N/A | N/A | N/A | N/A | 0.0% | 128K | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 187 | GO | Gemini 2.0 Flash-Lite | 21.0 | 26.6 | 51.4 | 86.0 | 50.0 | 0.0 | 100.0% | 1M | Closed weights | N/A | N/A | 51.5% | 71.6% | N/A | N/A | N/A | N/A | N/A | 86.8% | N/A | N/A |
| 188 | XA | Grok-2 | 21.0 | 29.2 | 45.3 | 64.3 | 66.9 | N/A | 80.0% | 128K | Closed weights | N/A | N/A | 56.0% | 75.5% | N/A | N/A | 87.5% | N/A | N/A | 76.1% | 88.4% | N/A |
| 189 | AM | Nova Pro | 20.9 | 68.6 | 65.2 | 69.9 | 75.4 | 86.7 | 100.0% | 300K | Closed weights | $0.80 | $3.2 | 46.9% | N/A | N/A | N/A | 85.9% | N/A | N/A | 76.6% | 89.0% | N/A |
| 190 | MA | Min istral 3 (3B Reasoning 2512) | 20.8 | 27.9 | N/A | 26.1 | 48.6 | N/A | 60.0% | 131.1K | Closed weights | $0.04 | $0.04 | 53.4% | N/A | 72.1% | N/A | N/A | N/A | 54.8% | N/A | N/A | N/A |
| 191 | GO | Gemini 1.5 Pro | 20.5 | 62.0 | 46.1 | 66.9 | 41.5 | 75.7 | 100.0% | 2.1M | Closed weights | N/A | N/A | 59.1% | 75.8% | N/A | N/A | 85.9% | N/A | N/A | 86.5% | 84.1% | N/A |
| 192 | MA | Magistral Small 2506 | 19.8 | 41.6 | N/A | 15.9 | 41.7 | N/A | 60.0% | 131.1K | Open weights | N/A | N/A | 68.2% | N/A | 62.8% | N/A | N/A | N/A | 51.3% | N/A | N/A | N/A |
| 193 | MA | Magistral Medium | 19.8 | 46.4 | 10.9 | 18.6 | 29.7 | N/A | 80.0% | N/A | Closed weights | N/A | N/A | 70.8% | N/A | 64.9% | N/A | N/A | 9.0% | 50.3% | N/A | N/A | N/A |
| 194 | AC | Qwen3 VL 4B Instruct | 19.3 | 12.3 | 33.4 | 4.0 | 1.9 | 16.8 | 100.0% | 262.1K | Closed weights | N/A | N/A | N/A | 67.1% | 46.6% | N/A | 77.2% | N/A | N/A | N/A | N/A | 53.2% |
| 195 | GO | Gemini 2.5 Flash-Lite | 19.1 | 35.2 | 44.8 | 11.9 | 9.8 | 28.6 | 100.0% | 1M | Closed weights | $0.10 | $0.40 | 64.6% | N/A | 49.8% | 31.6% | N/A | 5.1% | 33.7% | N/A | N/A | N/A |
| 196 | AC | Qwen2.5 VL 32B Instruct | 17.9 | 19.3 | 32.0 | 75.7 | 82.2 | 9.1 | 100.0% | N/A | Closed weights | N/A | N/A | 46.0% | 68.8% | N/A | N/A | 78.4% | N/A | N/A | 82.2% | 91.5% | 49.5% |
| 197 | MA | Devstral Small 1.1 | 17.1 | N/A | N/A | N/A | 16.4 | N/A | 20.0% | 128K | Open weights | $0.10 | $0.30 | N/A | N/A | N/A | 53.6% | N/A | N/A | N/A | N/A | N/A | N/A |
| 198 | OP | o1-mini | 16.8 | 32.6 | 59.1 | 12.9 | 90.8 | N/A | 80.0% | 128K | Closed weights | N/A | N/A | 60.0% | N/A | N/A | N/A | 85.2% | N/A | N/A | N/A | 92.4% | N/A |
| 199 | AN | Claude 3 Opus | 16.7 | 73.8 | 30.9 | 55.4 | 46.1 | N/A | 80.0% | 200K | Closed weights | N/A | N/A | 50.4% | 68.5% | N/A | N/A | 86.8% | N/A | N/A | 60.1% | 84.9% | N/A |
| 200 | XA | Grok-2 mini | 16.3 | 26.0 | 39.8 | 55.7 | 50.8 | N/A | 80.0% | N/A | Closed weights | N/A | N/A | 51.0% | 72.0% | N/A | N/A | 86.2% | N/A | N/A | 73.0% | 85.7% | N/A |
| 201 | MA | Mistral Small 3.2 24B Instruct | 15.9 | 19.7 | 26.1 | 44.3 | N/A | 57.1 | 80.0% | N/A | Closed weights | N/A | N/A | 46.1% | 69.1% | N/A | N/A | 80.5% | N/A | N/A | 69.4% | N/A | N/A |
| 202 | MA | Mistral Large 3 (675B Instruct 2512) | 15.8 | 16.9 | 36.4 | 70.0 | 24.3 | N/A | 80.0% | 262.1K | Open weights | $0.50 | $1.5 | 43.9% | N/A | N/A | N/A | N/A | N/A | 34.4% | N/A | N/A | N/A |
| 203 | GO | Gemma 3 27B | 15.8 | 46.8 | 37.9 | 89.0 | 39.2 | 61.1 | 100.0% | 131.1K | Closed weights | N/A | N/A | 42.4% | 67.5% | N/A | N/A | N/A | N/A | 29.7% | 89.0% | 87.8% | N/A |
| 204 | AM | Nova 2 Sonic | 15.7 | N/A | N/A | N/A | 66.7 | 3.6 | 40.0% | 1M | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 205 | DE | DeepSeek R1 Distill Qwen 7B | 15.7 | 23.2 | N/A | 43.7 | 29.9 | N/A | 60.0% | N/A | Closed weights | N/A | N/A | 49.1% | N/A | N/A | N/A | N/A | N/A | 37.6% | N/A | N/A | N/A |
| 206 | DE | DeepSeek-V2.5 | 15.4 | 63.6 | 40.4 | 69.4 | 38.2 | 81.8 | 100.0% | 8.2K | Closed weights | N/A | N/A | N/A | N/A | N/A | 16.8% | 80.4% | N/A | N/A | 74.7% | 89.0% | N/A |
| 207 | AC | QvQ-72B-Preview | 14.9 | N/A | N/A | N/A | N/A | N/A | 0.0% | N/A | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 208 | AC | Qwen2.5 32B Instruct | 14.8 | 50.6 | 37.4 | 81.7 | 68.3 | N/A | 80.0% | N/A | Closed weights | $0.70 | $2.8 | 49.5% | 69.0% | N/A | N/A | 83.3% | N/A | N/A | 83.1% | 88.4% | N/A |
| 209 | OP | GPT-4 Turbo | 14.6 | 53.8 | 71.7 | 54.3 | 55.4 | N/A | 80.0% | 128K | Closed weights | $10 | $30 | 48.0% | N/A | N/A | N/A | 86.5% | N/A | N/A | 72.6% | 87.1% | N/A |
| 210 | ME | Llama 4 Scout | 14.1 | 30.0 | 43.4 | 22.9 | 23.8 | N/A | 80.0% | 10M | Closed weights | N/A | N/A | 57.2% | 74.3% | N/A | N/A | 79.6% | N/A | 32.8% | 50.3% | N/A | N/A |
| 211 | MI | Phi 4 Mini Reasoning | 13.8 | 27.5 | N/A | 41.9 | N/A | N/A | 40.0% | N/A | Closed weights | $0.075 | $0.30 | 52.0% | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 212 | AM | Nova Lite | 13.2 | 51.4 | 41.9 | 63.7 | 48.5 | 71.9 | 100.0% | 300K | Closed weights | $0.06 | $0.24 | 42.0% | N/A | N/A | N/A | 80.5% | N/A | N/A | 73.3% | 85.4% | N/A |
| 213 | ME | Llama 3.1 70B Instruct | 13.2 | 52.9 | 24.2 | 100.0 | 32.3 | 51.6 | 100.0% | 128K | Closed weights | N/A | N/A | 41.7% | 66.4% | N/A | N/A | 83.6% | N/A | N/A | N/A | 80.5% | N/A |
| 214 | AC | Qwen2.5 VL 7B Instruct | 12.8 | N/A | N/A | N/A | N/A | 0.0 | 20.0% | N/A | Closed weights | $0.35 | $1.05 | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | 38.3% |
| 215 | DE | DeepSeek R1 Distill Llama 8B | 12.4 | 22.5 | N/A | 27.9 | 31.9 | N/A | 60.0% | N/A | Closed weights | N/A | N/A | 49.0% | N/A | N/A | N/A | N/A | N/A | 39.6% | N/A | N/A | N/A |
| 216 | GO | Gemma 4 E2B | 11.6 | 32.9 | 14.3 | 0.0 | 11.5 | N/A | 80.0% | 131.1K | Open weights | N/A | N/A | 43.4% | 60.0% | N/A | N/A | N/A | N/A | N/A | N/A | N/A | 44.2% |
| 217 | GO | Gemma 3 12B | 11.2 | 39.4 | 35.4 | 74.8 | 32.4 | 51.4 | 100.0% | 131.1K | Closed weights | N/A | N/A | 40.9% | 60.6% | N/A | N/A | N/A | N/A | 24.6% | 83.8% | 85.4% | N/A |
| 218 | ME | Llama 3.2 90B Instruct | 10.8 | 20.2 | 67.2 | 38.6 | N/A | N/A | 60.0% | 128K | Closed weights | N/A | N/A | 46.7% | N/A | N/A | N/A | 86.0% | N/A | N/A | 68.0% | N/A | 45.2% |
| 219 | GO | Gemini 1.5 Flash | 10.7 | 55.1 | 28.1 | 52.4 | 23.1 | 37.7 | 100.0% | 1M | Closed weights | N/A | N/A | 51.0% | 67.3% | N/A | N/A | 78.9% | N/A | N/A | 77.9% | 74.3% | N/A |
| 220 | NV | Llama 3.1 Nemotron Nano 8B V1 | 10.4 | 28.8 | N/A | 27.0 | 84.4 | 17.7 | 80.0% | N/A | Closed weights | N/A | N/A | 54.1% | N/A | 47.1% | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 221 | AC | Qwen2.5-Omni-7B | 10.2 | 5.2 | 7.8 | 44.3 | 26.1 | 100.0 | 100.0% | N/A | Closed weights | $0.10 | $0.40 | 30.8% | 47.0% | N/A | N/A | N/A | N/A | N/A | 71.5% | 78.7% | 36.6% |
| 222 | AC | Qwen2 72B Instruct | 9.8 | 50.9 | 24.9 | 41.4 | 46.6 | N/A | 80.0% | N/A | Closed weights | N/A | N/A | 42.4% | 64.4% | N/A | N/A | 82.3% | N/A | N/A | 59.7% | 86.0% | N/A |
| 223 | MI | Phi 4 | 9.4 | 33.8 | 20.6 | 74.3 | 38.5 | 3.9 | 100.0% | 16K | Closed weights | $0.125 | $0.50 | 56.1% | 70.4% | N/A | N/A | 84.8% | N/A | N/A | 80.4% | 82.6% | N/A |
| 224 | AN | Claude 3.5 Haiku | 9.3 | 42.2 | 22.7 | 42.9 | 35.5 | N/A | 80.0% | 200K | Closed weights | N/A | N/A | 41.6% | 65.0% | N/A | 40.6% | N/A | N/A | N/A | 69.4% | 88.1% | N/A |
| 225 | MA | Mistral Small 3.1 24B Instruct | 8.4 | 18.9 | 39.5 | 40.7 | 59.2 | N/A | 80.0% | N/A | Closed weights | N/A | N/A | 46.0% | 66.8% | N/A | N/A | 80.6% | N/A | N/A | 69.3% | 88.4% | N/A |
| 226 | AC | Qwen2.5 14B Instruct | 8.2 | 20.3 | 40.0 | 73.1 | 51.2 | N/A | 80.0% | N/A | Closed weights | $0.35 | $1.4 | 45.5% | 63.7% | N/A | N/A | 79.7% | N/A | N/A | 80.0% | 83.5% | N/A |
| 227 | OP | GPT-4o mini | 8.1 | 35.3 | 50.5 | 46.4 | 28.5 | N/A | 80.0% | 128K | Closed weights | $0.15 | $0.60 | 40.2% | N/A | N/A | 8.7% | 82.0% | N/A | N/A | 70.2% | 87.2% | N/A |
| 228 | MA | Mistral Small 3 24B Instruct | 7.5 | 18.0 | 23.4 | 48.6 | 43.9 | 32.2 | 100.0% | 32K | Closed weights | N/A | N/A | 45.3% | 66.3% | N/A | N/A | N/A | N/A | N/A | 70.6% | 84.8% | N/A |
| 229 | MI | Phi-4-multimodal-instruct | 7.4 | N/A | N/A | N/A | N/A | N/A | 0.0% | 128K | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | 38.5% |
| 230 | NR | Hermes 3 70B | 7.2 | 59.2 | 39.6 | 1.4 | N/A | 82.8 | 80.0% | 131.1K | Closed weights | N/A | N/A | 66.1% | 47.2% | N/A | N/A | 79.1% | N/A | N/A | 20.8% | N/A | N/A |
| 231 | MA | Mistral Large 2 | 7.0 | N/A | 54.5 | 63.8 | 86.9 | 54.5 | 80.0% | 128K | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | 84.0% | N/A | N/A | N/A | 92.0% | N/A |
| 232 | AC | Qwen2.5 7B Instruct | 6.5 | 9.4 | 17.2 | 58.4 | 37.6 | 35.0 | 100.0% | 131.1K | Closed weights | $0.175 | $0.70 | 36.4% | 56.3% | N/A | N/A | N/A | N/A | 28.7% | 75.5% | 84.8% | N/A |
| 233 | MI | Phi-3.5-MoE-instruct | 4.9 | 61.8 | 50.6 | 34.3 | 39.7 | 75.0 | 100.0% | N/A | Closed weights | N/A | N/A | 36.8% | 45.3% | N/A | N/A | 78.9% | N/A | N/A | 59.5% | 70.7% | N/A |
| 234 | OP | GPT-4 | 4.6 | 67.6 | 70.2 | 7.1 | 10.8 | N/A | 80.0% | 8.2K | Closed weights | $30 | $60 | 35.7% | N/A | N/A | N/A | 86.4% | N/A | N/A | 42.0% | 67.0% | N/A |
| 235 | AC | Qwen2.5-Coder 32B Instruct | 4.4 | 46.3 | 17.2 | 39.3 | 68.0 | N/A | 80.0% | 128K | Closed weights | $0.287 | $0.861 | N/A | 50.4% | N/A | N/A | 75.1% | N/A | 31.4% | 57.2% | 92.7% | N/A |
| 236 | OP | GPT-4.1 nano | 4.3 | 24.0 | 38.4 | 1.9 | 0.0 | 2.6 | 100.0% | 1M | Closed weights | $0.10 | $0.40 | 50.3% | N/A | N/A | N/A | 80.1% | N/A | N/A | N/A | N/A | N/A |
| 237 | AM | Nova Micro | 4.3 | 40.1 | 29.3 | 50.7 | 34.6 | 47.7 | 100.0% | 128K | Closed weights | $0.035 | $0.14 | 40.0% | N/A | N/A | N/A | 77.6% | N/A | N/A | 69.3% | 81.1% | N/A |
| 238 | IB | Granite 3.3 8B Instruct | 3.8 | 27.4 | 48.7 | 25.3 | 80.8 | 10.2 | 100.0% | 128K | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | 65.5% | N/A | N/A | N/A | 89.7% | N/A |
| 239 | GO | Gemini Diffusion | 3.6 | 16.3 | 46.1 | 3.5 | 36.8 | N/A | 80.0% | N/A | Closed weights | N/A | N/A | 40.4% | N/A | 23.3% | 22.9% | N/A | N/A | 30.9% | N/A | 89.6% | N/A |
| 240 | AN | Claude 3 Sonnet | 3.5 | 58.4 | 18.0 | 35.7 | 20.0 | N/A | 80.0% | 200K | Closed weights | N/A | N/A | 40.4% | 56.8% | N/A | N/A | 79.0% | N/A | N/A | 43.1% | 73.0% | N/A |
| 241 | NV | Llama 3.1 Nemotron 70B Instruct | 3.1 | 57.3 | 52.0 | 53.2 | N/A | 0.0 | 80.0% | 128K | Open weights | N/A | N/A | N/A | N/A | N/A | N/A | 80.2% | N/A | N/A | N/A | N/A | N/A |
| 242 | AC | Qwen3.5-2B | 2.8 | 15.1 | 13.3 | N/A | N/A | 11.3 | 60.0% | N/A | Closed weights | N/A | N/A | 51.6% | 66.5% | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 243 | AL | Jamba 1.5 Large | 2.7 | 46.1 | 33.9 | 31.9 | N/A | 14.3 | 80.0% | 256K | Closed weights | N/A | N/A | 36.9% | 53.5% | N/A | N/A | 81.2% | N/A | N/A | N/A | N/A | N/A |
| 244 | MA | Codestral-22B | 1.6 | N/A | N/A | N/A | 45.4 | N/A | 20.0% | N/A | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | 81.1% | N/A |
| 245 | XA | Grok-1.5V | 1.3 | N/A | N/A | N/A | N/A | N/A | 0.0% | N/A | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 246 | GO | Gemma 2 27B | 0.0 | 68.6 | 59.4 | 10.7 | 8.6 | N/A | 80.0% | N/A | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | 75.2% | N/A | N/A | 42.3% | 51.8% | N/A |
| 247 | DE | DeepSeek VL2 Tiny | 0.0 | N/A | N/A | N/A | N/A | N/A | 0.0% | N/A | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 248 | GO | Gemma 3n E2B Instructed | 0.0 | 1.8 | 11.0 | 6.5 | 7.0 | 11.4 | 100.0% | N/A | Closed weights | N/A | N/A | 24.8% | 40.5% | 6.7% | N/A | 60.1% | N/A | 13.2% | N/A | 66.5% | N/A |
| 249 | MA | Mistral NeMo Instruct | 0.0 | 46.9 | 17.8 | N/A | N/A | N/A | 40.0% | 128K | Closed weights | $0.15 | $0.15 | N/A | N/A | N/A | N/A | 68.0% | N/A | N/A | N/A | N/A | N/A |
| 250 | ME | Llama 3.2 3B Instruct | 0.0 | 23.2 | 4.0 | 16.7 | N/A | 14.1 | 80.0% | 128K | Closed weights | N/A | N/A | 32.8% | N/A | N/A | N/A | 63.4% | N/A | N/A | 48.0% | N/A | N/A |
| 251 | MI | Phi-3.5-vision-instruct | 0.0 | N/A | N/A | N/A | N/A | N/A | 0.0% | N/A | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 252 | IB | IBM Granite 4.0 Tiny Preview | 0.0 | 15.9 | 25.1 | 8.5 | 36.9 | 3.9 | 100.0% | N/A | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | 60.4% | N/A | N/A | N/A | 82.4% | N/A |
| 253 | ME | Llama 3.2 11B Instruct | 0.0 | 6.7 | 22.2 | 25.7 | N/A | N/A | 60.0% | 128K | Closed weights | N/A | N/A | 32.8% | N/A | N/A | N/A | 73.0% | N/A | N/A | 51.9% | N/A | 33.0% |
| 254 | AL | Jamba 1.5 Mini | 0.0 | 34.8 | 11.2 | 14.9 | N/A | 0.0 | 80.0% | 256.1K | Closed weights | N/A | N/A | 32.3% | 42.5% | N/A | N/A | 69.7% | N/A | N/A | N/A | N/A | N/A |
| 255 | OP | GPT-3.5 Turbo | 0.0 | 18.1 | 17.2 | 10.7 | 12.3 | N/A | 80.0% | 16.4K | Closed weights | $0.50 | $1.5 | 30.8% | N/A | N/A | N/A | 69.8% | N/A | N/A | 43.1% | 68.0% | N/A |
| 256 | MI | Phi-3.5-mini-instruct | 0.0 | 27.7 | 42.9 | 24.4 | 18.7 | 100.0 | 100.0% | 128K | Closed weights | N/A | N/A | 30.4% | 47.4% | N/A | N/A | 69.0% | N/A | N/A | 48.5% | 62.8% | N/A |
| 257 | GO | Gemini 1.5 Flash 8B | 0.0 | 11.2 | 18.8 | 27.5 | 28.6 | 8.3 | 100.0% | 1M | Closed weights | N/A | N/A | 38.4% | 58.7% | N/A | N/A | N/A | N/A | N/A | 58.7% | N/A | N/A |
| 258 | AC | Qwen3.5-0.8B | 0.0 | 2.2 | 3.3 | N/A | N/A | 0.6 | 60.0% | N/A | Closed weights | N/A | N/A | 11.9% | 42.3% | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 259 | MA | Pixtral-12B | 0.0 | N/A | 14.1 | 18.6 | 16.9 | 5.3 | 80.0% | 128K | Open weights | $0.15 | $0.15 | N/A | N/A | N/A | N/A | 69.2% | N/A | N/A | 48.1% | 72.0% | N/A |
| 260 | GO | Gemma 3n E4B Instructed | 0.0 | 8.0 | 23.4 | 19.9 | 16.9 | 29.6 | 100.0% | 32K | Closed weights | N/A | N/A | 23.7% | 50.6% | 11.6% | N/A | 64.9% | N/A | 13.2% | N/A | 75.0% | N/A |
| 261 | OP | GPT-5.1 Codex Mini | 0.0 | N/A | N/A | 5.3 | N/A | N/A | 20.0% | 400K | Closed weights | N/A | N/A | N/A | N/A | 42.1% | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 262 | GO | Gemma 3n E2B Instructed LiteRT (Preview) | 0.0 | 9.5 | 10.3 | 6.5 | 7.0 | 11.4 | 100.0% | N/A | Closed weights | N/A | N/A | 24.8% | 40.5% | 6.7% | N/A | 60.1% | N/A | 13.2% | N/A | 66.5% | N/A |
| 263 | GO | MedGemma 4B IT | 0.0 | N/A | 0.0 | N/A | N/A | N/A | 20.0% | N/A | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
| 264 | MA | Ministral 8B Instruct | 0.0 | 34.1 | 12.9 | 27.1 | 0.0 | 27.3 | 100.0% | 131.1K | Open weights | N/A | N/A | N/A | N/A | N/A | N/A | 65.0% | N/A | N/A | 54.5% | 34.8% | N/A |
| 265 | AN | Claude 3 Haiku | 0.0 | 46.4 | 24.8 | 23.1 | 27.7 | N/A | 80.0% | 200K | Closed weights | N/A | N/A | 33.3% | N/A | N/A | N/A | 75.2% | N/A | N/A | 38.9% | 75.9% | N/A |
| 266 | GO | Gemma 3n E4B Instructed LiteRT Preview | 0.0 | 25.7 | 26.4 | 19.9 | 16.9 | 29.6 | 100.0% | N/A | Closed weights | N/A | N/A | 23.7% | 50.6% | 11.6% | N/A | 64.9% | N/A | 13.2% | N/A | 75.0% | N/A |
| 267 | GO | Gemma 3 4B | 0.0 | 21.7 | 13.3 | 51.8 | 10.8 | 50.4 | 100.0% | 131.1K | Closed weights | N/A | N/A | 30.8% | 43.6% | N/A | N/A | N/A | N/A | 12.6% | 75.6% | 71.3% | N/A |
| 268 | AC | Qwen2.5-Coder 7B Instruct | 0.0 | 22.8 | 3.7 | 19.9 | 50.5 | N/A | 80.0% | N/A | Closed weights | $0.144 | $0.287 | N/A | 40.1% | N/A | N/A | 67.6% | N/A | 18.2% | 46.6% | 88.4% | N/A |
| 269 | XA | Grok-1.5 | 0.0 | 9.0 | 13.3 | 34.5 | 21.5 | N/A | 80.0% | N/A | Closed weights | N/A | N/A | 35.9% | 51.0% | N/A | N/A | 81.3% | N/A | N/A | 50.6% | 74.1% | N/A |
| 270 | GO | Gemma 2 9B | 0.0 | 49.9 | 39.5 | 5.3 | 2.3 | N/A | 80.0% | N/A | Closed weights | N/A | N/A | N/A | N/A | N/A | N/A | 71.3% | N/A | N/A | 36.6% | 40.2% | N/A |
| 271 | CO | Command R+ | 0.0 | 71.2 | 30.8 | 10.6 | N/A | N/A | 60.0% | 128K | Closed weights | $0.15 | $0.60 | N/A | N/A | N/A | N/A | 75.7% | N/A | N/A | N/A | N/A | N/A |
| 272 | GO | Gemma 3 1B | 0.0 | 0.1 | 0.6 | 6.9 | 1.0 | 11.7 | 100.0% | N/A | Closed weights | N/A | N/A | 19.2% | 14.7% | N/A | N/A | N/A | N/A | 1.9% | 48.0% | 41.5% | N/A |
| 273 | GO | Gemini 1.0 Pro | 0.0 | 3.4 | 21.2 | 2.9 | N/A | 40.0 | 80.0% | 32.8K | Closed weights | N/A | N/A | 27.9% | N/A | N/A | N/A | 71.8% | N/A | N/A | 32.6% | N/A | N/A |
| 274 | ME | Llama 3.1 8B Instruct | 0.0 | 26.4 | 10.2 | 0.0 | 18.5 | 20.3 | 100.0% | 131.1K | Closed weights | N/A | N/A | 30.4% | 48.3% | N/A | N/A | 69.4% | N/A | N/A | N/A | 72.6% | N/A |
| 275 | AC | Qwen2 7B Instruct | 0.0 | 3.0 | 11.9 | 22.4 | 17.1 | 45.5 | 100.0% | N/A | Closed weights | N/A | N/A | 25.3% | 44.1% | N/A | N/A | 70.5% | N/A | 26.6% | 49.6% | 79.9% | N/A |
| 276 | BA | ERNIE 4.5 | 0.0 | 6.5 | 0.3 | 0.0 | 0.0 | 0.0 | 100.0% | 128K | Closed weights | N/A | N/A | 74.0% | 16.0% | N/A | N/A | 41.9% | N/A | N/A | 12.4% | N/A | N/A |
| 277 | MI | Phi 4 Mini | 0.0 | 23.8 | 48.2 | 35.6 | N/A | N/A | 60.0% | 128K | Open weights | $0.075 | $0.30 | 25.2% | 52.8% | N/A | N/A | 67.3% | N/A | N/A | 64.0% | N/A | N/A |
Official PAYG prices appear here. Third-party offers remain on the pricing and model detail pages.
Official vendor API prices plotted against the overall metric used on this page. Price remains a separate decision signal.
Vendor concentration and model access among the first 25 ranked products.
Open focused comparisons between the current leader and the nearest practical alternatives.
Common questions about LLM Leaderboard.
Claude Opus 5 is currently ranked first with a overall score of 97.4.
Each model appears once using its current scored version. Category pages use the capability named in the title, while the overall page uses the LLMBoard score.
This page currently ranks 277 unique model products.
Main price columns use the model vendor's official standard PAYG API rate. Eligible third-party offers appear only in separately labeled columns, and unavailable official prices display as N/A.
No. Arena results are displayed as an independent signal and are not included in the current LLMBoard capability score.