language benchmark
SuperGLUE
SuperGLUE is a new benchmark styled after GLUE with a new set of more difficult language understanding tasks, improved resources, and a new public leaderboard. It includes 8 primary tasks: BoolQ (Boolean Questions), CB (CommitmentBank), COPA (Choice of Plausible Alternatives), MultiRC (Multi-Sentence Reading Comprehension), ReCoRD (Reading Comprehension with Commonsense Reasoning), RTE (Recognizing Textual Entailment), WiC (Word-in-Context), and WSC (Winograd Schema Challenge). The benchmark evaluates diverse language understanding capabilities including reading comprehension, commonsense reasoning, causal reasoning, coreference resolution, textual entailment, and word sense disambiguation across multiple domains.
Updated Aug 11, 2026
Models1
Model coverage1
MetricScore
EvidenceB
SuperGLUE Ranking
Higher score ranks better on this benchmark.
| 01 | OP | 75.0% | 100.0% | 1 | C |
SuperGLUE Highlights
The leading models and scores on this benchmark.
What is SuperGLUE?
What SuperGLUE measures and how its scores work.
SuperGLUE is a new benchmark styled after GLUE with a new set of more difficult language understanding tasks, improved resources, and a new public leaderboard. It includes 8 primary tasks: BoolQ (Boolean Questions), CB (CommitmentBank), COPA (Choice of Plausible Alternatives), MultiRC (Multi-Sentence Reading Comprehension), ReCoRD (Reading Comprehension with Commonsense Reasoning), RTE (Recognizing Textual Entailment), WiC (Word-in-Context), and WSC (Winograd Schema Challenge). The benchmark evaluates diverse language understanding capabilities including reading comprehension, commonsense reasoning, causal reasoning, coreference resolution, textual entailment, and word sense disambiguation across multiple domains.
Scores are shown in ratio. This benchmark is not independently verified and has an evidence level of B.
- Family
- SuperGLUE
- Modality
- text
- Primary category
- language
- Score direction
- higher
- LLMBoard eligible
- No
- Evaluation key
- superglue|llm-stats-current
Benchmark scores retain their original unit. Overall score eligibility is shown separately.
FAQ
Common questions about SuperGLUE.
Which model scores highest on SuperGLUE?
o1-mini is currently ranked first with 75.0%.
What does SuperGLUE measure?
SuperGLUE is a new benchmark styled after GLUE with a new set of more difficult language understanding tasks, improved resources, and a new public leaderboard. It includes 8 primary tasks: BoolQ (Boolean Questions), CB (CommitmentBank), COPA (Choice of Plausible Alternatives), MultiRC (Multi-Sentence Reading Comprehension), ReCoRD (Reading Comprehension with Commonsense Reasoning), RTE (Recognizing Textual Entailment), WiC (Word-in-Context), and WSC (Winograd Schema Challenge). The benchmark evaluates diverse language understanding capabilities including reading comprehension, commonsense reasoning, causal reasoning, coreference resolution, textual entailment, and word sense disambiguation across multiple domains.
Is a higher score better?
Yes. Higher values rank better for this benchmark.
How many models are compared?
1 model results are currently shown.
Does this benchmark affect the overall score?
No. This benchmark is shown for reference but does not contribute to the overall score.