MMLU-Pro
Knowledge and reasoning benchmark score.
MMLU-Pro extends MMLU with more challenging, reasoning-focused questions, removes trivial or noisy items, and expands multiple-choice options from four to ten. It is meant to be more discriminative for advanced language models.
Test type: Multiple-choice reasoning and knowledge benchmark across broad academic domains.
Top MMLU-Pro Models
Top models ranked by MMLU-Pro.
Leaderboard
| Rank | Model | Creator | Value | Speed | Blended Price |
|---|---|---|---|---|---|
| #1 | Gemini 3 Pro Preview (high) | 89.8% | n/a | $4.50/M | |
| #2 |
