DeepSeek
DeepSeek R1 is here: Performance on par with [OpenAI o1](/openai/o1), but open-sourced and with fully open reasoning tokens. It's 671B parameters in size, with 37B active in an inference pass....
DeepSeek release notesRank #240 across 566
Rank #149 across 222
Rank #251 across 371
Percentile score by analysis domain.
* Cost is inverted: lower input, output, and blended prices rank higher.
Higher bars mean stronger relative placement.
Streaming speed is not measured for this model yet.
| Metric | Domain | Value | Rank |
|---|---|---|---|
| Artificial Analysis Intelligence Index | overall | 18.5 | #240 |
| Artificial Analysis Coding Index | coding | 24.6 | #149 |
| Artificial Analysis Math Index | math | 68.0 | #101 |
| MMLU-Pro | reasoning | 84.4% | #41 |
| reasoning |
| 70.8% |
| #247 |
| Humanity's Last Exam | reasoning | 9.3% | #217 |
| LiveCodeBench | coding | 61.7% | #112 |
| SciCode | coding, reasoning | 35.7% | #233 |
| MATH-500 | math | 96.6% | #31 |
| AIME | math | 68.3% | #44 |
| Blended Price | cost | $2.43/M | #251 |
| Input Price | cost | $1.68/M | #276 |
| Output Price | cost | $4.70/M | #239 |
| Value Index | cost, overall | 7.6 | #274 |