DeepSeek
DeepSeek R1 is here: Performance on par with [OpenAI o1](/openai/o1), but open-sourced and with fully open reasoning tokens. It's 671B parameters in size, with 37B active in an inference pass....
DeepSeek release notesRank #265 across 600
Rank #181 across 266
Rank #254 across 379
Percentile score by analysis domain.
* Cost is inverted: lower input, output, and blended prices rank higher.
Higher bars mean stronger relative placement.
Streaming speed is not measured for this model yet.
| Metric | Domain | Value | Rank |
|---|---|---|---|
| Artificial Analysis Intelligence Index | overall | 18.5 | #265 |
| Artificial Analysis Coding Index | coding | 24.6 | #181 |
| Artificial Analysis Math Index | math | 68.0 | #101 |
| MMLU-Pro | reasoning | 84.4% | #37 |
| reasoning |
| 70.8% |
| #260 |
| Humanity's Last Exam | reasoning | 9.3% | #229 |
| LiveCodeBench | coding | 61.7% | #111 |
| SciCode | coding, reasoning | 35.7% | #246 |
| MATH-500 | math | 96.6% | #31 |
| AIME | math | 68.3% | #44 |
| Blended Price | cost | $2.43/M | #254 |
| Input Price | cost | $1.68/M | #280 |
| Output Price | cost | $4.70/M | #248 |
| Value Index | cost, overall | 7.6 | #282 |