o1-mini
Best configuration ranks #388 of 610 on the BenchLeader Index at 45.5 ±6.4. Last measured 2 Sept 2026. Released 12 Sept 2024.
- Blended price
- –
- Output speed
- –
- First answer
- –
- Context
- 128k
- Overall index46
- Reasoning37
- Coding45
- Human preference51
- Composite41
Reasoning-effort configurations
The same model behaves differently depending on how much it is allowed to think. Each row is one setting, scored only on the benchmarks that were run at that setting. “Default” means the publisher did not say which setting was used.
| Effort | Index | Rank | Speed | First answer | Chat reply cost | Categories |
|---|---|---|---|---|---|---|
| medium | 44.4 | #415 | – | – | – | Agents & tools 38 · Coding 41 · Maths 53 · Reasoning 35 |
| high | – | – | – | – | – | Knowledge 56 · Maths 55 · Reasoning 47 |
| defaultbest | 45.5 | #388 | – | – | – | Coding 45 · Composite 41 · Human preference 51 · Reasoning 37 |
Benchmark results
One column per reasoning effort. Rank is among every configuration of every model on that benchmark. Hover a score for the run it came from.
Reasoning
| Benchmark | medium | high | default | Source |
|---|---|---|---|---|
| GPQA Diamond | 59.5%#180 | 62.4%#175 | – | Epoch AI Benchmarking Hub |
| SimpleBench | 18.1%#82 | – | – | SimpleBench |
| LMArena Hard Prompts | – | – | 1360#186 | LMArena |
| GPQA Diamond (AA)not in index | – | – | 60.3%#355 | Artificial Analysis |
| Humanity's Last Exam (AA)not in index | – | – | 3.6%#499 | Artificial Analysis |
| ARC-AGI-1 | – | – | 14.0%#164 | ARC Prize |
| ARC-AGI-2 | – | – | 0.8%#164 | ARC Prize |
Coding
| Benchmark | medium | high | default | Source |
|---|---|---|---|---|
| WeirdML | 36.3%#119 | – | – | WeirdML |
| LMArena Coding | – | – | 1387#185 | LMArena |
| Aider Polyglot | – | – | 32.9%#31 | Aider polyglot leaderboard |
Maths
| Benchmark | medium | high | default | Source |
|---|---|---|---|---|
| OTIS Mock AIME | 44.7%#173 | 46.9%#168 | – | Epoch AI Benchmarking Hub |
| MATH Level 5 | 84.3%#28 | 89.2%#21 | – | Epoch AI Benchmarking Hub |
Human preference
| Benchmark | medium | high | default | Source |
|---|---|---|---|---|
| LMArena Text | – | – | 1337#193 | LMArena |
Composite
| Benchmark | medium | high | default | Source |
|---|---|---|---|---|
| Epoch Capabilities Indexnot in index | – | – | 135.8#115 | Epoch AI Benchmarking Hub |
| AA Intelligence Index | – | – | 9.8#320 | Artificial Analysis |
See also
Data as of 9 Sept 2026. Compare these configurations.