OpenAIGPT-4o
GPT-4o is an OpenAI proprietary model, released 13 May 2024. Its best configuration ranks #558 of 785 on the BenchLeader Index at 43.9 ±4.9, in the lower half. The ± is the point: 316 other configurations score within that range, so they and this one cannot be told apart on quality alone — price and speed are what separate them. It scores highest in human preference (63) and lowest in agents & tools (34). At $4.38 per million tokens blended it is among the most expensive ranked models. Output speed of 164 tokens per second puts it in the fastest quarter, with a first answer in 1.1 s. It has been measured at 2 reasoning-effort settings; this summary describes the best-scoring one, and the tabs above switch between them. Last measured 22 Oct 2026.
- Blended price
- $4.38/M
- $2.50 in · $10.00 out
- Output speed
- 164 tok/s
- measured by Artificial Analysis
- First answer
- 1.08 s
- first token 0.62 s
- Context
- 128k
- Full answer
- 4.12 s
- median, reasoning included
- Cost per run
- –
- Released
- 13 May 2024
- Overall index44
- Reasoning38
- Coding35
- Agents & tools34
- Maths41
- Knowledge43
- Instruction following41
- Human preference63
- Multimodal48
- Long context53
- Composite39
Reasoning-effort configurations
The same model behaves differently depending on how much it is allowed to think. Each row is one setting, scored only on the benchmarks that were run at that setting. “Not stated” collects results from publishers that did not say which setting they used; for a reasoning model that is usually its thinking mode, but we do not assume it. Pick a setting here or at the top of the page to see its price, speed and category scores.
| Effort | Index | Rank | Speed | First answer | Chat reply cost | Categories |
|---|---|---|---|---|---|---|
| high | 41.7 | #619 | 135 tok/s | 1.08 s | $0.0040 | Coding 29 · Knowledge 46 · Maths 41 |
| not statedbest | 43.9 | #558 | 164 tok/s | 1.08 s | $0.0040 | Agents & tools 34 · Coding 35 · Composite 39 · Human preference 63 · Instruction following 41 · Knowledge 43 · Long context 53 · Maths 41 · Multimodal 48 · Reasoning 38 |
How its index has moved
8 Sept 2026 to 21 Oct 2026- not stated
- high
The index is recomputed from scratch every day, so a line moves when a new benchmark result lands, when a publisher revises a score, or when the models it is normalised against change. Early movement usually means the score is still settling.
Benchmark results
See all LLM benchmarks. One column per reasoning effort. Rank is among every configuration of every model on that benchmark. Hover a score for the run it came from.
Reasoning
| Benchmark | high | not stated | Source | Trend |
|---|---|---|---|---|
| GPQA Diamondeffort not stated | – | 49.2%#216 | Epoch AI Benchmarking Hub | |
| Humanity's Last Exameffort not stated | – | 2.7%#48 | Scale AI / CAIS | |
| SimpleBencheffort not stated | – | 17.8%#85 | SimpleBench | |
| Arena Hard Promptseffort not stated | – | 1455#106 | Arena (LMArena) | |
| GPQA Diamond (AA)not in indexeffort not stated | – | 65.5%#343 | Artificial Analysis | |
| Humanity's Last Exam (AA)not in indexeffort not stated | – | 4.0%#555 | Artificial Analysis | |
| GPQA Diamond (Vals)not in index | 53.8%#112 | – | Vals AI | |
| Kagi LLM Benchmarkeffort not stated | – | 75.0%#12 | Kagi LLM Benchmark | |
| GPQA Diamond (HELM)not in indexeffort not stated | – | 52.0%#35 | HELM Capabilities | |
| ARC-AGI-1effort not stated | – | 4.5%#248 | ARC Prize | |
| ARC-AGI-2effort not stated | – | 0.0%#242 | ARC Prize | |
| CritPteffort not stated | – | 0.0%#315 | Artificial Analysis | |
| Chess Puzzlesnot in indexeffort not stated | – | 6.0%#130 | Epoch AI Benchmarking Hub | |
| LMCAnot in indexeffort not stated | – | 16.6%#169 | Epoch AI Benchmarking Hub | |
| DTBenchnot in indexeffort not stated | – | 64.5%#169 | Epoch AI Benchmarking Hub | |
| ForecastBenchnot in indexeffort not stated | – | 61.2%#68 | ForecastBench |
Coding
| Benchmark | high | not stated | Source | Trend |
|---|---|---|---|---|
| SWE-bench Verified (Epoch)effort not stated | – | 31.0%#33 | Epoch AI Benchmarking Hub | |
| WeirdMLeffort not stated | – | 25.1%#136 | WeirdML | |
| GSO-Bencheffort not stated | – | 0.0%#35 | GSO-Bench | |
| Arena Codingeffort not stated | – | 1467#121 | Arena (LMArena) | |
| LiveCodeBench | 43.4%#118 | – | Vals AI | |
| Aider Polygloteffort not stated | – | 45.3%#28 | Aider polyglot leaderboard | |
| SWE-bench Verified (bash only)effort not stated | – | 21.6%#41 | SWE-bench | |
| SWE-bench Verified (any scaffold)not in indexeffort not stated | – | 38.8%#48 | SWE-bench | |
| CadEvalnot in indexeffort not stated | – | 26.0%#12 | Epoch AI Benchmarking Hub |
Agents & tools
| Benchmark | not stated | Source | Trend |
|---|---|---|---|
| GDPval | 9.9%#11 | OpenAI | |
| Cybench | 12.5%#14 | Cybench | |
| Terminal-Bench Hard | 8.3%#235 | Artificial Analysis | |
| τ²-Bench Telecom (AA)not in index | 28.9%#265 | Artificial Analysis | |
| BALROGnot in index | 32.3%#16 | BALROG | |
| TheAgentCompanynot in index | 8.6%#8 | TheAgentCompany | |
| METR Time Horizonsnot in index | 40.8%#30 | METR | |
| BrowseCompnot in index | 0.7%#22 | OpenAI |
Maths
| Benchmark | high | not stated | Source | Trend |
|---|---|---|---|---|
| FrontierMath Tiers 1–3effort not stated | – | 0.3%#117 | Epoch AI Benchmarking Hub | |
| OTIS Mock AIMEeffort not stated | – | 6.4%#242 | Epoch AI Benchmarking Hub | |
| MATH Level 5effort not stated | – | 53.3%#51 | Epoch AI Benchmarking Hub | |
| AIME (Vals) | 14.0%#82 | – | Vals AI | |
| MGSM | 90.7%#35 | – | Vals AI | |
| Omni-MATH (HELM)effort not stated | – | 29.3%#46 | HELM Capabilities | |
| MATH 500not in index | 75.2%#43 | – | Vals AI | |
| Arena Mathseffort not stated | – | 1404#144 | Arena (LMArena) |
Knowledge
| Benchmark | high | not stated | Source | Trend |
|---|---|---|---|---|
| SimpleQA Verifiedeffort not stated | – | 26.0%#69 | Epoch AI Benchmarking Hub | |
| AA-Omniscienceeffort not stated | – | -10.5#195 | Artificial Analysis | |
| MMLU-Pro | 74.1%#108 | – | Vals AI | |
| LegalBench | 82.2%#72 | – | Vals AI | |
| CorpFin | 45.9%#108 | – | Vals AI | |
| TaxEval | 74.5%#34 | – | Vals AI | |
| MedQA | 88.2%#54 | – | Vals AI | |
| MultiNRCeffort not stated | – | 12.4%#40 | Scale AI SEAL | |
| MMLU-Pro (HELM)not in indexeffort not stated | – | 71.3%#38 | HELM Capabilities | |
| CaseLaw v2not in index | 59.7%#25 | – | Vals AI | |
| MMLUnot in indexeffort not stated | – | 88.1%#1 | Epoch AI Benchmarking Hub | |
| AA-Omniscience: accuracynot in indexeffort not stated | – | 23.7%#252 | Artificial Analysis | |
| AA-Omniscience: non-hallucinationnot in indexeffort not stated | – | 62.1%#71 | Artificial Analysis |
Instruction following
| Benchmark | not stated | Source | Trend |
|---|---|---|---|
| IFBench | 36.0%#308 | Artificial Analysis | |
| TutorBench | 36.1%#27 | Scale AI SEAL | |
| IFEval (HELM) | 81.7%#39 | HELM Capabilities | |
| WildBench (HELM) | 82.8%#20 | HELM Capabilities | |
| Arena Instruction Followingnot in index | 1427#99 | Arena (LMArena) |
Human preference
| Benchmark | not stated | Source | Trend |
|---|---|---|---|
| Arena Text | 1443#88 | Arena (LMArena) | |
| Arena Creative Writingnot in index | 1421#81 | Arena (LMArena) | |
| Arena Multi-turnnot in index | 1471#62 | Arena (LMArena) | |
| Arena Longer Queriesnot in index | 1440#108 | Arena (LMArena) | |
| Lech Mazur Creative Writingnot in index | 81.8%#13 | Lech Mazur |
Multimodal
| Benchmark | high | not stated | Source | Trend |
|---|---|---|---|---|
| Arena Visioneffort not stated | – | 1243#70 | Arena (LMArena) | |
| MMMU-Proeffort not stated | – | 56.3%#224 | Artificial Analysis | |
| VISTAeffort not stated | – | 38.0%#42 | Scale AI SEAL | |
| MMMU (validation)effort not stated | – | 70.7%#21 | MMMU | |
| MMMU-Pro (official)not in indexeffort not stated | – | 51.9%#15 | MMMU | |
| MMMU-Pro (Vals)not in index | 64.0%#76 | – | Vals AI | |
| MortgageTaxnot in index | 61.0%#62 | – | Vals AI | |
| GeoBenchnot in indexeffort not stated | – | 71.0%#12 | GeoBench | |
| VPCTnot in indexeffort not stated | – | 40.0%#16 | Epoch AI Benchmarking Hub | |
| Video-MMEnot in indexeffort not stated | – | 71.9%#6 | Video-MME | |
| ScienceQAnot in indexeffort not stated | – | 88.5%#2 | Epoch AI Benchmarking Hub |
Long context
| Benchmark | not stated | Source | Trend |
|---|---|---|---|
| AA-LCR | 56.0%#295 | Artificial Analysis |
Composite
| Benchmark | not stated | Source | Trend |
|---|---|---|---|
| Epoch Capabilities Indexnot in index | 129.0#149 | Epoch AI Benchmarking Hub | |
| AA Intelligence Index v4.3.2 | 9.0#418 | Artificial Analysis | |
| HELM Capabilities meannot in index | 63.4%#38 | HELM Capabilities |
Safety & honesty
| Benchmark | not stated | Source | Trend |
|---|---|---|---|
| FORTRESSnot in index | 47.2%#15 | Scale AI SEAL | |
| MASKnot in index | 60.1%#38 | Scale AI SEAL | |
| PropensityBenchnot in index | 46.1%#8 | Scale AI SEAL |
Where to run it
Every provider serving this model through OpenRouter, with throughput and first-token latency measured on live traffic over the last 30 minutes and each provider’s own price. Purple marks the best in each column.
| Provider | Speed | First token | Input $/M | Output $/M | Context | Quantisation |
|---|---|---|---|---|---|---|
| Azure | 77 tok/s | 1.44 s | $2.50 | $10.00 | 128k | – |
| OpenAI | 77 tok/s | 0.62 s | $2.50 | $10.00 | 128k | – |
What a task costs
Estimates from list price, output speed and time to first answer for the best configuration. “With caching” assumes three-quarters of the input is served from the prompt cache at $1.25 per 1M. Reasoning tokens are not modelled.
| Workload | Tokens in / out | Cost | With caching | Time |
|---|---|---|---|---|
| Chat reply | 400 / 300 | $0.0040 | $0.0036 | 2.9 s |
| Summarize a 30-page report | 12,000 / 600 | $0.036 | $0.025 | 4.7 s |
| Code edit | 6,000 / 1,500 | $0.030 | $0.024 | 10.2 s |
| Agentic coding session | 60,000 / 4,000 | $0.190 | $0.134 | 25.4 s |
| Structured extraction | 2,000 / 200 | $0.0070 | $0.0051 | 2.3 s |
More from OpenAI
See also
Questions people ask
- What are GPT-4o's benchmark scores?
- As of 24 Oct 2026, GPT-4o scores 43.9 ±4.9 on the BenchLeader Index, strongest in human preference (63) and weakest in agents & tools (34). That rests on 36 independent benchmark results, and every score on this page links to its publisher.
- How does GPT-4o rank?
- GPT-4o is #558 of 785 ranked configurations on 24 Oct 2026. 316 other configurations score within its margin, so the exact position matters less than the band. The leader is Claude Opus 5.5 (max effort) at 72.6.
- How much does GPT-4o cost per 1M tokens?
- As of 24 Oct 2026, GPT-4o costs $2.50 per 1M input tokens and $10.00 per 1M output tokens, $4.38 blended (three input tokens per output token).
- When was GPT-4o released?
- OpenAI released GPT-4o on 13 May 2024. BenchLeader has results for it at 2 reasoning-effort settings.
Data as of 24 Oct 2026. Compare these configurations.
Cite as: BenchLeader, “GPT-4o: benchmarks, pricing, speed and rank”, data as of 24 Oct 2026, https://www.benchleader.com/models/gpt-4o.