BenchLeader
OpenAIReasoning model

o3-pro

Best configuration ranks #200 of 610 on the BenchLeader Index at 54.4 ±7.7 (high reasoning effort). Last measured 26 Jun 2025stale: no new result in six months. Released 10 Jun 2025.

Blended price
$35.00/M
$20.00 in · $80.00 out
Output speed
First answer
Context
200k
How it scores by categoryDashed line = average model (50). One step of 15 = one standard deviation.
  1. Overall index54
  2. Reasoning41
  3. Coding56
  4. Knowledge62
  5. Instruction following59
  6. Multimodal66

Reasoning-effort configurations

The same model behaves differently depending on how much it is allowed to think. Each row is one setting, scored only on the benchmarks that were run at that setting. “Default” means the publisher did not say which setting was used.

EffortIndexRankSpeedFirst answerChat reply costCategories
low$0.032Reasoning 38
medium$0.032Long context 72 · Reasoning 40
highbest54.4#200$0.032Coding 56 · Instruction following 59 · Knowledge 62 · Multimodal 66 · Reasoning 41
default54.1#207$0.032Agents & tools 18 · Coding 74 · Composite 57 · Instruction following 59 · Knowledge 62 · Reasoning 66

Benchmark results

One column per reasoning effort. Rank is among every configuration of every model on that benchmark. Hover a score for the run it came from.

Reasoning

BenchmarklowmediumhighdefaultSource
GPQA Diamond (AA)not in index84.5%#136Artificial Analysis
Kagi LLM Benchmark72.1%#24Kagi LLM Benchmark
ARC-AGI-144.3%#12757.0%#11459.3%#109ARC Prize
ARC-AGI-22.1%#1411.9%#1444.9%#120ARC Prize

Coding

BenchmarklowmediumhighdefaultSource
WeirdML58.2%#49WeirdML
Aider Polyglot84.9%#2Aider polyglot leaderboard

Agents & tools

BenchmarklowmediumhighdefaultSource
MCP Atlas44.5%#29Scale AI SEAL

Knowledge

BenchmarklowmediumhighdefaultSource
PRBench Finance49.1%#10Scale AI SEAL
PRBench Legal49.7%#8Scale AI SEAL
MultiNRC49.0%#10Scale AI SEAL

Instruction following

BenchmarklowmediumhighdefaultSource
MultiChallenge62.4%#8Scale AI SEAL
TutorBench54.6%#5Scale AI SEAL

Multimodal

BenchmarklowmediumhighdefaultSource
VISTA51.6%#6Scale AI SEAL

Long context

BenchmarklowmediumhighdefaultSource
Fiction.LiveBench 120k88.9%#5Fiction.live

Composite

BenchmarklowmediumhighdefaultSource
Epoch Capabilities Indexnot in index147.4#53Epoch AI Benchmarking Hub
AA Intelligence Index21.9#154Artificial Analysis

What a task costs

Estimates from list price, output speed and time to first answer for the best configuration. “With caching” assumes three-quarters of the input is served from the prompt cache. Reasoning tokens are not modelled.

WorkloadTokens in / outCostWith cachingTime
Chat reply400 / 300$0.032
Summarise a 30-page report12,000 / 600$0.288
Code edit6,000 / 1,500$0.240
Agentic coding session60,000 / 4,000$1.52
Structured extraction2,000 / 200$0.056

See also

Data as of 9 Sept 2026. Compare these configurations.