BenchLeader

Qwen2.5 7B Instruct

Not yet ranked: too few independent results so far. Released 19 Sept 2024.

Blended price
$0.090/M
$0.072 in · $0.144 out
Output speed
51 tok/s
First answer
0.26 s
Context
131k
How it scores by categoryDashed line = average model (50). One step of 15 = one standard deviation.
  1. Reasoning28
  2. Maths25

Benchmark results

One column per reasoning effort. Rank is among every configuration of every model on that benchmark. Hover a score for the run it came from.

Reasoning

BenchmarkdefaultSource
GPQA Diamond35.5%#239Epoch AI Benchmarking Hub

Maths

BenchmarkdefaultSource
OTIS Mock AIME2.5%#236Epoch AI Benchmarking Hub

Composite

BenchmarkdefaultSource
Epoch Capabilities Indexnot in index118.5#169Epoch AI Benchmarking Hub

Where to run it

Every provider serving this model through OpenRouter, with throughput and first-token latency measured on live traffic over the last 30 minutes and each provider’s own price. Purple marks the best in each column.

ProviderSpeedFirst tokenInput $/MOutput $/MContextQuantisation
Phala51 tok/s0.26 s$0.100$0.20033k

What a task costs

Estimates from list price, output speed and time to first answer for the best configuration. “With caching” assumes three-quarters of the input is served from the prompt cache. Reasoning tokens are not modelled.

WorkloadTokens in / outCostWith cachingTime
Chat reply400 / 300$0.00016.1 s
Summarise a 30-page report12,000 / 600$0.001012.0 s
Code edit6,000 / 1,500$0.000629.7 s
Agentic coding session60,000 / 4,000$0.00491.3 min
Structured extraction2,000 / 200$0.00024.2 s

See also

Data as of 9 Sept 2026. Compare with another model.