BenchLeader

Qwen2.5-Coder 7B Instruct

Not yet ranked: too few independent results so far. Released 1 Nov 2024.

Blended price
$0.180/M
$0.144 in · $0.287 out
Output speed
First answer
Context
131k
How it scores by categoryDashed line = average model (50). One step of 15 = one standard deviation.
  1. Composite36

Benchmark results

One column per reasoning effort. Rank is among every configuration of every model on that benchmark. Hover a score for the run it came from.

Reasoning

BenchmarkdefaultSource
GPQA Diamond (AA)not in index33.9%#471Artificial Analysis
Humanity's Last Exam (AA)not in index4.9%#389Artificial Analysis

Composite

BenchmarkdefaultSource
AA Intelligence Index5.8#473Artificial Analysis

What a task costs

Estimates from list price, output speed and time to first answer for the best configuration. “With caching” assumes three-quarters of the input is served from the prompt cache. Reasoning tokens are not modelled.

WorkloadTokens in / outCostWith cachingTime
Chat reply400 / 300$0.0001
Summarise a 30-page report12,000 / 600$0.0019
Code edit6,000 / 1,500$0.0013
Agentic coding session60,000 / 4,000$0.0098
Structured extraction2,000 / 200$0.0003

See also

Data as of 9 Sept 2026. Compare with another model.