BenchLeader

WizardLM-2 8x22B

Not yet ranked: too few independent results so far. Released 15 Apr 2024.

Blended price
$0.620/M
$0.620 in · $0.620 out
Output speed
5 tok/s
First answer
2.84 s
Context
66k
How it scores by categoryDashed line = average model (50). One step of 15 = one standard deviation.
  1. Reasoning34
  2. Maths35

Benchmark results

One column per reasoning effort. Rank is among every configuration of every model on that benchmark. Hover a score for the run it came from.

Reasoning

BenchmarkdefaultSource
GPQA Diamond43.4%#223Epoch AI Benchmarking Hub

Maths

BenchmarkdefaultSource
MATH Level 525.7%#66Epoch AI Benchmarking Hub

Where to run it

Every provider serving this model through OpenRouter, with throughput and first-token latency measured on live traffic over the last 30 minutes and each provider’s own price. Purple marks the best in each column.

ProviderSpeedFirst tokenInput $/MOutput $/MContextQuantisation
NovitaAI5 tok/s2.84 s$0.620$0.62066kbf16

What a task costs

Estimates from list price, output speed and time to first answer for the best configuration. “With caching” assumes three-quarters of the input is served from the prompt cache. Reasoning tokens are not modelled.

WorkloadTokens in / outCostWith cachingTime
Chat reply400 / 300$0.00041.0 min
Summarise a 30-page report12,000 / 600$0.00782.0 min
Code edit6,000 / 1,500$0.00465.0 min
Agentic coding session60,000 / 4,000$0.04013.4 min
Structured extraction2,000 / 200$0.001442.8 s

See also

Data as of 9 Sept 2026. Compare with another model.