BenchLeader

Gemma 3 4B IT

Best configuration ranks #600 of 610 on the BenchLeader Index at 34.5 ±4.5. Last measured 2 Sept 2026. Released 12 Mar 2025.

Blended price
$0.063/M
$0.050 in · $0.100 out
Output speed
27 tok/s
First answer
0.62 s
Context
131k
How it scores by categoryDashed line = average model (50). One step of 15 = one standard deviation.
  1. Overall index35
  2. Reasoning27
  3. Coding39
  4. Agents & tools34
  5. Maths27
  6. Knowledge25
  7. Instruction following32
  8. Human preference47
  9. Multimodal18
  10. Long context28
  11. Composite35

Benchmark results

One column per reasoning effort. Rank is among every configuration of every model on that benchmark. Hover a score for the run it came from.

Coding

BenchmarkdefaultSource
LMArena Coding1274#269LMArena

Maths

BenchmarkdefaultSource
OTIS Mock AIME7.5%#216Epoch AI Benchmarking Hub

Knowledge

BenchmarkdefaultSource
AA-Omniscience-82.9#466Artificial Analysis

Instruction following

BenchmarkdefaultSource
IFBench28.3%#355Artificial Analysis

Human preference

BenchmarkdefaultSource
LMArena Text1303#230LMArena

Multimodal

BenchmarkdefaultSource
MMMU-Pro29.9%#239Artificial Analysis
MMMU (validation)48.8%#43MMMU

Long context

BenchmarkdefaultSource
AA-LCR6.7%#407Artificial Analysis

Where to run it

Every provider serving this model through OpenRouter, with throughput and first-token latency measured on live traffic over the last 30 minutes and each provider’s own price. Purple marks the best in each column.

ProviderSpeedFirst tokenInput $/MOutput $/MContextQuantisation
DeepInfra27 tok/s0.62 s$0.050$0.100131kbf16

Price history

Listed price per 1M tokens over time, as recorded by OpenRouter for the provider with the longest history.

$0.00$0.028$0.055$0.083$0.110Jan 26Feb 26Mar 26Apr 26May 26Jun 26Jul 26Aug 26
input outputnow $0.050 in · $0.100 out

What a task costs

Estimates from list price, output speed and time to first answer for the best configuration. “With caching” assumes three-quarters of the input is served from the prompt cache. Reasoning tokens are not modelled.

WorkloadTokens in / outCostWith cachingTime
Chat reply400 / 300$0.000111.7 s
Summarise a 30-page report12,000 / 600$0.000722.8 s
Code edit6,000 / 1,500$0.000556.2 s
Agentic coding session60,000 / 4,000$0.00342.5 min
Structured extraction2,000 / 200$0.00018.0 s

See also

Data as of 9 Sept 2026. Compare with another model.