BenchLeader

Gemma 3 12B IT

Best configuration ranks #564 of 610 on the BenchLeader Index at 37.2 ±5.3. Last measured 2 Sept 2026. Released 12 Mar 2025.

Blended price
$0.063/M
$0.050 in · $0.100 out
Output speed
5 tok/s
First answer
1.17 s
Context
131k
How it scores by categoryDashed line = average model (50). One step of 15 = one standard deviation.
  1. Overall index37
  2. Reasoning37
  3. Coding28
  4. Agents & tools40
  5. Maths31
  6. Knowledge28
  7. Instruction following40
  8. Human preference51
  9. Multimodal28
  10. Long context29
  11. Composite34

Benchmark results

One column per reasoning effort. Rank is among every configuration of every model on that benchmark. Hover a score for the run it came from.

Coding

BenchmarkdefaultSource
SciCode17.4%#154SciCode
LMArena Coding1316#239LMArena
SciCode (AA)not in index16.4%#160Artificial Analysis

Maths

BenchmarkdefaultSource
OTIS Mock AIME16.7%#205Epoch AI Benchmarking Hub

Knowledge

BenchmarkdefaultSource
AA-Omniscience-77.1#452Artificial Analysis

Instruction following

BenchmarkdefaultSource
IFBench36.7%#282Artificial Analysis

Human preference

BenchmarkdefaultSource
LMArena Text1342#189LMArena

Multimodal

BenchmarkdefaultSource
MMMU-Pro37.5%#235Artificial Analysis
MMMU (validation)59.6%#32MMMU

Long context

BenchmarkdefaultSource
AA-LCR8.3%#400Artificial Analysis

Where to run it

Every provider serving this model through OpenRouter, with throughput and first-token latency measured on live traffic over the last 30 minutes and each provider’s own price. Purple marks the best in each column.

ProviderSpeedFirst tokenInput $/MOutput $/MContextQuantisation
DeepInfra5 tok/s1.17 s$0.050$0.150131kbf16

Price history

Listed price per 1M tokens over time, as recorded by OpenRouter for the provider with the longest history.

$0.00$0.041$0.083$0.124$0.165Jan 26Feb 26Mar 26Apr 26May 26Jun 26Jul 26Aug 26
input outputnow $0.050 in · $0.150 out

What a task costs

Estimates from list price, output speed and time to first answer for the best configuration. “With caching” assumes three-quarters of the input is served from the prompt cache. Reasoning tokens are not modelled.

WorkloadTokens in / outCostWith cachingTime
Chat reply400 / 300$0.00011.0 min
Summarise a 30-page report12,000 / 600$0.00072.0 min
Code edit6,000 / 1,500$0.00055.0 min
Agentic coding session60,000 / 4,000$0.003413.4 min
Structured extraction2,000 / 200$0.000141.2 s

See also

Data as of 9 Sept 2026. Compare with another model.