BenchLeader

Llama 3.2 Instruct 11B (Vision)

Best configuration ranks #579 of 610 on the BenchLeader Index at 36.4 ±6.8. Last measured 27 Mar 2025stale: no new result in six months. Released 18 Sept 2024.

Blended price
$0.350/M
$0.350 in · $0.350 out
Output speed
13 tok/s
First answer
1.24 s
first token 1.24 s
Context
128k
How it scores by categoryDashed line = average model (50). One step of 15 = one standard deviation.
  1. Overall index36
  2. Agents & tools34
  3. Knowledge34
  4. Instruction following34
  5. Multimodal14
  6. Long context31
  7. Composite36

Benchmark results

One column per reasoning effort. Rank is among every configuration of every model on that benchmark. Hover a score for the run it came from.

Reasoning

BenchmarkdefaultSource
GPQA Diamond (AA)not in index22.1%#521Artificial Analysis
Humanity's Last Exam (AA)not in index5.5%#346Artificial Analysis

Agents & tools

Knowledge

BenchmarkdefaultSource
AA-Omniscience-62.6#405Artificial Analysis

Instruction following

BenchmarkdefaultSource
IFBench30.4%#343Artificial Analysis

Multimodal

BenchmarkdefaultSource
MMMU-Pro29.3%#240Artificial Analysis
VISTA20.5%#56Scale AI SEAL

Long context

BenchmarkdefaultSource
AA-LCR12.7%#388Artificial Analysis

Composite

BenchmarkdefaultSource
AA Intelligence Index5.4#492Artificial Analysis

What a task costs

Estimates from list price, output speed and time to first answer for the best configuration. “With caching” assumes three-quarters of the input is served from the prompt cache. Reasoning tokens are not modelled.

WorkloadTokens in / outCostWith cachingTime
Chat reply400 / 300$0.000224.9 s
Summarise a 30-page report12,000 / 600$0.004448.5 s
Code edit6,000 / 1,500$0.00262.0 min
Agentic coding session60,000 / 4,000$0.0225.3 min
Structured extraction2,000 / 200$0.000817.0 s

See also

Data as of 9 Sept 2026. Compare with another model.