MetaLlama 3-8B
Best configuration ranks #596 of 610 on the BenchLeader Index at 35.0 ±3.1. Last measured 2 Sept 2026. Released 18 Apr 2024.
- Blended price
- $0.073/M
- $0.050 in · $0.140 out
- Output speed
- –
- First answer
- –
- Context
- 8k
- Overall index35
- Reasoning27
- Coding36
- Agents & tools34
- Maths25
- Knowledge31
- Instruction following29
- Human preference37
- Long context25
- Composite35
Benchmark results
One column per reasoning effort. Rank is among every configuration of every model on that benchmark. Hover a score for the run it came from.
Reasoning
| Benchmark | default | Source |
|---|---|---|
| GPQA Diamond | 26.1%#261 | Epoch AI Benchmarking Hub |
| LMArena Hard Prompts | 1219#284 | LMArena |
| GPQA Diamond (AA)not in index | 29.6%#492 | Artificial Analysis |
| Humanity's Last Exam (AA)not in index | 5.1%#373 | Artificial Analysis |
Coding
| Benchmark | default | Source |
|---|---|---|
| LMArena Coding | 1253#279 | LMArena |
Agents & tools
| Benchmark | default | Source |
|---|---|---|
| Terminal-Bench Hard | 0.0%#345 | Artificial Analysis |
| τ²-Bench Telecom (AA)not in index | 0.0%#375 | Artificial Analysis |
Maths
| Benchmark | default | Source |
|---|---|---|
| OTIS Mock AIME | 1.9%#241 | Epoch AI Benchmarking Hub |
| MATH Level 5 | 6.1%#86 | Epoch AI Benchmarking Hub |
Knowledge
| Benchmark | default | Source |
|---|---|---|
| AA-Omniscience | -70.1#437 | Artificial Analysis |
Instruction following
| Benchmark | default | Source |
|---|---|---|
| IFBench | 24.6%#375 | Artificial Analysis |
Human preference
| Benchmark | default | Source |
|---|---|---|
| LMArena Text | 1223#277 | LMArena |
Long context
| Benchmark | default | Source |
|---|---|---|
| AA-LCR | 0.0%#419 | Artificial Analysis |
Composite
| Benchmark | default | Source |
|---|---|---|
| Epoch Capabilities Indexnot in index | 116.4#178 | Epoch AI Benchmarking Hub |
| AA Intelligence Index | 4.8#527 | Artificial Analysis |
What a task costs
Estimates from list price, output speed and time to first answer for the best configuration. “With caching” assumes three-quarters of the input is served from the prompt cache. Reasoning tokens are not modelled.
| Workload | Tokens in / out | Cost | With caching | Time |
|---|---|---|---|---|
| Chat reply | 400 / 300 | $0.0001 | – | – |
| Summarise a 30-page report | 12,000 / 600 | $0.0007 | – | – |
| Code edit | 6,000 / 1,500 | $0.0005 | – | – |
| Agentic coding session | 60,000 / 4,000 | $0.0036 | – | – |
| Structured extraction | 2,000 / 200 | $0.0001 | – | – |
See also
Data as of 9 Sept 2026. Compare with another model.