MetaLlama 3.1 70B
Llama 3.1 70B is a Meta open-weights model, released 23 Jul 2024. Its best configuration ranks #645 of 785 on the BenchLeader Index at 40.9 ±3.5, in the lower half. The ± is the point: 272 other configurations score within that range, so they and this one cannot be told apart on quality alone — price and speed are what separate them. It scores highest in instruction following (45) and lowest in coding (33). At $0.560 per million tokens blended it is mid-priced. Output speed of 40 tokens per second puts it in the slowest quarter, with a first answer in 2.1 s. Last measured 22 Oct 2026.
- Blended price
- $0.560/M
- $0.560 in · $0.560 out
- Output speed
- 40 tok/s
- measured by Artificial Analysis
- First answer
- 2.06 s
- first token 0.41 s
- Context
- 128k
- Full answer
- 15 s
- median, reasoning included
- Cost per run
- –
- Released
- 23 Jul 2024
- Overall index41
- Reasoning39
- Coding33
- Agents & tools36
- Maths37
- Knowledge42
- Instruction following45
- Human preference44
- Composite37
Versions
Meta has shipped 4 models under this name. Each is ranked on its own results; a newer version often has fewer results so far, which holds its index nearer the average until more arrive.
| Model | Released | Index | Rank |
|---|---|---|---|
| Llama 3.3 70B | 6 Dec 2024 | 40.7 | #651 |
| Llama 3.1 70Bthis page | 23 Jul 2024 | 40.9 | #645 |
| Llama 3-70B | 18 Apr 2024 | 38.6 | #707 |
| Llama 2-70B | 18 Jul 2023 | 34.3 | #772 |
How its index has moved
8 Sept 2026 to 18 Oct 2026The index is recomputed from scratch every day, so a line moves when a new benchmark result lands, when a publisher revises a score, or when the models it is normalised against change. Early movement usually means the score is still settling.
Benchmark results
See all LLM benchmarks. One column per reasoning effort. Rank is among every configuration of every model on that benchmark. Hover a score for the run it came from.
Reasoning
| Benchmark | not stated | Source | Trend |
|---|---|---|---|
| GPQA Diamond | 44.2%#239 | Epoch AI Benchmarking Hub | |
| Arena Hard Prompts | 1299#264 | Arena (LMArena) | |
| GPQA Diamond (AA)not in index | 40.9%#475 | Artificial Analysis | |
| Humanity's Last Exam (AA)not in index | 4.5%#502 | Artificial Analysis | |
| GPQA Diamond (HELM)not in index | 42.6%#44 | HELM Capabilities | |
| CritPt | 0.0%#315 | Artificial Analysis | |
| LMCAnot in index | 14.8%#172 | Epoch AI Benchmarking Hub | |
| DTBenchnot in index | 60.0%#186 | Epoch AI Benchmarking Hub |
Coding
| Benchmark | not stated | Source | Trend |
|---|---|---|---|
| WeirdML | 9.0%#152 | WeirdML | |
| Arena Coding | 1333#256 | Arena (LMArena) |
Agents & tools
| Benchmark | not stated | Source | Trend |
|---|---|---|---|
| Terminal-Bench Hard | 3.0%#314 | Artificial Analysis | |
| τ²-Bench Telecom (AA)not in index | 15.2%#361 | Artificial Analysis | |
| BALROGnot in index | 27.9%#20 | BALROG | |
| TheAgentCompanynot in index | 6.9%#10 | TheAgentCompany |
Maths
| Benchmark | not stated | Source | Trend |
|---|---|---|---|
| OTIS Mock AIME | 3.6%#252 | Epoch AI Benchmarking Hub | |
| MATH Level 5 | 36.7%#67 | Epoch AI Benchmarking Hub | |
| Omni-MATH (HELM) | 21.0%#56 | HELM Capabilities | |
| Arena Maths | 1269#257 | Arena (LMArena) |
Knowledge
| Benchmark | not stated | Source | Trend |
|---|---|---|---|
| AA-Omniscience | -43.1#340 | Artificial Analysis | |
| MMLU-Pro (HELM)not in index | 65.3%#42 | HELM Capabilities | |
| MMLUnot in index | 80.1%#19 | Epoch AI Benchmarking Hub | |
| AA-Omniscience: accuracynot in index | 19.7%#311 | Artificial Analysis | |
| AA-Omniscience: non-hallucinationnot in index | 21.8%#270 | Artificial Analysis |
Instruction following
| Benchmark | not stated | Source | Trend |
|---|---|---|---|
| IFBench | 34.4%#318 | Artificial Analysis | |
| IFEval (HELM) | 82.1%#37 | HELM Capabilities | |
| WildBench (HELM) | 75.8%#50 | HELM Capabilities | |
| Arena Instruction Followingnot in index | 1273#263 | Arena (LMArena) |
Human preference
| Benchmark | not stated | Source | Trend |
|---|---|---|---|
| Arena Text | 1293#258 | Arena (LMArena) | |
| Arena Creative Writingnot in index | 1257#259 | Arena (LMArena) | |
| Arena Multi-turnnot in index | 1289#252 | Arena (LMArena) | |
| Arena Longer Queriesnot in index | 1295#258 | Arena (LMArena) |
Composite
| Benchmark | not stated | Source | Trend |
|---|---|---|---|
| Epoch Capabilities Indexnot in index | 125.9#160 | Epoch AI Benchmarking Hub | |
| AA Intelligence Index v4.3.2 | 6.6#520 | Artificial Analysis | |
| HELM Capabilities meannot in index | 57.4%#50 | HELM Capabilities |
Safety & honesty
| Benchmark | not stated | Source | Trend |
|---|---|---|---|
| FORTRESSnot in index | 44.2%#17 | Scale AI SEAL | |
| PropensityBenchnot in index | 55.4%#6 | Scale AI SEAL |
Where to run it
Every provider serving this model through OpenRouter, with throughput and first-token latency measured on live traffic over the last 30 minutes and each provider’s own price. Purple marks the best in each column.
| Provider | Speed | First token | Input $/M | Output $/M | Context | Quantisation |
|---|---|---|---|---|---|---|
| Amazon Bedrock | 68 tok/s | 0.39 s | $0.720 | $0.720 | 131k | – |
| DeepInfra (Turbo) | 32 tok/s | 0.46 s | $0.400 | $0.400 | 131k | fp8 |
Price history
The price above, per 1M tokens, every day it changed.
What a task costs
Estimates from list price, output speed and time to first answer for the best configuration. “With caching” assumes three-quarters of the input is served from the prompt cache. Reasoning tokens are not modelled.
| Workload | Tokens in / out | Cost | With caching | Time |
|---|---|---|---|---|
| Chat reply | 400 / 300 | $0.0004 | – | 9.5 s |
| Summarize a 30-page report | 12,000 / 600 | $0.0071 | – | 17.0 s |
| Code edit | 6,000 / 1,500 | $0.0042 | – | 39.5 s |
| Agentic coding session | 60,000 / 4,000 | $0.036 | – | 1.7 min |
| Structured extraction | 2,000 / 200 | $0.0012 | – | 7.0 s |
More from Meta
See also
Questions people ask
- What are Llama 3.1 70B's benchmark scores?
- As of 25 Oct 2026, Llama 3.1 70B scores 40.9 ±3.5 on the BenchLeader Index, strongest in instruction following (45) and weakest in coding (33). That rests on 16 independent benchmark results, and every score on this page links to its publisher.
- How does Llama 3.1 70B rank?
- Llama 3.1 70B is #645 of 785 ranked configurations on 25 Oct 2026. 272 other configurations score within its margin, so the exact position matters less than the band. The leader is Claude Opus 5.5 (max effort) at 72.6.
- How much does Llama 3.1 70B cost per 1M tokens?
- As of 25 Oct 2026, Llama 3.1 70B costs $0.560 per 1M input tokens and $0.560 per 1M output tokens, $0.560 blended (three input tokens per output token). The list price last changed on 13 Sept 2026.
- When was Llama 3.1 70B released?
- Meta released Llama 3.1 70B on 23 Jul 2024.
Data as of 25 Oct 2026. Compare with another model.
Cite as: BenchLeader, “Llama 3.1 70B: benchmarks, pricing, speed and rank”, data as of 25 Oct 2026, https://www.benchleader.com/models/llama-3-1-70b.