SWE Atlas leaderboard
As of 16 Nov 2026, the top score on SWE Atlas is 80.5% by Claude Fable 5.2 (Anthropic), ahead of Claude Opus 5.5 at 77.4%, across 28 model configurations with a published result (Scale AI SEAL, result dated 11 Nov 2026). SWE Atlas v1.1 overall: codebase QnA, test writing and refactoring on 284 tasks from 15 repositories, every model re-run with a new judge. Scale AI. SWE Atlas is shown for reference only and does not count toward the BenchLeader Index.
Key facts (as of 16 Nov 2026)
- Claude Fable 5.2 holds the top SWE Atlas v1.1 score at 80.5% (Scale AI SEAL, 11 Nov 2026).
- Claude Opus 5.5 is second on SWE Atlas v1.1 at 77.4% (Scale AI SEAL, 9 Sep 2026).
- SWE Atlas v1.1: SWE Atlas v1.1 overall: codebase QnA, test writing and refactoring on 284 tasks from 15 repositories, every model re-run with a new judge. Scale AI (Scale AI SEAL).
- 28 model configurations have a published SWE Atlas v1.1 result on BenchLeader (BenchLeader, 16 Nov 2026).
- SWE Atlas v1.1 does not feed the BenchLeader Index; it is shown for reference (BenchLeader methodology).
SWE Atlas v1.1 overall: codebase QnA, test writing and refactoring on 284 tasks from 15 repositories, every model re-run with a new judge. Scale AI.
- Published by
- Scale AI SEAL
- Category
- Coding
- Index weight
- Reference only
- Models
- 28
- Data as of
- 16 Nov 2026
- Newest result
- 11 Nov 2026
Scale AI SEAL Leaderboards.
- 1Claude Fable 5.280.5%
- 2Claude Opus 5.577.4%
- 3Claude Fable 5.176.4%
- 4Gemini 4 Carbon71.4%
- 5Gemini 4 Argon70.1%
- 6GPT-6 Astra69.4%
- 7Claude Sonnet 5.568.3%
- 8GPT-6.1 Sol65.9%
- 9Muse Wonder64.8%
- 10Qwen3.8 Max (max)64.4%
- 11DeepSeek V4.1 Flash62.1%
- 12Grok 4.762.1%
- 13Inkling 2 Small61.9%
- 14Kimi K3.1 Pro61.1%
- 15Kimi K361.0%
| # | ||||
|---|---|---|---|---|
| 1 | New | 80.5% | 65.4 | 2026-11-11 |
| 2 | 77.4% | 61.0 | 2026-09-09 | |
| 3 | 76.4% | 66.4 | 2026-09-02 | |
| 4 | 71.4% | – | 2026-11-11 | |
| 5 | 70.1% | 64.4 | 2026-06-11 | |
| 6 | 69.4% | 66.4 | 2026-05-06 | |
| 7 | 68.3% | – | 2026-06-08 | |
| 8 | 65.9% | 62.0 | 2026-05-06 | |
| 9 | 64.8% | 64.4 | 2026-09-09 | |
| 10 | 64.4% | 58.7 | 2026-11-11 | |
| 11 | 62.1% | – | 2026-06-23 | |
| 12 | 62.1% | – | 2026-05-06 | |
| 13 | 61.9% | 57.9 | 2026-05-06 | |
| 14 | 61.1% | 61.8 | 2026-11-11 | |
| 15 | 61.0% | 60.7 | 2026-05-06 | |
| 16 | 59.4% | – | 2026-05-06 | |
| 17 | 58.1% | – | 2026-11-11 | |
| 18 | 57.7% | – | 2026-05-06 | |
| 19 | 57.3% | 56.4 | 2026-05-06 | |
| 20 | New | 56.0% | – | 2026-11-11 |
| 21 | 55.3% | 57.8 | 2026-11-11 | |
| 22 | 50.8% | – | 2026-05-06 | |
| 23 | 45.2% | 52.9 | 2026-11-11 | |
| 24 | 42.3% | – | 2026-05-06 | |
| 25 | 39.3% | 56.1 | 2026-11-11 | |
| 26 | 24.8% | 45.8 | 2026-11-11 | |
| 27 | 21.4% | 42.1 | 2026-11-11 | |
| 28 | 8.8% | 46.1 | 2026-11-11 |
AI coding benchmark leaderboard · All LLM benchmarks
Related benchmarks
Top head-to-heads on SWE Atlas v1.1
Cite as: BenchLeader, “SWE Atlas v1.1 leaderboard”, data as of 16 Nov 2026, https://www.benchleader.com/benchmarks/scale_swe_atlas.
SWE Atlas v1.1: questions
- What does SWE Atlas v1.1 measure?
- SWE Atlas v1.1 overall: codebase QnA, test writing and refactoring on 284 tasks from 15 repositories, every model re-run with a new judge. Scale AI. Scores are reported in percent of tasks solved; higher is better.
- What is the top score on SWE Atlas?
- As of 16 Nov 2026, the highest score on SWE Atlas v1.1 is 80.5% by Claude Fable 5.2 (result dated 11 Nov 2026), ahead of Claude Opus 5.5 at 77.4%. Scores come from Scale AI SEAL and are re-read daily.
- Which AI model leads SWE Atlas v1.1?
- Claude Fable 5.2 leads SWE Atlas v1.1 with 80.5% as of 16 Nov 2026 (result dated 11 Nov 2026), ahead of Claude Opus 5.5 at 77.4%.
- How many models have SWE Atlas v1.1 results?
- 28 model configurations have a SWE Atlas v1.1 result on BenchLeader, all taken from Scale AI SEAL.
- Who runs SWE Atlas v1.1 and how often is it updated?
- SWE Atlas v1.1 is published by Scale AI SEAL. BenchLeader re-reads the published results once a day and records the date each result was published.
- Does SWE Atlas v1.1 count toward the BenchLeader Index?
- No. SWE Atlas v1.1 is shown for reference but left out of the composite index.