SWE-bench (Vals)
Vals AI's own SWE-bench run. Shown for reference.
- Published by
- Vals AI
- Category
- Coding
- Index weight
- Reference only
- Models
- 84
- Data as of
- 9 Sept 2026
Vals AI (vals.ai).
- 1Claude Opus 597.0%
- 2DeepSeek V4 Pro96.4%
- 3GPT-5.6 Sol96.2%
- 4Grok 4.695.6%
- 5GLM-5.395.4%
- 6GPT-5.6 Terra95.4%
- 7Claude Fable 595.0%
- 8Kimi K393.4%
- 9GPT-5.6 Luna93.0%
- 10GLM-5.3-Flash92.0%
- 11DeepSeek V4 Flash88.8%
- 12Claude Opus 4.888.6%
- 13Muse Spark 1.286.6%
- 14Grok 4.586.6%
- 15Qwen 3.8 27B86.0%
84 of 84
| # | |||||
|---|---|---|---|---|---|
| 1 |  Claude Opus 5Anthropic | 97.0% | – | 70.0 | – |
| 2 |  DeepSeek V4 ProDeepSeekopen | 96.4% | max, 0813 | 56.1 | – |
| 3 |  GPT-5.6 SolOpenAI | 96.2% | – | 65.5 | – |
| 4 |  Grok 4.6xAI | 95.6% | – | 58.7 | – |
| 5 |  GLM-5.3Zhipu AIopen | 95.4% | – | 59.9 | – |
| 6 | GPT-5.6 TerraOpenAI | 95.4% | – | 58.0 | – |
| 7 | Claude Fable 5Anthropic | 95.0% | – | 70.4 | – |
| 8 |  Kimi K3Moonshot AIopen | 93.4% | kimi/kimi-k3 | 66.5 | – |
| 9 | GPT-5.6 LunaOpenAI | 93.0% | – | 56.5 | – |
| 10 | GLM-5.3-FlashZhipu AIopen | 92.0% | – | 55.6 | – |
| 11 | DeepSeek V4 FlashDeepSeekopen | 88.8% | high, 0731 | 59.3 | – |
| 12 | Claude Opus 4.8Anthropic | 88.6% | – | 64.7 | – |
| 13 |  Muse Spark 1.2Meta | 86.6% | – | 61.3 | – |
| 14 | Grok 4.5xAI | 86.6% | – | 54.2 | – |
| 15 |  Qwen 3.8 27BAlibabaopen | 86.0% | – | 52.0 | – |
| 16 | Claude Opus 4.8 Claude CodeAnthropic | 85.8% | – | – | – |
| 17 | Qwen3 8Alibaba | 85.6% | – | 63.9 | – |
| 18 | GLM-5.2Zhipu AIopen | 82.8% | – | 57.6 | – |
| 19 | GPT-5.5OpenAI | 82.6% | – | 63.7 | – |
| 20 | Inkling-SmallThinking Machinesopen | 82.2% | – | 55.0 | – |
| 21 | Claude Opus 4.7Anthropic | 82.0% | – | 65.5 | – |
| 22 | Muse Spark 1.1Meta | 82.0% | – | 56.4 | – |
| 23 |  Gemini 3.7 FlashGoogle | 80.8% | – | 60.8 | – |
| 24 | Gemini 3.8 FlashGoogle | 80.0% | – | 60.1 | – |
| 25 | Claude Sonnet 5Anthropic | 79.6% | – | 61.2 | – |
| 26 | Gemini 3.6 FlashGoogle | 79.6% | – | 58.6 | – |
| 27 | Composer 2.5Cursor | 79.6% | cursor/composer-2.5 | – | – |
| 28 | Gemini 3.1 ProGoogle | 78.8% | – | 60.7 | – |
| 29 | Gemini 3.5 FlashGoogle | 78.8% | – | 60.4 | – |
| 30 | Claude Opus 4.6Anthropic | 78.2% | – | 62.3 | – |
| 31 | GPT-5.4OpenAI | 78.2% | – | 61.3 | – |
| 32 | Kimi K2.7 CodeMoonshot AIopen | 78.2% | – | 56.2 | – |
| 33 | GPT-5.3 CodexOpenAI | 78.0% | – | – | – |
| 34 | Claude Sonnet 4.6Anthropic | 77.4% | – | 60.3 | – |
| 35 | Claude Opus 4.5Anthropic | 76.4% | – | 60.6 | – |
| 36 | GLM-5.1Zhipu AIopen | 76.4% | zai/glm-5.1 | 60.1 | – |
| 37 | Gemini 3 ProGoogle | 76.4% | – | 57.0 | – |
| 38 | GPT 5.5 CodexOpenAI | 76.4% | – | – | – |
| 39 | Kimi K2.6Moonshot AIopen | 76.2% | kimi/kimi-k2.6 | 60.6 | – |
| 40 | GPT 5.5 FactoryOpenAI | 76.2% | – | – | – |
| 41 | GPT-5.2OpenAI | 75.8% | – | 57.3 | – |
| 42 | Gemini 3 FlashGoogle | 75.0% | – | 58.5 | – |
| 43 |  MiniMax-M3MiniMaxopen | 75.0% | minimax/MiniMax-M3 | 56.9 | – |
| 44 | Gemini 3.5 Flash LiteGoogle | 75.0% | – | 44.0 | – |
| 45 | MiniMax-M2MiniMaxopen | 74.8% | minimax/MiniMax-M2.1 | 55.1 | – |
| 46 | Muse SparkMeta | 74.4% | – | 65.4 | – |
| 47 | MiniMax-M2.5MiniMaxopen | 74.2% | minimax/MiniMax-M2.5 | 53.5 | – |
| 48 | MiMo-V2.5-ProXiaomiopen | 74.0% | – | 59.0 | – |
| 49 | MiniMax-M2.7MiniMaxopen | 73.8% | minimax/MiniMax-M2.7 | 56.5 | – |
| 50 | Qwen3.6 PlusAlibabaopen | 73.4% | – | 59.0 | – |
| 51 | GPT-5.4 miniOpenAI | 73.0% | – | 46.0 | – |
| 52 | Qwen3 6Alibaba | 72.8% | – | 59.5 | – |
| 53 | GPT-5.2 CodexOpenAI | 72.4% | – | – | – |
| 54 | Grok 4.20xAI | 72.2% | – | 54.3 | – |
| 55 | GLM-5Zhipu AIopen | 71.4% | – | 57.0 | – |
| 56 | Grok 4.3xAI | 71.4% | – | 50.1 | – |
| 57 | Qwen3.5 PlusAlibaba | 71.2% | – | 57.2 | – |
| 58 | Kimi K2.5Moonshot AIopen | 70.0% | – | 55.3 | – |
| 59 | Qwen3.6 27BAlibabaopen | 70.0% | – | 53.2 | – |
| 60 | Claude Sonnet 4.5Anthropic | 70.0% | – | 52.8 | – |