Aider Polyglot
Percent of 225 Exercism problems solved on the second attempt.
- Published by
- Aider polyglot leaderboard
- Category
- Coding
- Index weight
- 1.0
- Models
- 45
- Data as of
- 9 Sept 2026
Apache 2.0 — Aider-AI/aider.
- 1GPT-588.0%
- 2o3-pro84.9%
- 3Gemini 2.5 Pro83.1%
- 4o381.3%
- 5Grok 479.6%
- 6DeepSeek R174.2%
- 7o4-mini72.0%
- 8Claude Opus 472.0%
- 9DeepSeek V3.270.2%
- 10Claude 3.7 Sonnet64.9%
- 11Deepseek R1 Plus Claude 3.5 Sonnet64.0%
- 12o161.7%
- 13Claude Sonnet 461.3%
- 14o3-mini60.4%
- 15Claude 3.7 Sonnet60.4%
45 of 45
| # | |||||
|---|---|---|---|---|---|
| 1 |  GPT-5OpenAI | 88.0% | – | 59.5 | – |
| 2 | o3-proOpenAI | 84.9% | – | 54.1 | – |
| 3 |  Gemini 2.5 ProGoogle | 83.1% | – | 54.1 | – |
| 4 | o3OpenAI | 81.3% | – | 60.3 | – |
| 5 |  Grok 4xAI | 79.6% | – | 57.2 | – |
| 6 |  DeepSeek R1DeepSeekopen | 74.2% | – | 48.9 | – |
| 7 | o4-miniOpenAI | 72.0% | – | 54.9 | – |
| 8 |  Claude Opus 4Anthropic | 72.0% | – | 50.7 | – |
| 9 | DeepSeek V3.2DeepSeekopen | 70.2% | – | 54.7 | – |
| 10 | Claude 3.7 SonnetAnthropic | 64.9% | – | 49.8 | – |
| 11 | Deepseek R1 Plus Claude 3.5 SonnetDeepSeek | 64.0% | – | – | – |
| 12 | o1OpenAI | 61.7% | – | 53.2 | – |
| 13 | Claude Sonnet 4Anthropic | 61.3% | – | 49.5 | – |
| 14 | o3-miniOpenAI | 60.4% | – | 49.5 | – |
| 15 | Claude 3.7 SonnetAnthropic | 60.4% | – | – | – |
| 16 |  Qwen3 235B A22BAlibabaopen | 59.6% | – | 48.7 | – |
| 17 |  Kimi K2Moonshot AIopen | 59.1% | – | 48.8 | – |
| 18 | Gemini 2.5 FlashGoogle | 55.1% | – | 48.8 | – |
| 19 | DeepSeek V3DeepSeekopen | 55.1% | 0324, diff format | 43.8 | – |
| 20 | Quasar AlphaUnknown | 54.7% | – | – | – |
| 21 | Grok 3xAI | 53.3% | – | 50.0 | – |
| 22 | Optimus AlphaUnknown | 52.9% | – | – | – |
| 23 | GPT-4.1OpenAI | 52.4% | – | 47.3 | – |
| 24 | Claude 3.5 SonnetAnthropic | 51.6% | – | 45.1 | – |
| 25 | Grok 3 minixAI | 49.3% | – | 52.0 | – |
| 26 | GPT-4oOpenAI | 45.3% | – | 42.3 | – |
| 27 | GPT-4.5OpenAI | 44.9% | – | 49.6 | – |
| 28 | gpt-oss-120bOpenAIopen | 41.8% | – | 47.6 | – |
| 29 | Qwen3 32BAlibabaopen | 40.0% | – | 45.9 | – |
| 30 | Gemini 2.0 ProGoogle | 35.6% | – | 47.0 | – |
| 31 | o1-miniOpenAI | 32.9% | – | 45.5 | – |
| 32 | GPT-4.1 miniOpenAI | 32.4% | – | 44.5 | – |
| 33 | Claude 3.5 HaikuAnthropic | 28.0% | – | 39.8 | – |
| 34 | Qwq 32B Plus Qwen 2.5 CoderAlibaba | 26.2% | – | – | – |
| 35 | Gemini 2.0 FlashGoogle | 22.2% | – | 42.3 | – |
| 36 | QwQ-32BAlibabaopen | 20.9% | – | 45.7 | – |
| 37 | Gemini 2.0 FlashGoogle | 18.2% | – | 45.1 | – |
| 38 | Qwen2.5-Coder 32B InstructAlibabaopen | 16.4% | – | 42.2 | – |
| 39 |  Llama 4 MaverickMetaopen | 15.6% | – | 42.6 | – |
| 40 | Yi Lightning01.AI | 12.9% | – | – | – |
| 41 |  Command A 03 2025 QualityCohere | 12.0% | – | – | – |
| 42 | Openhands Lm 32BAll Hands AI | 10.2% | – | – | – |
| 43 | GPT-4.1 nanoOpenAI | 8.9% | – | 38.1 | – |
| 44 | Gemma 3 27BGoogleopen | 4.9% | – | 39.7 | – |
| 45 | GPT-4o miniOpenAI | 3.6% | – | 35.8 | – |