ARC-AGI-3
Semi-private ARC-AGI-3 interactive evaluation set.
- Published by
- ARC Prize
- Category
- Reasoning
- Index weight
- 0.5
- Models
- 39
- Data as of
- 9 Sept 2026
ARC Prize Foundation, arcprize.org.
- 1GPT 6 Astra Provider Adapter99.9%
- 2GPT 6 Astra Provider Adapter98.6%
- 3GPT 6 Astra Provider Adapter98.4%
- 4GPT 6 Astra Provider Adapter98.4%
- 5GPT 6 Astra Provider Adapter98.0%
- 6GPT 6 Astra Provider Adapter96.7%
- 7GPT-6 Astra62.7%
- 8GPT-6 Astra59.3%
- 9GPT-6 Astra54.8%
- 10GPT-6 Astra38.6%
- 11GPT-6 Astra35.2%
- 12Claude Opus 530.2%
- 13GPT-6 Astra17.5%
- 14GPT-5.6 Sol7.8%
- 15GPT-5.6 Sol7.0%
39 of 39
| # | |||||
|---|---|---|---|---|---|
| 1 | 99.9% | – | – | – | |
| 2 | 98.6% | – | – | – | |
| 3 | 98.4% | – | – | – | |
| 4 | 98.4% | – | – | – | |
| 5 | 98.0% | – | – | – | |
| 6 | 96.7% | – | – | – | |
| 7 | 62.7% | – | 70.6 | – | |
| 8 | 59.3% | – | 68.6 | – | |
| 9 | 54.8% | – | 69.5 | – | |
| 10 | 38.6% | – | 67.4 | – | |
| 11 | 35.2% | – | 64.4 | – | |
| 12 | 30.2% | – | 69.3 | – | |
| 13 | 17.5% | – | 65.8 | – | |
| 14 | 7.8% | – | 65.5 | – | |
| 15 | 7.0% | – | 67.5 | – | |
| 16 | 2.2% | – | 68.0 | – | |
| 17 | 2.1% | – | 62.3 | – | |
| 18 | 1.5% | – | 61.3 | – | |
| 19 | 1.1% | – | 66.0 | – | |
| 20 | 0.8% | – | 58.0 | – | |
| 21 | 0.7% | – | 64.2 | – | |
| 22 | 0.5% | – | 63.1 | – | |
| 23 | 0.5% | – | 54.1 | – | |
| 24 | 0.4% | – | 66.3 | – | |
| 25 | 0.4% | – | 63.9 | – | |
| 26 | 0.3% | – | 64.6 | – | |
| 27 | 0.3% | – | 54.2 | – | |
| 28 | 0.3% | – | – | – | |
| 29 | 0.3% | – | – | – | |
| 30 | 0.2% | – | 61.3 | – | |
| 31 | 0.2% | – | 58.8 | – | |
| 32 | 0.2% | – | 56.5 | – | |
| 33 | 0.2% | – | 54.4 | – | |
| 34 | 0.2% | – | 53.6 | – | |
| 35 | 0.1% | – | 58.1 | – | |
| 36 | 0.1% | – | 58.1 | – | |
| 37 | 0.1% | – | 54.3 | – | |
| 38 | 0.0% | – | 59.3 | – | |
| 39 | 0.0% | – | 58.8 | – |