OpenAIReasoning modelGPT-5.6 Sol
GPT-5.6 Sol is an OpenAI proprietary reasoning model, released 9 Jul 2026. Its best configuration (max reasoning effort) ranks #24 of 751 on the BenchLeader Index at 67.5 ±3.6, in the top 25. The ± is the point: 69 other configurations score within that range, so they and this one cannot be told apart on quality alone — price and speed are what separate them. It scores highest in composite (75) and lowest in knowledge (66). At $8.00 per million tokens blended it is among the most expensive ranked models. Output speed of 80 tokens per second puts it faster than most, with a first answer in 113.0 s. It has been measured at 7 reasoning-effort settings; this summary describes the best-scoring one, and the tabs above switch between them. Last measured 29 Sept 2026.
- Blended price
- $8.00/M
- $4.00 in · $20.00 out
- Output speed
- 80 tok/s
- measured by Artificial Analysis
- First answer
- 113 s
- first token 3.36 s
- Context
- 1.1M
- Full answer
- 119 s
- median, reasoning included
- Cost per run
- $1.99
- one full Intelligence Index run
- Released
- 9 Jul 2026
- Overall index68
- Reasoning73
- Coding66
- Agents & tools66
- Maths72
- Knowledge66
- Instruction following71
- Multimodal67
- Long context68
- Composite75
Versions
OpenAI has shipped 3 models under this name. Each is ranked on its own results; a newer version often has fewer results so far, which holds its index nearer the average until more arrive.
| Model | Released | Index | Rank |
|---|---|---|---|
| NewGPT-6.1 Solmax | 29 Sept 2026 | 69.5 | #10 |
| GPT-6 Solmax | 22 Sept 2026 | 66.3 | #31 |
| GPT-5.6 Solmaxthis page | 9 Jul 2026 | 67.5 | #24 |
Reasoning-effort configurations
The same model behaves differently depending on how much it is allowed to think. Each row is one setting, scored only on the benchmarks that were run at that setting. “Not stated” collects results from publishers that did not say which setting they used; for a reasoning model that is usually its thinking mode, but we do not assume it. Pick a setting here or at the top of the page to see its price, speed and category scores.
| Effort | Index | Rank | Speed | First answer | Chat reply cost | Categories |
|---|---|---|---|---|---|---|
| no reasoning | 54.1 | #240 | 69 tok/s | 1.02 s | $0.0076 | Agents & tools 48 · Coding 52 · Composite 62 · Knowledge 62 · Long context 56 · Maths 54 · Multimodal 55 · Reasoning 55 |
| low | 62.4 | #84 | 72 tok/s | 2.72 s | $0.0076 | Agents & tools 67 · Coding 63 · Composite 68 · Instruction following 66 · Knowledge 70 · Long context 64 · Maths 66 · Multimodal 64 · Reasoning 58 |
| medium | 64.6 | #50 | 73 tok/s | 5.46 s | $0.0076 | Agents & tools 73 · Coding 64 · Composite 74 · Instruction following 68 · Knowledge 71 · Long context 66 · Multimodal 65 · Reasoning 65 |
| high | 66.5 | #29 | 76 tok/s | 13 s | $0.0076 | Agents & tools 73 · Coding 71 · Composite 78 · Instruction following 68 · Knowledge 71 · Long context 66 · Multimodal 65 · Reasoning 68 |
| xhigh | 66.9 | #27 | 78 tok/s | 50 s | $0.0076 | Agents & tools 71 · Coding 66 · Composite 80 · Human preference 68 · Instruction following 70 · Knowledge 71 · Long context 67 · Maths 68 · Multimodal 64 · Reasoning 70 |
| maxbest | 67.5 | #24 | 80 tok/s | 113 s | $0.0076 | Agents & tools 66 · Coding 66 · Composite 75 · Instruction following 71 · Knowledge 66 · Long context 68 · Maths 72 · Multimodal 67 · Reasoning 73 |
| not stated | 54.9 | #225 | 45 tok/s | 3.36 s | $0.0076 | Agents & tools 49 · Coding 62 · Human preference 58 · Reasoning 62 |
What more thinking costs
Turning the effort up buys index points and multiplies the bill. Here max costs 7.6× low for +5.1 on the index — 1.7 points per doubling of spend. Compare that with other models.
How its index has moved
8 Sept 2026 to 3 Oct 2026- max
- xhigh
- high
- medium
The index is recomputed from scratch every day, so a line moves when a new benchmark result lands, when a publisher revises a score, or when the models it is normalised against change. Early movement usually means the score is still settling.
Benchmark results
One column per reasoning effort. Rank is among every configuration of every model on that benchmark. Hover a score for the run it came from.
Reasoning
| Benchmark | no reasoning | low | medium | high | xhigh | max | not stated | Source | Trend |
|---|---|---|---|---|---|---|---|---|---|
| GPQA Diamond | 82.8%#104 | 89.9%#45 | – | – | – | 93.5%#15 | – | Epoch AI Benchmarking Hub | |
| SimpleBench | – | – | – | – | 64.8%#17 | – | 64.8%#17 | SimpleBench | |
| LMArena Hard Prompts | – | – | – | – | 1511#17 | – | – | LMArena | |
| LiveBench Reasoningnot in index | – | – | – | – | – | 91.7%#5 | – | LiveBench | |
| GPQA Diamond (AA)not in index | 79.0%#199 | 89.8%#67 | 92.6%#32 | 92.8%#28 | 93.1%#24 | 94.1%#7 | – | Artificial Analysis | |
| Humanity's Last Exam (AA)not in index | 16.7%#221 | 39.4%#83 | 42.2%#65 | 46.0%#43 | 47.3%#37 | 49.5%#25 | – | Artificial Analysis | |
| GPQA Diamond (Vals)not in index | – | – | – | – | – | 95.2%#2 | – | Vals AI | |
| EnigmaEval | – | – | – | 37.1%#2 | – | – | – | Scale AI SEAL | |
| Kagi LLM Benchmark | – | – | – | – | – | – | 67.0%#35 | Kagi LLM Benchmark | |
| ARC-AGI-1 | – | 74.5%#114 | 92.5%#48 | 97.0%#20 | 97.5%#10 | 96.5%#21 | – | ARC Prize | |
| ARC-AGI-2 | – | 42.5%#99 | 67.1%#60 | 85.4%#26 | 90.0%#13 | 92.5%#5 | – | ARC Prize | |
| ARC-AGI-3 | – | 0.3%#37 | 1.1%#27 | 2.2%#22 | 7.0%#19 | 7.8%#18 | – | ARC Prize | |
| CritPt | 5.1%#136 | 14.9%#85 | 22.9%#49 | 25.7%#38 | 28.6%#23 | 32.3%#1 | – | Artificial Analysis | |
| MysteryMechanismnot in index | – | – | – | – | – | 33.3%#10 | – | Vals AI | |
| Chess Puzzlesnot in index | 7.0%#143 | 27.0%#58 | – | – | – | 55.0%#7 | – | Epoch AI Benchmarking Hub | |
| Mystery Game Puzzlesnot in index | 33.0%#24 | 26.0%#38 | – | – | – | 58.0%#6 | – | Epoch AI Benchmarking Hub | |
| LMCAnot in index | 52.8%#39 | 55.9%#29 | 56.4%#28 | 56.9%#27 | 58.5%#24 | 58.4%#25 | – | Epoch AI Benchmarking Hub | |
| DTBenchnot in index | 83.7%#93 | 93.9%#46 | 95.2%#32 | 95.5%#28 | 95.7%#25 | 95.5%#28 | – | Epoch AI Benchmarking Hub | |
| BTF-3not in index | – | – | 13.7%#7 | 13.5%#9 | – | 13.7%#7 | – | Epoch AI Benchmarking Hub |
Coding
| Benchmark | no reasoning | low | medium | high | xhigh | max | not stated | Source | Trend |
|---|---|---|---|---|---|---|---|---|---|
| SciCode | 47.1%#105 | 55.4%#37 | 56.5%#25 | 56.9%#21 | 56.0%#31 | 57.1%#20 | – | SciCode | |
| WeirdML | – | – | – | 88.8%#10 | – | 87.0%#12 | – | WeirdML | |
| FrontierCode | – | – | – | – | – | – | 47.5%#11 | Cognition | |
| LMArena Coding | – | – | – | – | 1534#14 | – | – | LMArena | |
| LMArena WebDev | – | – | – | – | 1620#21 | – | – | LMArena | |
| LiveBench Codingnot in index | – | – | – | – | – | 83.9%#7 | – | LiveBench | |
| SciCode (AA)not in index | 47.7%#113 | 56.4%#35 | 57.4%#24 | 57.8%#21 | 57.1%#29 | 57.1%#29 | – | Artificial Analysis | |
| LiveCodeBench | – | – | – | – | – | 82.6%#50 | – | Vals AI | |
| IOI | – | – | – | – | – | 91.2%#5 | – | Vals AI | |
| SWE-bench (Vals)not in index | – | – | – | – | – | 96.2%#3 | – | Vals AI | |
| Code Migrationnot in index | – | – | – | – | – | 52.9%#10 | – | Vals AI | |
| ProgramBenchnot in index | – | – | – | – | – | 1.5%#9 | – | Vals AI | |
| Vibe Code Bench 1-100not in index | – | – | – | – | – | 20.0%#7 | – | Vals AI | |
| Vibe Code Bench v1.1not in index | – | – | – | – | – | 80.5%#20 | – | Vals AI | |
| SWE Atlas: Codebase QnAnot in index | – | – | – | – | 46.0%#7 | – | – | Scale AI SEAL | |
| SWE Atlas: Test Writingnot in index | – | – | – | – | 45.9%#7 | – | – | Scale AI SEAL | |
| MirrorCodenot in index | – | – | – | 20.0%#6 | – | – | – | Epoch AI Benchmarking Hub | |
| Surface Evolver Benchnot in index | – | – | – | – | 93.1%#3 | – | – | Epoch AI Benchmarking Hub | |
| DeepSWEnot in index | – | 45.4%#52 | 61.1%#31 | 69.4%#15 | 70.7%#11 | 72.7%#9 | – | Epoch AI Benchmarking Hub | |
| CursorBenchnot in index | – | 24.6%#50 | 31.1%#41 | 35.7%#32 | 37.7%#26 | 41.7%#17 | – | Cursor | |
| ALE-Benchnot in index | – | – | – | – | – | 2176.9#3 | – | Epoch AI Benchmarking Hub | |
| FrontierSWEnot in index | – | – | – | – | – | 32.2%#7 | – | Epoch AI Benchmarking Hub | |
| Terminal-Bench 4.0 (AA)not in index | – | 1.0%#112 | 14.7%#60 | 20.7%#52 | 24.8%#47 | 39.9%#29 | – | Artificial Analysis | |
| Terminal-Bench 2.1 (AA)not in index | 74.2%#65 | 76.8%#58 | 86.1%#21 | 87.3%#20 | 89.5%#5 | 88.0%#12 | – | Artificial Analysis |
Agents & tools
| Benchmark | no reasoning | low | medium | high | xhigh | max | not stated | Source | Trend |
|---|---|---|---|---|---|---|---|---|---|
| Terminal-Bench | – | – | – | – | – | 37.3%#46 | – | Terminal-Bench | |
| OSWorld-Verified 2.0 | – | – | – | – | – | 27.3%#4 | – | OSWorld | |
| LMArena Agent | – | – | – | – | 6.5#12 | – | – | LMArena | |
| LiveBench Agentic Codingnot in index | – | – | – | – | – | 56.2%#26 | – | LiveBench | |
| Terminal-Bench Hard | – | 60.6%#7 | 62.9%#2 | 62.1%#5 | 61.4%#6 | 65.9%#1 | – | Artificial Analysis | |
| τ²-Bench Telecom (AA)not in index | – | 76.0%#133 | 81.0%#118 | 83.3%#109 | 84.8%#96 | 85.1%#93 | – | Artificial Analysis | |
| Terminal-Bench 2.1 (Vals) | – | – | – | – | – | 85.8%#3 | – | Vals AI | |
| HiL-Bench | – | – | – | – | – | – | 32.3%#11 | Scale AI SEAL | |
| GDPval (AA)not in index | 36.3%#101 | 39.5%#92 | 45.1%#63 | 49.0%#46 | 52.4%#35 | 54.4%#28 | – | Artificial Analysis | |
| τ²-Bench Banking (AA) | 19.6%#97 | 29.1%#68 | 36.5%#44 | 36.7%#42 | 38.1%#38 | 44.3%#17 | – | Artificial Analysis | |
| ITBench SRE (AA)not in index | – | – | – | – | – | 56.2%#1 | – | Artificial Analysis | |
| Analyst Agent (AA)not in index | – | – | – | – | – | 47.5%#10 | – | Artificial Analysis | |
| CUA-benchnot in index | – | – | – | – | – | 8.3%#5 | – | Vals AI | |
| CyberBenchnot in index | – | – | – | – | – | 76.3%#3 | – | Vals AI | |
| Finance Agent v2not in index | – | – | – | – | – | 53.8%#25 | – | Vals AI | |
| Harvey's Legal Agent Benchmarknot in index | – | – | – | – | – | 2.5%#38 | – | Vals AI | |
| Legal Research Benchnot in index | – | – | – | – | – | 48.1%#8 | – | Vals AI | |
| SkillsBenchnot in index | – | – | – | – | – | 54.1%#15 | – | Vals AI | |
| SREBenchnot in index | – | – | – | – | – | 30.5%#5 | – | Vals AI | |
| Tax Agent Benchnot in index | – | – | – | – | – | 68.0%#13 | – | Vals AI | |
| Terminal-Bench 4.0 (Vals)not in index | – | – | – | – | – | 37.9%#11 | – | Vals AI | |
| Terminal-Bench Sciencenot in index | – | – | – | – | – | 20.0%#8 | – | Vals AI | |
| Time Horizon Index: KSPnot in index | – | – | – | – | – | 23.8%#3 | – | Vals AI | |
| Web Search Indexnot in index | – | – | – | – | – | 43.6%#4 | – | Vals AI | |
| LMArena Searchnot in index | – | – | – | – | 1256#1 | – | – | LMArena | |
| BALROGnot in index | – | – | – | – | – | 60.0%#3 | – | BALROG | |
| PostTrainBenchnot in index | – | – | – | – | – | 36.2%#2 | – | Epoch AI Benchmarking Hub | |
| GBAEvalnot in index | – | – | – | – | – | – | 52.6%#7 | Epoch AI Benchmarking Hub | |
| Vending-Bench 2not in index | – | – | – | – | – | – | 9619.4#5 | Andon Labs | |
| FACTS Searchnot in index | – | – | – | – | – | – | 88.5%#2 |
Maths
| Benchmark | no reasoning | low | medium | high | xhigh | max | not stated | Source | Trend |
|---|---|---|---|---|---|---|---|---|---|
| FrontierMath Tiers 1–3 | – | – | – | – | – | 89.1%#6 | – | Epoch AI Benchmarking Hub | |
| FrontierMath Tier 4 | – | – | – | – | – | 82.9%#11 | – | Epoch AI Benchmarking Hub | |
| OTIS Mock AIME | 68.9%#133 | 95.6%#36 | – | – | – | 100.0%#1 | – | Epoch AI Benchmarking Hub | |
| ProofBench | – | – | – | – | – | 83.0%#9 | – | Vals AI | |
| LiveBench Mathematicsnot in index | – | – | – | – | – | 96.2%#9 | – | LiveBench | |
| LMArena Maths | – | – | – | – | 1494#22 | – | – | LMArena |
Knowledge
| Benchmark | no reasoning | low | medium | high | xhigh | max | not stated | Source | Trend |
|---|---|---|---|---|---|---|---|---|---|
| SimpleQA Verified | – | – | – | – | – | 69.7%#7 | – | Epoch AI Benchmarking Hub | |
| LiveBench Data Analysisnot in index | – | – | – | – | – | 79.8%#9 | – | LiveBench | |
| AA-Omniscience | 1.1#112 | 18.9#69 | 19.4#67 | 20.4#64 | 21.0#59 | 22.0#56 | – | Artificial Analysis | |
| MMLU-Pro | – | – | – | – | – | 89.1%#16 | – | Vals AI | |
| LegalBench | – | – | – | – | – | 87.0%#8 | – | Vals AI | |
| CorpFin | – | – | – | – | – | 64.4%#38 | – | Vals AI | |
| TaxEval | – | – | – | – | – | 74.8%#28 | – | Vals AI | |
| PRBench Finance | – | – | – | – | – | 50.5%#9 | – | Scale AI SEAL | |
| PRBench Legal | – | – | – | – | – | 50.5%#7 | – | Scale AI SEAL | |
| BioMysteryBenchnot in index | – | – | – | – | – | 71.1%#10 | – | Vals AI | |
| Excel Modeling Benchmarknot in index | – | – | – | – | – | 72.3%#7 | – | Vals AI | |
| MedCodenot in index | – | – | – | – | – | 44.0%#41 | – | Vals AI | |
| MedScribenot in index | – | – | – | – | – | 85.2%#28 | – | Vals AI | |
| Public Benefits Benchnot in index | – | – | – | – | – | 66.5%#15 | – | Vals AI | |
| DrugDiscoveryBenchnot in index | – | – | – | – | – | 56.5%#3 | – | Scale AI SEAL | |
| EBR-benchnot in index | – | – | – | – | – | 44.8%#7 | – | Epoch AI Benchmarking Hub | |
| GDP.pdfnot in index | – | – | – | – | – | 30.7%#1 | 30.7%#1 | Epoch AI Benchmarking Hub | |
| AA-Omniscience: accuracynot in index | 48.7%#68 | 57.2%#30 | 57.8%#29 | 58.4%#27 | 58.8%#26 | 59.4%#23 | – | Artificial Analysis | |
| AA-Omniscience: non-hallucinationnot in index | 7.2%#465 | 10.6%#388 | 9.2%#413 | 8.8%#425 | 8.1%#446 | 7.8%#452 | – | Artificial Analysis |
Instruction following
| Benchmark | no reasoning | low | medium | high | xhigh | max | not stated | Source | Trend |
|---|---|---|---|---|---|---|---|---|---|
| LiveBench Languagenot in index | – | – | – | – | – | 87.7%#8 | – | LiveBench | |
| LiveBench Instruction Followingnot in index | – | – | – | – | – | 71.8%#21 | – | LiveBench | |
| IFBench | – | 66.5%#93 | 69.6%#72 | 69.2%#73 | 71.0%#62 | 72.7%#46 | – | Artificial Analysis | |
| LMArena Instruction Followingnot in index | – | – | – | – | 1490#12 | – | – | LMArena |
Human preference
| Benchmark | no reasoning | low | medium | high | xhigh | max | not stated | Source | Trend |
|---|---|---|---|---|---|---|---|---|---|
| LMArena Text | – | – | – | – | 1484#20 | – | – | LMArena | |
| EQ-Bench 4 | – | – | – | – | – | – | 1250#9 | EQ-Bench | |
| LMArena Creative Writingnot in index | – | – | – | – | 1468#19 | – | – | LMArena | |
| LMArena Multi-turnnot in index | – | – | – | – | 1487#27 | – | – | LMArena | |
| LMArena Longer Queriesnot in index | – | – | – | – | 1498#18 | – | – | LMArena |
Multimodal
| Benchmark | no reasoning | low | medium | high | xhigh | max | not stated | Source | Trend |
|---|---|---|---|---|---|---|---|---|---|
| LMArena Vision | – | – | – | – | 1279#35 | – | – | LMArena | |
| MMMU-Pro | 71.9%#128 | 81.0%#41 | 81.4%#38 | 81.8%#36 | 82.7%#30 | 83.4%#25 | – | Artificial Analysis | |
| MMMU-Pro (Vals)not in index | – | – | – | – | – | 88.8%#6 | – | Vals AI | |
| MortgageTaxnot in index | – | – | – | – | – | 67.3%#27 | – | Vals AI | |
| SAGEnot in index | – | – | – | – | – | 52.6%#6 | – | Vals AI | |
| Blueprint-Bench 2not in index | – | – | – | – | – | – | 33.6%#7 | Epoch AI Benchmarking Hub |
Long context
| Benchmark | no reasoning | low | medium | high | xhigh | max | not stated | Source | Trend |
|---|---|---|---|---|---|---|---|---|---|
| AA-LCR | 62.3%#252 | 78.0%#110 | 80.3%#63 | 81.7%#46 | 82.3%#35 | 84.0%#11 | – | Artificial Analysis | |
| LMArena Documentnot in index | – | – | – | – | 1489#8 | – | – | LMArena |
Composite
| Benchmark | no reasoning | low | medium | high | xhigh | max | not stated | Source | Trend |
|---|---|---|---|---|---|---|---|---|---|
| Epoch Capabilities Indexnot in index | – | – | – | – | – | – | 161.8#8 | Epoch AI Benchmarking Hub | |
| LiveBench | – | – | – | – | – | 81.0%#10 | – | LiveBench | |
| AA Intelligence Index | 28.3#120 | 33.5#94 | 39.2#63 | 42.4#45 | 44.0#40 | 47.0#26 | – | Artificial Analysis | |
| Vals Indexnot in index | – | – | – | – | – | 58.0#10 | – | Vals AI | |
| Vals Multimodal Indexnot in index | – | – | – | – | – | 72.6%#4 | – | Vals AI |
Safety & honesty
| Benchmark | no reasoning | low | medium | high | xhigh | max | not stated | Source | Trend |
|---|---|---|---|---|---|---|---|---|---|
| FORTRESSnot in index | – | – | – | – | – | – | 20.1%#39 | Scale AI SEAL |
Where it wins
Benchmarks where this configuration ranks in the top five of every configuration measured.
Where to run it
Every provider serving this model through OpenRouter, with throughput and first-token latency measured on live traffic over the last 30 minutes and each provider’s own price. Purple marks the best in each column.
| Provider | Speed | First token | Input $/M | Output $/M | Context | Quantisation |
|---|---|---|---|---|---|---|
| Azure | 96 tok/s | 3.54 s | $4.40 | $22.00 | 1.1M | – |
| OpenAI | 93 tok/s | 1.76 s | $1.00 | $5.00 | 1.1M | – |
| OpenAI | 86 tok/s | 2.89 s | $4.00 | $20.00 | 1.1M | – |
| OpenAI | 64 tok/s | 2.62 s | $2.00 | $10.00 | 1.1M | – |
| Azure | 51 tok/s | 2.49 s | $4.00 | $20.00 | 1.1M | – |
| Amazon Bedrock | 48 tok/s | 2.54 s | $4.40 | $22.00 | 1.1M | – |
Price history
Listed price per 1M tokens over time, as recorded by OpenRouter for the provider with the longest history.
What a task costs
Estimates from list price, output speed and time to first answer for the best configuration. “With caching” assumes three-quarters of the input is served from the prompt cache at $0.400 per 1M. Reasoning tokens are not modelled.
| Workload | Tokens in / out | Cost | With caching | Time |
|---|---|---|---|---|
| Chat reply | 400 / 300 | $0.0076 | $0.0065 | 1.9 min |
| Summarise a 30-page report | 12,000 / 600 | $0.060 | $0.028 | 2.0 min |
| Code edit | 6,000 / 1,500 | $0.054 | $0.038 | 2.2 min |
| Agentic coding session | 60,000 / 4,000 | $0.320 | $0.158 | 2.7 min |
| Structured extraction | 2,000 / 200 | $0.012 | $0.0066 | 1.9 min |
See also
Data as of 4 Oct 2026. Compare these configurations.
Cite as: BenchLeader, “GPT-5.6 Sol: benchmarks, pricing, speed and rank”, https://www.benchleader.com/models/gpt-5-6-sol, data as of 4 Oct 2026.