BenchLeader

GPT-6 Astra vs GPT-6 Sol

Verdict
  • GPT-6 Astra (max) leads on quality: 71.6 vs 67.7.
  • GPT-6 Astra (max) is stronger in agents & tools, coding, human preference, knowledge, maths.
  • GPT-6 Sol (max) is stronger in composite, long context, multimodal, reasoning.
  • GPT-6 Sol (max) is 5.0× cheaper ($4.00 vs $20.00 per 1M blended).
  • GPT-6 Sol (max) streams 2.1× faster (126 vs 59 tokens per second).
MetricGPT-6 Astra (max)GPT-6 Sol (max)
BenchLeader Index71.667.7
Agents & tools score68.6
Coding score77.6
Composite score82.686.2
Human preference score68.2
Knowledge score81.475.4
Long context score66.167.7
Maths score76.9
Multimodal score66.867.1
Reasoning score77.795.0
Blended price $/M$20.00$4.00
Output speed59 tok/s126 tok/s
Time to first answer326.5 s107.2 s
Context window1.1M1.1M
GPQA Diamond95.8%
FrontierMath Tiers 1–393.7%
FrontierMath Tier 497.6%
OTIS Mock AIME100.0%
SimpleQA Verified75.6%
Terminal-Bench58.2%
SciCode56.5%
WeirdML93.3%
FrontierCode53.3%
LMArena Text1480
LMArena Hard Prompts1497
LMArena Coding1543
LMArena WebDev1800
LMArena Vision1279
LMArena Agent11.5
LiveBench82.2%
LiveBench Reasoning92.7%
LiveBench Coding80.4%
LiveBench Agentic Coding57.3%
LiveBench Mathematics96.8%
LiveBench Data Analysis83.0%
LiveBench Language89.4%
LiveBench Instruction Following75.6%
AA Intelligence Index52.747.5
AA-LCR80.7%83.7%
MMMU-Pro86.9%83.3%
AA-Omniscience43.427.1
GPQA Diamond (AA)96.1%
Humanity's Last Exam (AA)54.7%47.9%
SciCode (AA)56.5%57.6%
IOI100.0%
Terminal-Bench 2.1 (Vals)87.3%
Vals Index66.6
ARC-AGI-197.5%
ARC-AGI-295.0%
ARC-AGI-398.6%
CritPt31.7%30.9%
GDPval (AA)52.1%49.4%
τ²-Bench Banking (AA)41.4%
Analyst Agent (AA)51.3%
BioMysteryBench79.3%
Code Migration67.7%
CUA-bench19.2%
CyberBench41.1%
Excel Modeling Benchmark71.7%
Finance Agent v253.5%
Harvey's Legal Agent Benchmark5.4%
Legal Research Bench39.4%
MedCode48.5%
MedScribe87.9%
MysteryMechanism53.1%
ProgramBench5.5%
SAGE46.4%
SREBench56.9%
Tax Agent Bench63.3%
Terminal-Bench 4.0 (Vals)57.1%
Terminal-Bench Science65.7%
Time Horizon Index: KSP90.5%
Vibe Code Bench 1-10027.6%
Vibe Code Bench v1.189.6%
DrugDiscoveryBench68.7%
LMArena Creative Writing1461
LMArena Instruction Following1461
LMArena Multi-turn1499
LMArena Longer Queries1481
LMArena Document1473
Chess Puzzles72.0%
EBR-bench76.2%
Mystery Game Puzzles84.0%
BALROG68.3%
DeepSWE73.2%
ALE-Bench2951.3
FrontierSWE65.5%
Terminal-Bench 4.0 (AA)59.1%43.9%
Terminal-Bench 2.1 (AA)88.4%
AutomationBench68.5%61.6%
GDP.pdf31.0%24.8%
MLCR35.0%16.1%
AA-Omniscience: accuracy62.6%54.5%
AA-Omniscience: non-hallucination48.7%39.9%
AA-Briefcase15691483

Data as of 2026-09-23. Best configuration of each model; every score links to its source on the model pages.

GPT-6 Astra vs GPT-6 Sol: questions

Is GPT-6 Astra better than GPT-6 Sol?
GPT-6 Astra (max) leads on quality: 71.6 vs 67.7. The BenchLeader Index combines every independent quality benchmark; GPT-6 Astra (max) is ahead overall as of 2026-09-23, but check the category scores for your use.
Which is cheaper, GPT-6 Astra or GPT-6 Sol?
GPT-6 Sol is cheaper: $4.00 against $20.00 per million tokens, blended at three input tokens per output token.
Which is faster, GPT-6 Astra or GPT-6 Sol?
GPT-6 Sol streams faster: 126 against 59 output tokens per second.
Which has the larger context window?
Both accept 1.1M tokens of context.