BenchLeader

GPT-6 Astra vs Qwen3 8

Verdict
  • GPT-6 Astra (max) leads on quality: 70.6 vs 63.9.
  • GPT-6 Astra (max) is stronger in agents & tools, coding, composite, knowledge, maths, reasoning.
  • Qwen3 8 (max) is stronger in human preference, long context, multimodal.
  • Qwen3 8 (max) is 8.3× cheaper ($2.67 vs $22.00 per 1M blended).
  • GPT-6 Astra (max) streams 1.4× faster (54 vs 39 tokens per second).
MetricGPT-6 Astra (max)Qwen3 8 (max)
BenchLeader Index70.663.9
Agents & tools score68.256.1
Coding score79.071.7
Composite score73.170.8
Knowledge score79.862.3
Maths score77.0
Reasoning score70.967.7
Human preference score67.9
Long context score65.7
Multimodal score67.2
Blended price $/M$22.00$2.67
Output speed54 tok/s39 tok/s
Time to first answer328.6 s53.2 s
Context window1.1M1M
GPQA Diamond95.8%
FrontierMath Tiers 1–393.7%
FrontierMath Tier 497.6%
OTIS Mock AIME100.0%
SimpleQA Verified75.6%
Terminal-Bench58.2%
SciCode56.5%
FrontierCode53.3%
Epoch Capabilities Index156.6
LMArena Text1480
LMArena Hard Prompts1502
LMArena Coding1520
LMArena WebDev17961685
LMArena Vision1313
LMArena Agent12.53.9
LiveBench82.2%78.5%
LiveBench Reasoning92.7%88.2%
LiveBench Coding80.4%72.9%
LiveBench Agentic Coding57.3%64.7%
LiveBench Mathematics96.8%91.3%
LiveBench Data Analysis83.0%78.4%
LiveBench Language89.4%79.7%
AA Intelligence Index40.3
AA-LCR78.3%
MMMU-Pro82.3%
AA-Omniscience3.4
GPQA Diamond (AA)92.7%
Humanity's Last Exam (AA)43.0%
SciCode (AA)53.2%
LiveCodeBench87.8%
MMLU-Pro88.6%
IOI73.0%
LegalBench83.6%
CorpFin65.8%
TaxEval75.5%
Terminal-Bench 2.1 (Vals)87.3%67.4%
SWE-bench (Vals)85.6%
GPQA Diamond (Vals)93.7%
Vals Index66.651.8
ARC-AGI-197.5%
ARC-AGI-295.0%
ARC-AGI-362.7%

Data as of 2026-09-09. Best configuration of each model; every score links to its source on the model pages.