BenchLeader

GPT-5.5 Pro vs Qwen3 8

Verdict
  • GPT-5.5 Pro (xhigh) and Qwen3 8 (max) are level on quality (67.1 vs 66.5).
  • GPT-5.5 Pro (xhigh) is stronger in maths, reasoning.
  • Qwen3 8 (max) is stronger in agents & tools, coding, composite, human preference, knowledge, long context, multimodal.
  • Qwen3 8 (max) is 25× cheaper ($2.67 vs $67.50 per 1M blended).
  • Qwen3 8 (max) streams 9.7× faster (39 vs 4 tokens per second).
MetricGPT-5.5 Pro (xhigh)Qwen3 8 (max)
BenchLeader Index67.166.5
Maths score74.567.0
Reasoning score80.176.3
Agents & tools score68.3
Coding score66.5
Composite score74.3
Human preference score68.2
Knowledge score63.5
Long context score66.6
Multimodal score67.4
Blended price $/M$67.50$2.67
Output speed4 tok/s39 tok/s
Time to first answer3.5 s55.1 s
Context window1.1M1M
FrontierMath Tiers 1–387.7%
FrontierMath Tier 478.0%
SciCode52.9%
ProofBench58.0%
Epoch Capabilities Index156.6
LMArena Text1481
LMArena Hard Prompts1503
LMArena Coding1522
LMArena WebDev1671
LMArena Vision1315
LMArena Agent3.3
LiveBench78.5%
LiveBench Reasoning88.2%
LiveBench Coding72.9%
LiveBench Agentic Coding64.7%
LiveBench Mathematics91.3%
LiveBench Data Analysis78.4%
LiveBench Language79.7%
LiveBench Instruction Following74.1%
AA Intelligence Index45.4
AA-LCR80.3%
MMMU-Pro82.8%
AA-Omniscience12.0
GPQA Diamond (AA)92.8%
Humanity's Last Exam (AA)43.1%
SciCode (AA)53.2%
LiveCodeBench87.8%
MMLU-Pro88.6%
IOI68.9%
LegalBench83.6%
CorpFin65.8%
TaxEval75.5%
Terminal-Bench 2.1 (Vals)67.4%
SWE-bench (Vals)85.6%
GPQA Diamond (Vals)93.7%
Vals Index51.8
ARC-AGI-195.0%
ARC-AGI-284.2%
CritPt30.6%20.0%
GDPval (AA)58.2%
τ²-Bench Banking (AA)51.3%
Code Migration24.0%
Excel Modeling Benchmark60.1%
Finance Agent v250.6%
Harvey's Legal Agent Benchmark10.4%
Legal Research Bench47.6%
MedCode40.7%
MedScribe85.0%
MMMU-Pro (Vals)88.0%
MortgageTax64.0%
MysteryMechanism23.9%
ProgramBench0.0%
Public Benefits Bench67.1%
SAGE51.3%
SkillsBench42.0%
Tax Agent Bench66.0%
Terminal-Bench 4.0 (Vals)24.8%
Terminal-Bench Science1.4%
Vals Multimodal Index65.4%
Vibe Code Bench 1-10012.8%
Vibe Code Bench v1.164.7%
LMArena Maths1498
LMArena Creative Writing1472
LMArena Instruction Following1477
LMArena Multi-turn1495
LMArena Longer Queries1492
LMCA53.9%
DTBench96.0%

Data as of 2026-09-19. Best configuration of each model; every score links to its source on the model pages.

GPT-5.5 Pro vs Qwen3 8: questions

Is GPT-5.5 Pro better than Qwen3 8?
GPT-5.5 Pro (xhigh) and Qwen3 8 (max) are level on quality (67.1 vs 66.5). The BenchLeader Index combines every independent quality benchmark; GPT-5.5 Pro (xhigh) is ahead overall as of 2026-09-19, but check the category scores for your use.
Which is cheaper, GPT-5.5 Pro or Qwen3 8?
Qwen3 8 is cheaper: $2.67 against $67.50 per million tokens, blended at three input tokens per output token.
Which is faster, GPT-5.5 Pro or Qwen3 8?
Qwen3 8 streams faster: 39 against 4 output tokens per second.
Which has the larger context window?
GPT-5.5 Pro accepts more context: 1.1M against 1M tokens.