BenchLeader

GPT-5.5 vs Qwen3 8

Verdict
  • GPT-5.5 leads on quality: 66.6 vs 63.9.
  • GPT-5.5 is stronger in agents & tools, composite, instruction following, knowledge, long context, reasoning.
  • Qwen3 8 (max) is stronger in coding, human preference, multimodal.
  • Qwen3 8 (max) is 4.2× cheaper ($2.67 vs $11.25 per 1M blended).
  • GPT-5.5 streams 2.2× faster (88 vs 39 tokens per second).
MetricGPT-5.5Qwen3 8 (max)
BenchLeader Index66.663.9
Agents & tools score68.456.1
Coding score57.371.7
Composite score77.770.8
Human preference score67.667.9
Instruction following score73.3
Knowledge score73.762.3
Long context score68.865.7
Multimodal score64.967.2
Reasoning score69.767.7
Blended price $/M$11.25$2.67
Output speed88 tok/s39 tok/s
Time to first answer62.3 s53.2 s
Context window1.1M1M
Terminal-Bench84.7%
SimpleBench69.0%
Remote Labor Index6.3%
APEX-Agents38.5%
FrontierCode43.0%
Epoch Capabilities Index159.1156.6
LMArena Text14771480
LMArena Hard Prompts14981502
LMArena Coding15091520
LMArena WebDev14581685
LMArena Vision12961313
LMArena Agent33.9
LiveBench78.5%
LiveBench Reasoning88.2%
LiveBench Coding72.9%
LiveBench Agentic Coding64.7%
LiveBench Mathematics91.3%
LiveBench Data Analysis78.4%
LiveBench Language79.7%
AA Intelligence Index38.640.3
IFBench75.8%
AA-LCR84.3%78.3%
MMMU-Pro79.9%82.3%
AA-Omniscience20.53.4
Terminal-Bench Hard60.6%
GPQA Diamond (AA)93.5%92.7%
Humanity's Last Exam (AA)45.8%43.0%
SciCode (AA)55.8%53.2%
τ²-Bench Telecom (AA)93.9%
LiveCodeBench87.8%
MMLU-Pro88.6%
IOI73.0%
LegalBench83.6%
CorpFin65.8%
TaxEval75.5%
Terminal-Bench 2.1 (Vals)67.4%
SWE-bench (Vals)85.6%
GPQA Diamond (Vals)93.7%
Vals Index51.8
HiL-Bench39.7%
EQ-Bench 41315
Kagi LLM Benchmark88.8%

Data as of 2026-09-09. Best configuration of each model; every score links to its source on the model pages.