BenchLeader

GPT-5.5 Instant vs Qwen3 8

Verdict
  • Qwen3 8 (max) leads on quality: 63.6 vs 60.5.
  • GPT-5.5 Instant is stronger in agents & tools, instruction following, knowledge.
  • Qwen3 8 (max) is stronger in coding, composite, human preference, long context, maths, multimodal, reasoning.
  • Qwen3 8 (max) is 4.2× cheaper ($2.67 vs $11.25 per 1M blended).
  • GPT-5.5 Instant streams 3.4× faster (129 vs 38 tokens per second).
MetricGPT-5.5 InstantQwen3 8 (max)
BenchLeader Index60.563.6
Agents & tools score70.756.0
Coding score61.169.7
Composite score62.970.9
Human preference score67.568.3
Instruction following score69.8
Knowledge score69.462.3
Long context score61.465.7
Maths score42.562.4
Multimodal score59.767.2
Reasoning score62.668.1
Blended price $/M$11.25$2.67
Output speed129 tok/s38 tok/s
Time to first answer16.8 s55.3 s
Context window400k1M
GPQA Diamond82.5%
FrontierMath Tiers 1–326.3%
FrontierMath Tier 42.4%
OTIS Mock AIME68.1%
SciCode48.6%52.9%
ProofBench58.0%
Epoch Capabilities Index142.5156.6
LMArena Text14741480
LMArena Hard Prompts14911502
LMArena Coding15141520
LMArena WebDev1670
LMArena Vision12511313
LMArena Agent3.9
LiveBench78.5%
LiveBench Reasoning88.2%
LiveBench Coding72.9%
LiveBench Agentic Coding64.7%
LiveBench Mathematics91.3%
LiveBench Data Analysis78.4%
LiveBench Language79.7%
AA Intelligence Index26.840.3
IFBench71.5%
AA-LCR70.0%78.3%
MMMU-Pro82.3%
AA-Omniscience11.23.4
Terminal-Bench Hard42.4%
GPQA Diamond (AA)84.7%92.7%
Humanity's Last Exam (AA)21.6%43.0%
SciCode (AA)52.5%53.2%
τ²-Bench Telecom (AA)49.4%
LiveCodeBench87.8%
MMLU-Pro88.6%
IOI73.0%
LegalBench83.6%
CorpFin65.8%
TaxEval75.5%
Terminal-Bench 2.1 (Vals)67.4%
SWE-bench (Vals)85.6%
GPQA Diamond (Vals)93.7%
Vals Index51.8

Data as of 2026-09-10. Best configuration of each model; every score links to its source on the model pages.

GPT-5.5 Instant vs Qwen3 8: questions

Is GPT-5.5 Instant better than Qwen3 8?
Qwen3 8 (max) leads on quality: 63.6 vs 60.5. The BenchLeader Index combines every independent quality benchmark; Qwen3 8 (max) is ahead overall as of 2026-09-10, but check the category scores for your use.
Is GPT-5.5 Instant better than Qwen3 8 for coding?
Qwen3 8 scores higher in coding (70 vs 61 on the category index, where 50 is average).
Is GPT-5.5 Instant better than Qwen3 8 for agentic tasks?
GPT-5.5 Instant scores higher in agentic tasks (71 vs 56 on the category index, where 50 is average).
Which is cheaper, GPT-5.5 Instant or Qwen3 8?
Qwen3 8 is cheaper: $2.67 against $11.25 per million tokens, blended at three input tokens per output token.
Which is faster, GPT-5.5 Instant or Qwen3 8?
GPT-5.5 Instant streams faster: 129 against 38 output tokens per second.
Which has the larger context window?
Qwen3 8 accepts more context: 1M against 400k tokens.