BenchLeader

GPT-5.5 vs Qwen3.8 27B

Verdict
  • GPT-5.5 (xhigh) leads on quality: 67.6 vs 59.2.
  • GPT-5.5 (xhigh) is stronger in coding, composite, instruction following, knowledge, long context, maths, multimodal, reasoning.
  • Qwen3.8 27B (xhigh) is stronger in agents & tools.
  • Qwen3.8 27B (xhigh) is 12× cheaper ($0.938 vs $11.25 per 1M blended).
  • GPT-5.5 (xhigh) streams 1.9× faster (79 vs 42 tokens per second).
MetricGPT-5.5 (xhigh)Qwen3.8 27B (xhigh)
BenchLeader Index67.659.2
Agents & tools score62.367.3
Coding score64.653.2
Composite score72.572.0
Instruction following score73.8
Knowledge score66.456.4
Long context score68.767.5
Maths score71.2
Multimodal score64.460.7
Reasoning score79.952.5
Blended price $/M$11.25$0.938
Output speed79 tok/s42 tok/s
Time to first answer52.2 s51.0 s
Context window1.1M262k
FrontierMath Tiers 1–385.3%
FrontierMath Tier 472.5%
SimpleQA Verified63.0%
OSWorld-Verified 2.013.0%
SciCode56.1%44.7%
WeirdML84.9%
APEX-Agents38.5%
ProofBench50.0%
GSO-Bench40.2%
LMArena WebDev1510
LMArena Agent5
LiveBench80.2%
LiveBench Reasoning89.7%
LiveBench Coding82.2%
LiveBench Agentic Coding54.0%
LiveBench Mathematics95.9%
LiveBench Data Analysis81.6%
LiveBench Language87.4%
LiveBench Instruction Following70.7%
AA Intelligence Index38.633.9
IFBench75.8%
AA-LCR84.3%82.0%
MMMU-Pro79.9%76.3%
AA-Omniscience20.5-10.0
Terminal-Bench Hard60.6%
GPQA Diamond (AA)93.5%90.5%
Humanity's Last Exam (AA)45.8%33.9%
SciCode (AA)55.8%46.6%
τ²-Bench Telecom (AA)93.9%
LiveCodeBench85.3%84.0%
MMLU-Pro88.1%84.3%
IOI39.1%
LegalBench86.5%82.4%
CorpFin68.4%
TaxEval75.0%70.8%
Terminal-Bench 2.1 (Vals)58.4%
SWE-bench (Vals)82.6%86.0%
GPQA Diamond (Vals)93.2%88.9%
Vals Index57.448.5
AIME 2026100.0%
HMMT February 202698.5%
MathArena Apex80.2%
MCP Atlas75.3%
ARC-AGI-195.0%
ARC-AGI-285.0%
CritPt27.1%5.4%
GDPval (AA)44.8%48.2%
τ²-Bench Banking (AA)39.0%48.0%
ITBench SRE (AA)45.8%
Analyst Agent (AA)50.0%
APEX-Agents (AA)37.7%
CaseLaw v266.2%
Code Migration45.2%14.2%
Excel Modeling Benchmark64.5%59.7%
Finance Agent v251.8%48.5%
Harvey's Legal Agent Benchmark3.8%11.3%
Legal Research Bench40.4%36.1%
MedCode49.1%28.7%
MedScribe86.9%83.8%
MMMU-Pro (Vals)88.3%83.9%
MortgageTax68.8%64.9%
ProgramBench0.5%0.0%
Public Benefits Bench60.9%
SAGE51.5%52.4%
SkillsBench62.2%38.1%
SREBench3.8%
Tax Agent Bench60.5%
Terminal-Bench 4.0 (Vals)4.0%
Terminal-Bench Science1.4%
Time Horizon Index: KSP8.3%
Vals Multimodal Index68.1%
Vibe Code Bench v1.169.8%64.8%
DrugDiscoveryBench51.6%
FORTRESS16.3%
SWE Atlas: Codebase QnA45.4%
SWE Atlas: Refactoring44.8%
SWE Atlas: Test Writing42.6%
EBR-bench34.3%
Mystery Game Puzzles56.0%
PostTrainBench27.2%
Surface Evolver Bench45.0%
DeepSWE67.0%
LMCA54.3%
DTBench96.0%
CursorBench58.4%
ALE-Bench1943.0
GDP.pdf26.0%

Data as of 2026-09-19. Best configuration of each model; every score links to its source on the model pages.

GPT-5.5 vs Qwen3.8 27B: questions

Is GPT-5.5 better than Qwen3.8 27B?
GPT-5.5 (xhigh) leads on quality: 67.6 vs 59.2. The BenchLeader Index combines every independent quality benchmark; GPT-5.5 (xhigh) is ahead overall as of 2026-09-19, but check the category scores for your use.
Is GPT-5.5 better than Qwen3.8 27B for coding?
GPT-5.5 scores higher in coding (65 vs 53 on the category index, where 50 is average).
Is GPT-5.5 better than Qwen3.8 27B for agentic tasks?
Qwen3.8 27B scores higher in agentic tasks (67 vs 62 on the category index, where 50 is average).
Which is cheaper, GPT-5.5 or Qwen3.8 27B?
Qwen3.8 27B is cheaper: $0.938 against $11.25 per million tokens, blended at three input tokens per output token.
Which is faster, GPT-5.5 or Qwen3.8 27B?
GPT-5.5 streams faster: 79 against 42 output tokens per second.
Which has the larger context window?
GPT-5.5 accepts more context: 1.1M against 262k tokens.