BenchLeader

GPT-5.5 vs Qwen3.8 27B

Full profiles: GPT-5.5 (OpenAI) and Qwen3.8 27B (Alibaba): every benchmark, price and rank.

Updated · Data from 13 sources

As of 16 Nov 2026, GPT-5.5 is ahead of Qwen3.8 27B on quality (64.1 vs 55.1 on the BenchLeader Index), but Qwen3.8 27B is 10× cheaper at $1.09 vs $11.25 per 1M tokens blended. GPT-5.5 leads in every category we measure both in.

Key facts (as of 16 Nov 2026)

  • GPT-5.5 scores 64.1 on the BenchLeader Index and Qwen3.8 27B scores 55.1 (BenchLeader, 16 Nov 2026).
  • GPT-5.5 costs $11.25 per 1M tokens blended (list price, 16 Nov 2026).
  • Qwen3.8 27B costs $1.09 per 1M tokens blended (list price, 16 Nov 2026).
  • Of the 12 benchmarks both models have, GPT-5.5 leads 9 (BenchLeader, 16 Nov 2026).
  • On Arena WebDev, GPT-5.5 is rated 1512 and Qwen3.8 27B 1590 (LMArena, as published by 16 Nov 2026).

Which to pick for…

The pick's numbers come first. Category scores on the BenchLeader scale (50 is the average model, 15 points one standard deviation). High confidence means a lead of half a standard deviation or more; under one point is called either.

Use casePickWhyConfidence
CodingEither61 vs 62 category score; Arena WebDev 1512 vs 1590Either
Agents & tool useGPT-5.562 vs 44 category score; LiveBench Agentic Coding 54.0% vs 61.4%High
MathsGPT-5.569 vs 55 category score; ProofBench 50.0% vs 16.0%High
ReasoningGPT-5.568 vs 58 category score; LiveBench 1.0 Reasoning 89.7% vs 80.0%High
Images and other mediaGPT-5.562 vs 61 category scoreMedium
Chat quality (human preference)–Only Qwen3.8 27B has an Arena rating (61 category score)Not comparable
Lowest costQwen3.8 27B$1.06 vs $11.25 per 1M blended; agentic coding session $0.037 vs $0.420–
Fastest first answerQwen3.8 27B0.7 s (Qwen3.8 27B) vs 38.3 s (GPT-5.5 (xhigh)) to the first answer token–
High volume on a budgetNeither flagshipA smaller model is usually the better fit: Cheapest good LLMs, Fastest LLMs–

Key differences

  • GPT-5.5 (xhigh) leads on quality: 64.1 vs 55.1.
  • GPT-5.5 (xhigh) is stronger in agents & tools, maths, multimodal, reasoning.
  • Qwen3.8 27B is stronger in coding.
  • Qwen3.8 27B is 10× cheaper ($1.09 vs $11.25 per 1M blended).

At a glance

SpecGPT-5.5Qwen3.8 27B
DeveloperOpenAIAlibaba
Released23 Apr 202614 Aug 2026
Context window (tokens)1,050,000262,144
Compared atGPT-5.5 (xhigh)Qwen3.8 27B
Open weightsNoYes
Price in / out / cached input per 1M$5.00 / $30.00 / $0.500$0.420 / $3.00 / $0.085

Category by category

Category scores on the BenchLeader scale: 50 is the average evaluated model, 15 points is one standard deviation. A gap under one point is called level.

CategoryGPT-5.5 (xhigh)Qwen3.8 27BLeader
Reasoning68.157.6GPT-5.5
Coding60.761.6level
Agents & tools61.844.2GPT-5.5
Maths69.354.6GPT-5.5
Knowledge63.6–not comparable
Instruction following74.0–not comparable
Human preference–61.3not comparable
Multimodal62.360.7GPT-5.5
Long context66.9–not comparable

On one chart

Each domain on the index's own scale, where 50 is an average model. Click a domain to see the benchmarks behind it. Pick up to 5 models from the list.

2550 avg75ReasoningCodingAgents & toolsMathsMultimodalGPT-5.5, Reasoning: 68.1GPT-5.5, Coding: 60.7GPT-5.5, Agents & tools: 61.8GPT-5.5, Maths: 69.3GPT-5.5, Multimodal: 62.3Qwen3.8 27B, Reasoning: 57.6Qwen3.8 27B, Coding: 61.6Qwen3.8 27B, Agents & tools: 44.2Qwen3.8 27B, Maths: 54.6Qwen3.8 27B, Multimodal: 60.7

Not drawn, measured for fewer than two of these models: Knowledge, Instruction following, Long context, Human preference.

Model, click to add or removeIndex

Where sources disagree

Across the 12 benchmarks both have, GPT-5.5 leads 9, Qwen3.8 27B leads 3. Every overall index that rates both puts GPT-5.5 ahead.

Overall indexGPT-5.5 (xhigh)Qwen3.8 27BLeader
BenchLeader Index64.155.1GPT-5.5
Arena Text1481†1434GPT-5.5

Each publisher runs its own tasks, harnesses and effort settings, so their overall verdicts can differ; BenchLeader reconciles them on one scale. † measured at another effort setting of the same model (the publisher did not test the one compared here).

Price, speed and latency

List prices blended at three input tokens per output token. Per-task prices use the token counts on the methodology page. Cost, tokens and time per benchmark task are measured: Artificial Analysis’ averages over its whole Intelligence Index run.

MeasureGPT-5.5 (xhigh)Qwen3.8 27B
Blended price per 1M tokens$11.25$1.06
Input / output per 1M$5.00 / $30.00$0.420 / $3.00
Cached input per 1M$0.500$0.085
Price per task: chat reply$0.011$0.0011
Price per task: summarize a 30-page report$0.078$0.0068
Price per task: code edit$0.075$0.0070
Price per task: agentic coding session$0.420$0.037
Price per task: structured extraction$0.016$0.0014
Agentic coding session, input mostly cached$0.217$0.022
Output speed81 tok/s73 tok/s
Time to first answer38.3 s0.7 s
Time to a complete answer, last measured 13 Nov 2026104.3 s–

Each model is compared at its best-ranked reasoning-effort setting. GPT-5.5 (xhigh) scores 64.1 and takes 38 s to its first answer token; GPT-5.5 (high) scores 63.5 in 16 s, GPT-5.5 scores 61.0 in 3 s. Qwen3.8 27B scores 55.1 and takes 1 s to its first answer token; Qwen3.8 27B (xhigh) scores 52.2 in 109 s, Qwen3.8 27B (medium) scores 50.2 in 24 s. Higher effort means more thinking before the answer: better scores, longer waits and more tokens billed. How reasoning effort changes scores and cost.

Every benchmark

161 benchmarks, grouped by category; each name links to the board and its leaders. † measured at another effort setting of the same model, shown for reference and not counted as a win.

MetricPublisherGPT-5.5 (xhigh)Qwen3.8 27B
BenchLeader IndexBenchLeader64.155.1
Agents & tools scoreBenchLeader61.844.2
Coding scoreBenchLeader60.761.6
Instruction following scoreBenchLeader74.0–
Knowledge scoreBenchLeader63.6–
Long context scoreBenchLeader66.9–
Maths scoreBenchLeader69.354.6
Multimodal scoreBenchLeader62.360.7
Reasoning scoreBenchLeader68.157.6
Human preference scoreBenchLeader–61.3
Blended price $/MBenchLeader$11.25$1.06
Output speedBenchLeader81 tok/s73 tok/s
Time to first answerBenchLeader38.3 s0.7 s
Context windowBenchLeader1,050,000 tokens262,144 tokens
Reasoning
GPQA DiamondEpoch AI Benchmarking Hub90.7%†–
SimpleBenchSimpleBench69.0%†60.2%
Arena Hard PromptsArena (LMArena)1499†1459
LiveBench 2.0 ReasoningLiveBench–80.0%†
LiveBench 1.0 ReasoningLiveBench89.7%80.0%
GPQA Diamond (AA)Artificial Analysis93.5%90.5%†
Humanity's Last Exam (AA)Artificial Analysis45.8%33.9%†
HLE-Diamond (AA)Artificial Analysis–15.3%†
GPQA Diamond (Vals)Vals AI93.2%88.9%†
Kagi LLM BenchmarkKagi LLM Benchmark88.8%†–
ARC-AGI-1ARC Prize95.0%87.5%†
ARC-AGI-2ARC Prize85.0%42.4%†
ARC-AGI-3ARC Prize0.4%†–
CritPtArtificial Analysis27.1%5.4%†
CritPt v2 hard subset (AA)Artificial Analysis–4.0%†
Arena ExpertArena (LMArena)1510†1473
Chess PuzzlesEpoch AI Benchmarking Hub63.0%–
Mystery Game PuzzlesEpoch AI Benchmarking Hub56.0%–
CL-bench LifeEpoch AI Benchmarking Hub22.2%†–
LMCAEpoch AI Benchmarking Hub54.3%41.4%
DTBenchEpoch AI Benchmarking Hub96.0%88.0%
ForecastBenchForecastBench64.2%†–
BTF-3Epoch AI Benchmarking Hub14.3%†–
Coding
SciCodeSciCode55.8%46.6%†
WeirdMLWeirdML84.9%–
Show all 161 benchmarks
MetricPublisherGPT-5.5 (xhigh)Qwen3.8 27B
Coding
FrontierCodeCognition43.0%†–
GSO-BenchGSO-Bench40.2%–
Arena CodingArena (LMArena)1510†1496
Arena WebDevArena (LMArena)15121590
LiveBench 2.0 CodingLiveBench–69.3%†
LiveBench 1.0 CodingLiveBench82.2%75.7%
LiveCodeBenchVals AI85.3%84.0%†
IOIVals AI–39.1%†
SWE-bench (Vals)Vals AI82.6%86.0%†
Code MigrationVals AI45.2%14.2%†
ProgramBenchVals AI0.5%0.0%†
Vibe Code Bench v1.1Vals AI69.8%64.8%†
SWE Atlas v1.0: Codebase QnAScale AI SEAL45.4%–
SWE Atlas v1.0: RefactoringScale AI SEAL44.8%–
SWE Atlas v1.0: Test WritingScale AI SEAL42.6%–
MirrorCodeEpoch AI Benchmarking Hub23.3%–
Surface Evolver BenchEpoch AI Benchmarking Hub88.1%†45.0%†
DeepSWE v1.1Epoch AI Benchmarking Hub67.0%–
ALE-BenchEpoch AI Benchmarking Hub1943.0–
Terminal-Bench 4.0 (AA)Artificial Analysis14.7%5.6%†
Terminal-Bench 2.1 (AA)Artificial Analysis84.3%79.8%†
GameBench 2 OverallDuelLab GameBench 249.2†–
GameBench 2 by reasoning settingDuelLab GameBench 259.943.8†
Design Arena WebsiteDesign Arena1248†–
FrontierCode 1.1 (AA)Artificial Analysis–34.2%†
FrontierCode 2.0 (AA)Artificial Analysis–14.9%†
Agents & tools
Terminal-BenchTerminal-Bench84.7%†–
OSWorld-Verified 2.0OSWorld13.0%–
Remote Labor IndexScale AI / CAIS6.3%†–
APEX-AgentsMercor55.1%†47.5%
Arena AgentArena (LMArena)–-4.8
LiveBench Long AgenticLiveBench–15.9%†
LiveBench BrowserLiveBench–24.2%†
LiveBench Agentic CodingLiveBench54.0%61.4%
Terminal-Bench HardArtificial Analysis60.6%–
τ²-Bench Telecom (AA)Artificial Analysis93.9%–
Terminal-Bench 2.1 (Vals)Vals AI57.3%†58.4%†
MCP AtlasScale AI SEAL75.3%–
HiL-BenchScale AI SEAL39.7%†–
τ³-bench Bankingτ²-bench44.6%–
GDPval-AA v2.1, normalised scoreArtificial Analysis–46.0%†
GDPval-AA v2.1Artificial Analysis13571426†
τ³-Banking (AA)Artificial Analysis39.0%48.0%†
ITBench SRE (AA)Artificial Analysis45.8%–
Analyst Agent (AA)Artificial Analysis50.0%–
APEX-Agents (AA)Artificial Analysis37.7%–
CyberBenchVals AI–67.8%†
Finance Agent v2Vals AI51.8%48.5%†
Harvey's Legal Agent Benchmark v1Vals AI3.8%11.3%†
Legal Research BenchVals AI40.4%36.1%†
SkillsBenchVals AI62.2%38.1%†
SREBenchVals AI3.8%–
Tax Agent BenchVals AI21.8%30.9%†
Terminal-Bench 2.0 (Vals)Vals AI73.2%†–
Terminal-Bench ScienceVals AI–0.0%†
Time Horizon Index: KSPVals AI8.3%–
Arena SearchArena (LMArena)1226†–
Arena Agent Task CompletionArena (LMArena)–-2.7
DeepResearch BenchDeepResearch Bench54.0%†–
PostTrainBenchEpoch AI Benchmarking Hub23.9%–
ExploitBenchEpoch AI Benchmarking Hub47.4%†–
GBAEvalEpoch AI Benchmarking Hub53.2%†–
Vending-Bench 2Andon Labs7523.8†–
AutomationBenchArtificial Analysis47.3%48.2%†
GDP.pdf (AA)Artificial Analysis21.2%16.4%†
EnterpriseOps-GymArtificial Analysis46.6%44.2%†
AA-Briefcase v1.1Artificial Analysis11351391†
Design Arena AgenticDesign Arena1113†–
RoboDojo (LLM as robot policy)RoboDojo1.1†–
Terminal-Bench-Science 0.1 (AA)Artificial Analysis–0.5%†
CWE-Bench (AA)Artificial Analysis–26.7%†
DeepSec-Bench (AA)Artificial Analysis–11.5%†
CyberGym end-to-end (AA)Artificial Analysis–0.0%†
Maths
FrontierMath Tiers 1–3Epoch AI Benchmarking Hub85.3%–
FrontierMath Tier 4Epoch AI Benchmarking Hub72.5%–
OTIS Mock AIMEEpoch AI Benchmarking Hub84.4%†–
ProofBenchVals AI50.0%16.0%
LiveBench MathematicsLiveBench95.9%86.2%
AIME 2026MathArena100.0%–
HMMT February 2026MathArena98.5%–
USAMO 2026MathArena98.2%–
MathArena ApexMathArena80.2%–
Arena MathsArena (LMArena)1500†1451
FrontierMath ErdősEpoch AI Benchmarking Hub0.0%–
Knowledge
SimpleQA VerifiedEpoch AI Benchmarking Hub63.0%–
LiveBench 2.0 Data AnalysisLiveBench–76.6%†
LiveBench ResearchLiveBench–61.3%†
LiveBench 1.0 Data AnalysisLiveBench81.6%76.6%
AA-Omniscience v1.1Artificial Analysis–-6.4†
MMLU-ProVals AI88.1%84.3%†
LegalBenchVals AI86.5%82.4%†
CorpFinVals AI68.4%–
TaxEvalVals AI75.0%70.8%†
CaseLaw v2Vals AI66.2%–
Excel Modeling BenchmarkVals AI64.5%59.7%†
MedCodeVals AI49.1%28.7%†
MedScribeVals AI86.9%83.8%†
Public Benefits Bench v1.1Vals AI60.9%–
DrugDiscoveryBenchScale AI SEAL51.6%–
EBR-benchEpoch AI Benchmarking Hub34.3%–
GDP.pdfEpoch AI Benchmarking Hub26.0%–
AA-Omniscience v1.1: accuracyArtificial Analysis–17.3%†
AA-Omniscience v1.1: non-hallucinationArtificial Analysis–71.4%†
Instruction following
LiveBench LanguageLiveBench87.4%74.3%
LiveBench Instruction FollowingLiveBench70.7%72.7%
IFBenchArtificial Analysis75.8%–
Arena Instruction FollowingArena (LMArena)1475†1419
Human preference
Arena TextArena (LMArena)1476†1434
EQ-Bench 4EQ-Bench1295†–
EQ-Bench Creative Writing v3EQ-Bench1845†1671
Arena Creative WritingArena (LMArena)1448†1359
Arena Multi-turnArena (LMArena)1484†1436
Arena Longer QueriesArena (LMArena)1486†1443
Multimodal
Arena VisionArena (LMArena)1296†1270
LiveBench DesignLiveBench–72.4%†
MMMU-ProArtificial Analysis79.9%76.3%†
MMMU-Pro (Vals)Vals AI88.3%83.9%†
MortgageTaxVals AI68.8%64.9%†
GeoBenchGeoBench–38.0%
Blueprint-Bench 2Epoch AI Benchmarking Hub36.2%†–
Furniture AssemblyEpoch AI Benchmarking Hub44.2%–
Code2Video-AAArtificial Analysis1000949†
Long context
AA-LCR v1.1Artificial Analysis84.3%82.0%†
Arena DocumentArena (LMArena)1479†–
MLCRArtificial Analysis28.9%22.8%†
Composite
Epoch Capabilities IndexEpoch AI Benchmarking Hub160.1†152.6
LiveBench 2.0LiveBench–54.0%†
LiveBench 1.0LiveBench80.2%75.3%
AA Intelligence Index v5.0.1Artificial Analysis–20.1†
AA Intelligence Index v4.3.2Artificial Analysis38.433.7†
AA Progress Index v1Artificial Analysis320303.1†
Vals RSI IndexVals AI16.5%–
Vals Multimodal IndexVals AI68.1%–
AA Cyber IndexArtificial Analysis–12.7†
Safety & honesty
FORTRESSScale AI SEAL16.3%–
Metadata
AA Openness IndexArtificial Analysis–38.9†

Data as of 2026-11-16. Best configuration of each model; every score links to its source on the model pages.

DuelLab GameBench 2, release gb2-20261111-7b598bb13de4 (https://benchmarks.duellab.org/releases/gb2-20261111-7b598bb13de4/), CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Scores mapped to BenchLeader model names; not endorsed by DuelLab.

What changed

  • Qwen3.8 27B: BenchLeader Index 53.2 → 55.1.
  • Qwen3.8 27B: Qwen3.8 27B cached input price moved from $0.10/M to $0.085/M (15% down).
  • GPT-5.5 (xhigh): 1 new result (GDPval-AA v2.1).
  • Qwen3.8 27B: Qwen3.8 27B input price moved from $0.45/M to $0.42/M (7% down).
  • GPT-5.5 (xhigh): BenchLeader Index 64.6 → 64.1.
  • GPT-5.5 (xhigh): 1 score revision.
  • Qwen3.8 27B: BenchLeader Index 54.0 → 53.2.
  • GPT-5.5 (xhigh): 1 new result (MirrorCode).
  • Qwen3.8 27B: 2 new results (SimpleBench, GeoBench).
  • Qwen3.8 27B: 5 score revisions.

Rankings: Best LLM overall · Best LLM for agents · Best cheap LLMs

GPT-5.5 vs Qwen3.8 27B: questions

Is GPT-5.5 better than Qwen3.8 27B?
GPT-5.5 (xhigh) leads on quality: 64.1 vs 55.1. The BenchLeader Index combines every independent quality benchmark; GPT-5.5 (xhigh) is ahead overall as of 16 Nov 2026, but check the category scores for your use.
GPT-5.5 vs Qwen3.8 27B: which is cheaper, and will that change?
Qwen3.8 27B is cheaper today: $1.09 against $11.25 per million tokens, blended at three input tokens per output token. No price change has been announced for either.
Is GPT-5.5 or Qwen3.8 27B better for coding?
They are level in coding (61 vs 62 on the category index). On Arena WebDev, the top shared coding benchmark, it is 1512 for GPT-5.5 against 1590 for Qwen3.8 27B.
Which is faster, GPT-5.5 or Qwen3.8 27B?
GPT-5.5 streams faster (81 vs 73 output tokens per second, Artificial Analysis 7-day median).
Is GPT-5.5 or Qwen3.8 27B better for agents and tool use?
GPT-5.5 scores higher in agentic tasks (62 vs 44 on the category index, where 50 is average).
More questions (4)
Which is better for long documents?
GPT-5.5 accepts more context: 1,050,000 against 262,144 tokens for Qwen3.8 27B.
Which has lower latency?
Qwen3.8 27B answers first: 0.7 s against 38.3 s to the first answer token, as Artificial Analysis measures it. Reasoning effort drives most of this: a higher setting thinks longer before it answers.
Do independent benchmarks agree on GPT-5.5 vs Qwen3.8 27B?
Across the 12 benchmarks both have, GPT-5.5 leads 9, Qwen3.8 27B leads 3. Every overall index that rates both puts GPT-5.5 ahead.
When was Qwen3.8 27B released?
Qwen3.8 27B was released on 14 Aug 2026.