BenchLeader

Claude Opus 5 vs Qwen3.8 27B

Full profiles: Claude Opus 5 (Anthropic) and Qwen3.8 27B (Alibaba): every benchmark, price and rank.

Updated · Data from 13 sources

As of 16 Nov 2026, Claude Opus 5 is ahead of Qwen3.8 27B on quality (65.0 vs 55.1 on the BenchLeader Index), but Qwen3.8 27B is 9.2× cheaper at $1.09 vs $10.00 per 1M tokens blended. Claude Opus 5 leads in every category we measure both in.

Key facts (as of 16 Nov 2026)

  • Claude Opus 5 scores 65.0 on the BenchLeader Index and Qwen3.8 27B scores 55.1 (BenchLeader, 16 Nov 2026).
  • Claude Opus 5 costs $10.00 per 1M tokens blended (list price, 16 Nov 2026).
  • Qwen3.8 27B costs $1.09 per 1M tokens blended (list price, 16 Nov 2026).
  • Of the 23 benchmarks both models have, Claude Opus 5 leads 21 (BenchLeader, 16 Nov 2026).
  • On Arena WebDev, Claude Opus 5 is rated 1691 and Qwen3.8 27B 1590 (LMArena, as published by 16 Nov 2026).

Which to pick for…

The pick's numbers come first. Category scores on the BenchLeader scale (50 is the average model, 15 points one standard deviation). High confidence means a lead of half a standard deviation or more; under one point is called either.

Use casePickWhyConfidence
CodingClaude Opus 567 vs 62 category score; Arena WebDev 1691 vs 1590Medium
Agents & tool useClaude Opus 564 vs 44 category score; APEX-Agents 65.8% vs 47.5%High
MathsClaude Opus 570 vs 55 category score; Arena Maths 1515 vs 1451High
ReasoningClaude Opus 566 vs 58 category score; Arena Hard Prompts 1513 vs 1459High
Images and other mediaClaude Opus 567 vs 61 category scoreMedium
Chat quality (human preference)Claude Opus 568 vs 61 on Arena votesMedium
Lowest costQwen3.8 27B$1.06 vs $10.00 per 1M blended; agentic coding session $0.037 vs $0.400–
Fastest first answerQwen3.8 27B0.7 s (Qwen3.8 27B) vs 48.5 s (Claude Opus 5 (max)) to the first answer token–
High volume on a budgetNeither flagshipA smaller model is usually the better fit: Cheapest good LLMs, Fastest LLMs–

Key differences

  • Claude Opus 5 (max) leads on quality: 65.0 vs 55.1.
  • Claude Opus 5 (max) is stronger in agents & tools, coding, human preference, maths, multimodal, reasoning.
  • Qwen3.8 27B is 9.2× cheaper ($1.09 vs $10.00 per 1M blended).

At a glance

SpecClaude Opus 5Qwen3.8 27B
DeveloperAnthropicAlibaba
Released24 Jul 202614 Aug 2026
Context window (tokens)1,000,000262,144
Compared atClaude Opus 5 (max)Qwen3.8 27B
Open weightsNoYes
Price in / out / cached input per 1M$5.00 / $25.00 / $0.500$0.420 / $3.00 / $0.085

Category by category

Category scores on the BenchLeader scale: 50 is the average evaluated model, 15 points is one standard deviation. A gap under one point is called level.

CategoryClaude Opus 5 (max)Qwen3.8 27BLeader
Reasoning66.157.6Claude Opus 5
Coding67.061.6Claude Opus 5
Agents & tools63.844.2Claude Opus 5
Maths69.854.6Claude Opus 5
Knowledge65.2–not comparable
Human preference68.161.3Claude Opus 5
Multimodal67.260.7Claude Opus 5
Long context64.3–not comparable

On one chart

Each domain on the index's own scale, where 50 is an average model. Click a domain to see the benchmarks behind it. Pick up to 5 models from the list.

2550 avg75ReasoningCodingAgents & toolsMathsMultimodalHumanpreferenceClaude Opus 5, Reasoning: 66.1Claude Opus 5, Coding: 67.0Claude Opus 5, Agents & tools: 63.8Claude Opus 5, Maths: 69.8Claude Opus 5, Multimodal: 67.2Claude Opus 5, Human preference: 68.1Qwen3.8 27B, Reasoning: 57.6Qwen3.8 27B, Coding: 61.6Qwen3.8 27B, Agents & tools: 44.2Qwen3.8 27B, Maths: 54.6Qwen3.8 27B, Multimodal: 60.7Qwen3.8 27B, Human preference: 61.3

Not drawn, measured for fewer than two of these models: Knowledge, Instruction following, Long context.

Model, click to add or removeIndex

Where sources disagree

Across the 23 benchmarks both have, Claude Opus 5 leads 21, Qwen3.8 27B leads 2. Every overall index that rates both puts Claude Opus 5 ahead.

Overall indexClaude Opus 5 (max)Qwen3.8 27BLeader
BenchLeader Index65.055.1Claude Opus 5
AA Intelligence Index v5.0.144.210.0†Claude Opus 5
Arena Text14891434Claude Opus 5

Each publisher runs its own tasks, harnesses and effort settings, so their overall verdicts can differ; BenchLeader reconciles them on one scale. † measured at another effort setting of the same model (the publisher did not test the one compared here).

Price, speed and latency

List prices blended at three input tokens per output token. Per-task prices use the token counts on the methodology page. Cost, tokens and time per benchmark task are measured: Artificial Analysis’ averages over its whole Intelligence Index run.

MeasureClaude Opus 5 (max)Qwen3.8 27B
Blended price per 1M tokens$10.00$1.06
Input / output per 1M$5.00 / $25.00$0.420 / $3.00
Cached input per 1M$0.500$0.085
Price per task: chat reply$0.0095$0.0011
Price per task: summarize a 30-page report$0.075$0.0068
Price per task: code edit$0.068$0.0070
Price per task: agentic coding session$0.400$0.037
Price per task: structured extraction$0.015$0.0014
Agentic coding session, input mostly cached$0.198$0.022
Cost per benchmark task (AA Index)$11.82–
Output tokens per task (AA Index)118k–
Of which reasoning73k–
Time per task (AA Index)25 min–
Output speed80 tok/s73 tok/s
Time to first answer48.5 s0.7 s
Time to a complete answer, last measured 13 Nov 2026191.6 s–

Each model is compared at its best-ranked reasoning-effort setting. Claude Opus 5 (max) scores 65.0 and takes 49 s to its first answer token; Claude Opus 5 (high) scores 64.4 in 17 s, Claude Opus 5 scores 63.2 in 2 s. Qwen3.8 27B scores 55.1 and takes 1 s to its first answer token; Qwen3.8 27B (xhigh) scores 52.2 in 109 s, Qwen3.8 27B (medium) scores 50.2 in 24 s. Higher effort means more thinking before the answer: better scores, longer waits and more tokens billed. How reasoning effort changes scores and cost.

Every benchmark

159 benchmarks, grouped by category; each name links to the board and its leaders. † measured at another effort setting of the same model, shown for reference and not counted as a win.

MetricPublisherClaude Opus 5 (max)Qwen3.8 27B
BenchLeader IndexBenchLeader65.055.1
Agents & tools scoreBenchLeader63.844.2
Coding scoreBenchLeader67.061.6
Human preference scoreBenchLeader68.161.3
Knowledge scoreBenchLeader65.2–
Long context scoreBenchLeader64.3–
Maths scoreBenchLeader69.854.6
Multimodal scoreBenchLeader67.260.7
Reasoning scoreBenchLeader66.157.6
Blended price $/MBenchLeader$10.00$1.06
Output speedBenchLeader80 tok/s73 tok/s
Time to first answerBenchLeader48.5 s0.7 s
Context windowBenchLeader1,000,000 tokens262,144 tokens
Reasoning
GPQA DiamondEpoch AI Benchmarking Hub93.9%–
SimpleBenchSimpleBench80.6%†60.2%
Arena Hard PromptsArena (LMArena)15131459
LiveBench 2.0 ReasoningLiveBench–80.0%†
LiveBench 1.0 ReasoningLiveBench91.2%80.0%
GPQA Diamond (AA)Artificial Analysis93.2%90.5%†
Humanity's Last Exam (AA)Artificial Analysis54.9%33.9%†
HLE-Diamond (AA)Artificial Analysis44.8%15.3%†
GPQA Diamond (Vals)Vals AI93.4%†88.9%†
ARC-AGI-1ARC Prize97.5%87.5%†
ARC-AGI-2ARC Prize90.4%42.4%†
ARC-AGI-3ARC Prize30.2%†–
CritPtArtificial Analysis29.1%5.4%†
CritPt v2 hard subset (AA)Artificial Analysis50.0%4.0%†
MysteryMechanismVals AI37.4%–
HLE-Diamond (Scale)Scale AI SEAL38.6%†–
Arena ExpertArena (LMArena)15301473
Chess PuzzlesEpoch AI Benchmarking Hub43.0%–
Mystery Game PuzzlesEpoch AI Benchmarking Hub59.0%–
LMCAEpoch AI Benchmarking Hub63.3%41.4%
DTBenchEpoch AI Benchmarking Hub97.6%88.0%
ForecastBenchForecastBench66.6%–
BTF-3Epoch AI Benchmarking Hub12.0%†–
Coding
SciCodeSciCode56.4%46.6%†
WeirdMLWeirdML91.8%–
Show all 159 benchmarks
MetricPublisherClaude Opus 5 (max)Qwen3.8 27B
Coding
FrontierCodeCognition53.4%–
Arena CodingArena (LMArena)15281496
Arena WebDevArena (LMArena)16911590
LiveBench 2.0 CodingLiveBench–69.3%†
LiveBench 1.0 CodingLiveBench81.5%75.7%
LiveCodeBenchVals AI89.0%84.0%†
IOIVals AI84.3%39.1%†
SWE-bench (Vals)Vals AI97.0%†86.0%†
Code MigrationVals AI57.5%14.2%†
ProgramBenchVals AI3.0%0.0%†
Vibe Code Bench 1-100Vals AI28.5%–
Vibe Code Bench v1.1Vals AI88.4%†64.8%†
SWE Atlas v1.0: Codebase QnAScale AI SEAL63.2%†–
SWE Atlas v1.0: Test WritingScale AI SEAL62.2%†–
SWE-Bench Pro V2Scale AI SEAL99.4%†–
SWE-Bench Pro V2 HARDScale AI SEAL98.0%†–
MirrorCodeEpoch AI Benchmarking Hub87.8%–
Surface Evolver BenchEpoch AI Benchmarking Hub–45.0%†
DeepSWE v1.1Epoch AI Benchmarking Hub73.7%–
CursorBenchCursor46.6%–
ALE-BenchEpoch AI Benchmarking Hub2164.6†–
FrontierSWEEpoch AI Benchmarking Hub52.0%–
WeirdML v3WeirdML19.0%†–
Terminal-Bench 4.0 (AA)Artificial Analysis49.0%5.6%†
Terminal-Bench 2.1 (AA)Artificial Analysis89.1%79.8%†
Startrise FrontendStartrise82.3%†–
GameBench 2 OverallDuelLab GameBench 276.5†–
GameBench 2 by reasoning settingDuelLab GameBench 284.8†43.8†
Design Arena WebsiteDesign Arena1304†–
FrontierCode 1.1 (AA)Artificial Analysis–34.2%†
FrontierCode 2.0 (AA)Artificial Analysis31.1%14.9%†
Agents & tools
Terminal-BenchTerminal-Bench52.1%–
OSWorld-Verified 2.0OSWorld31.4%–
APEX-AgentsMercor65.8%47.5%
Arena AgentArena (LMArena)7.2-4.8
LiveBench Long AgenticLiveBench–15.9%†
LiveBench BrowserLiveBench–24.2%†
LiveBench Agentic CodingLiveBench65.2%61.4%
Terminal-Bench 2.1 (Vals)Vals AI84.6%†58.4%†
MCP AtlasScale AI SEAL85.8%†–
HiL-BenchScale AI SEAL57.0%†–
τ³-bench Bankingτ²-bench48.7%–
GDPval-AA v2.1, normalised scoreArtificial Analysis–46.0%†
GDPval-AA v2.1Artificial Analysis17291426†
τ³-Banking (AA)Artificial Analysis42.1%48.0%†
Analyst Agent (AA)Artificial Analysis53.8%–
CUA-benchVals AI9.0%–
CyberBenchVals AI65.4%67.8%†
Finance Agent v2Vals AI58.6%48.5%†
Harvey's Legal Agent Benchmark v1Vals AI6.7%11.3%†
Legal Research BenchVals AI55.3%36.1%†
SkillsBenchVals AI60.4%38.1%†
SREBenchVals AI12.2%–
Tax Agent BenchVals AI47.1%30.9%†
Terminal-Bench 4.0 (Vals)Vals AI53.5%–
Terminal-Bench ScienceVals AI27.1%0.0%†
Time Horizon Index: KSPVals AI18.8%–
Arena SearchArena (LMArena)1213†–
Arena Agent Task CompletionArena (LMArena)10.2-2.7
BALROGBALROG63.4%–
PostTrainBenchEpoch AI Benchmarking Hub35.7%†–
GBAEvalEpoch AI Benchmarking Hub79.6%†–
Vending-Bench 2Andon Labs11181.9†–
AutomationBenchArtificial Analysis56.6%48.2%†
GDP.pdf (AA)Artificial Analysis21.6%16.4%†
EnterpriseOps-GymArtificial Analysis47.5%44.2%†
AA-Briefcase v1.1Artificial Analysis16541391†
Design Arena AgenticDesign Arena1270†–
Terminal-Bench-Science 0.1 (AA)Artificial Analysis28.6%0.5%†
CWE-Bench (AA)Artificial Analysis–26.7%†
DeepSec-Bench (AA)Artificial Analysis25.9%11.5%†
CyberGym end-to-end (AA)Artificial Analysis–0.0%†
Maths
FrontierMath Tiers 1–3Epoch AI Benchmarking Hub85.6%–
FrontierMath Tier 4Epoch AI Benchmarking Hub73.2%–
OTIS Mock AIMEEpoch AI Benchmarking Hub98.9%–
ProofBenchVals AI99.0%16.0%
LiveBench MathematicsLiveBench95.7%86.2%
Arena MathsArena (LMArena)15151451
FrontierMath ErdősEpoch AI Benchmarking Hub0.0%–
Knowledge
SimpleQA VerifiedEpoch AI Benchmarking Hub59.9%–
LiveBench 2.0 Data AnalysisLiveBench–76.6%†
LiveBench ResearchLiveBench–61.3%†
LiveBench 1.0 Data AnalysisLiveBench74.5%76.6%
AA-Omniscience v1.1Artificial Analysis37.6-6.4†
MMLU-ProVals AI91.6%84.3%†
LegalBenchVals AI87.0%82.4%†
CorpFinVals AI73.2%†–
TaxEvalVals AI75.1%†70.8%†
BioMysteryBenchVals AI79.3%–
Excel Modeling BenchmarkVals AI73.6%59.7%†
MedCodeVals AI63.6%28.7%†
MedScribeVals AI91.0%83.8%†
Public Benefits Bench v1.1Vals AI76.9%–
DrugDiscoveryBenchScale AI SEAL53.7%–
EBR-benchEpoch AI Benchmarking Hub45.7%–
GDP.pdfEpoch AI Benchmarking Hub24.0%–
AA-Omniscience v1.1: accuracyArtificial Analysis60.9%17.3%†
AA-Omniscience v1.1: non-hallucinationArtificial Analysis40.6%71.4%†
FACTS ParametricGoogle48.8%†–
Instruction following
LiveBench LanguageLiveBench88.7%74.3%
LiveBench Instruction FollowingLiveBench63.8%72.7%
Arena Instruction FollowingArena (LMArena)14941419
Human preference
Arena TextArena (LMArena)14891434
EQ-Bench 4EQ-Bench1365†–
EQ-Bench Creative Writing v3EQ-Bench2135†1671
Arena Creative WritingArena (LMArena)14731359
Arena Multi-turnArena (LMArena)14861436
Arena Longer QueriesArena (LMArena)15021443
Multimodal
Arena VisionArena (LMArena)1318†1270
LiveBench DesignLiveBench–72.4%†
MMMU-ProArtificial Analysis84.7%76.3%†
MMMU-Pro (Vals)Vals AI89.9%83.9%†
MortgageTaxVals AI72.1%†64.9%†
Humanity's Sixth SenseScale AI SEAL30.5%–
GeoBenchGeoBench–38.0%
Blueprint-Bench 2Epoch AI Benchmarking Hub30.4%†–
Furniture AssemblyEpoch AI Benchmarking Hub60.8%–
Code2Video-AAArtificial Analysis–949†
Long context
AA-LCR v1.1Artificial Analysis79.3%82.0%†
Arena DocumentArena (LMArena)1486†–
MLCRArtificial Analysis11.1%22.8%†
Composite
Epoch Capabilities IndexEpoch AI Benchmarking Hub164.7†152.6
LiveBench 2.0LiveBench–54.0%†
LiveBench 1.0LiveBench80.1%75.3%
AA Intelligence Index v5.0.1Artificial Analysis44.220.1†
AA Intelligence Index v4.3.2Artificial Analysis50.833.7†
AA Progress Index v1Artificial Analysis333.7303.1†
Vals RSI IndexVals AI33.0%–
Vals Science IndexVals AI47.9%–
Vals Multimodal IndexVals AI73.9%†–
AA Cyber IndexArtificial Analysis–12.7†
Safety & honesty
FORTRESSScale AI SEAL16.8%†–
DistressBenchScale AI SEAL70.2%†–
Metadata
AA Openness IndexArtificial Analysis–38.9†

Data as of 2026-11-16. Best configuration of each model; every score links to its source on the model pages.

DuelLab GameBench 2, release gb2-20261111-7b598bb13de4 (https://benchmarks.duellab.org/releases/gb2-20261111-7b598bb13de4/), CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Scores mapped to BenchLeader model names; not endorsed by DuelLab.

What changed

  • Qwen3.8 27B: BenchLeader Index 53.2 → 55.1.
  • Claude Opus 5 (max): 25 new results (LiveCodeBench, MMLU-Pro, IOI…).
  • Qwen3.8 27B: Qwen3.8 27B cached input price moved from $0.10/M to $0.085/M (15% down).
  • Claude Opus 5 (max): 1 new result (GDPval-AA v2.1).
  • Qwen3.8 27B: Qwen3.8 27B input price moved from $0.45/M to $0.42/M (7% down).
  • Qwen3.8 27B: BenchLeader Index 54.0 → 53.2.
  • Claude Opus 5 (max): 1 new result (MirrorCode).
  • Qwen3.8 27B: 2 new results (SimpleBench, GeoBench).
  • Claude Opus 5 (max): BenchLeader Index 65.5 → 65.0.
  • Qwen3.8 27B: 5 score revisions.

Rankings: Best LLM overall · Best LLM for agents · Best cheap LLMs

Claude Opus 5 vs Qwen3.8 27B: questions

Is Claude Opus 5 better than Qwen3.8 27B?
Claude Opus 5 (max) leads on quality: 65.0 vs 55.1. The BenchLeader Index combines every independent quality benchmark; Claude Opus 5 (max) is ahead overall as of 16 Nov 2026, but check the category scores for your use.
Claude Opus 5 vs Qwen3.8 27B: which is cheaper, and will that change?
Qwen3.8 27B is cheaper today: $1.09 against $10.00 per million tokens, blended at three input tokens per output token. No price change has been announced for either.
Is Claude Opus 5 or Qwen3.8 27B better for coding?
Claude Opus 5 scores higher in coding (67 vs 62 on the category index, where 50 is average). On Arena WebDev, the top shared coding benchmark, it is 1691 for Claude Opus 5 against 1590 for Qwen3.8 27B.
Which is faster, Claude Opus 5 or Qwen3.8 27B?
Claude Opus 5 streams faster (80 vs 73 output tokens per second, Artificial Analysis 7-day median).
Is Claude Opus 5 or Qwen3.8 27B better for agents and tool use?
Claude Opus 5 scores higher in agentic tasks (64 vs 44 on the category index, where 50 is average). On APEX-Agents, the top shared agents & tools benchmark, it is 65.8% for Claude Opus 5 against 47.5% for Qwen3.8 27B.
More questions (4)
Which is better for long documents?
Claude Opus 5 accepts more context: 1,000,000 against 262,144 tokens for Qwen3.8 27B.
Which has lower latency?
Qwen3.8 27B answers first: 0.7 s against 48.5 s to the first answer token, as Artificial Analysis measures it. Reasoning effort drives most of this: a higher setting thinks longer before it answers.
Do independent benchmarks agree on Claude Opus 5 vs Qwen3.8 27B?
Across the 23 benchmarks both have, Claude Opus 5 leads 21, Qwen3.8 27B leads 2. Every overall index that rates both puts Claude Opus 5 ahead.
When was Qwen3.8 27B released?
Qwen3.8 27B was released on 14 Aug 2026.