BenchLeader

Claude Opus 5 vs Qwen3.5 397B A17B

Verdict
  • Claude Opus 5 leads on quality: 70.0 vs 58.7.
  • Claude Opus 5 is stronger in agents & tools, coding, composite, human preference, knowledge, long context, maths, multimodal, reasoning.
  • Qwen3.5 397B A17B is stronger in instruction following.
  • Qwen3.5 397B A17B is 26× cheaper ($0.387 vs $10.00 per 1M blended).
  • Qwen3.5 397B A17B streams 1.5× faster (78 vs 51 tokens per second).
MetricClaude Opus 5Qwen3.5 397B A17B
BenchLeader Index70.058.7
Agents & tools score71.569.4
Coding score74.551.7
Composite score93.153.1
Human preference score78.263.6
Knowledge score70.649.5
Long context score66.265.2
Maths score67.150.1
Multimodal score69.461.6
Reasoning score71.563.0
Instruction following score76.1
Blended price $/M$10.00$0.387
Output speed51 tok/s78 tok/s
Time to first answer93.0 s42.7 s
Context window1M262k
GPQA Diamond92.9%85.9%
FrontierMath Tiers 1–329.5%
OTIS Mock AIME97.8%88.9%
SimpleBench80.6%
WeirdML86.3%
Epoch Capabilities Index162.6147.0
LMArena Text1441
LMArena Hard Prompts1463
LMArena Coding1491
LMArena WebDev1399
LMArena Vision1265
AA Intelligence Index50.719.1
IFBench78.8%
AA-LCR79.3%77.3%
MMMU-Pro84.7%77.3%
AA-Omniscience37.1-30.8
Terminal-Bench Hard40.9%
GPQA Diamond (AA)93.2%89.3%
Humanity's Last Exam (AA)54.9%29.0%
SciCode (AA)56.4%44.8%
τ²-Bench Telecom (AA)95.6%
LiveCodeBench89.0%
MMLU-Pro91.6%
IOI91.7%
LegalBench87.0%
CorpFin73.2%
TaxEval75.1%
Terminal-Bench 2.1 (Vals)84.6%
SWE-bench (Vals)97.0%
GPQA Diamond (Vals)93.4%
Vals Index67.2
AIME 202694.2%
HMMT February 202687.9%
HiL-Bench57.0%
EQ-Bench 41385

Data as of 2026-09-10. Best configuration of each model; every score links to its source on the model pages.

Claude Opus 5 vs Qwen3.5 397B A17B: questions

Is Claude Opus 5 better than Qwen3.5 397B A17B?
Claude Opus 5 leads on quality: 70.0 vs 58.7. The BenchLeader Index combines every independent quality benchmark; Claude Opus 5 is ahead overall as of 2026-09-10, but check the category scores for your use.
Is Claude Opus 5 better than Qwen3.5 397B A17B for coding?
Claude Opus 5 scores higher in coding (75 vs 52 on the category index, where 50 is average).
Is Claude Opus 5 better than Qwen3.5 397B A17B for agentic tasks?
Claude Opus 5 scores higher in agentic tasks (72 vs 69 on the category index, where 50 is average).
Which is cheaper, Claude Opus 5 or Qwen3.5 397B A17B?
Qwen3.5 397B A17B is cheaper: $0.387 against $10.00 per million tokens, blended at three input tokens per output token.
Which is faster, Claude Opus 5 or Qwen3.5 397B A17B?
Qwen3.5 397B A17B streams faster: 78 against 51 output tokens per second.
Which has the larger context window?
Claude Opus 5 accepts more context: 1M against 262k tokens.