BenchLeader

Claude Opus 4.6 vs Qwen3 8

Verdict
  • Claude Opus 4.6 and Qwen3 8 (max) are level on quality (63.1 vs 63.9).
  • Claude Opus 4.6 is stronger in agents & tools, instruction following, knowledge, maths.
  • Qwen3 8 (max) is stronger in coding, composite, human preference, long context, multimodal, reasoning.
  • Qwen3 8 (max) is 3.8× cheaper ($2.67 vs $10.00 per 1M blended).
MetricClaude Opus 4.6Qwen3 8 (max)
BenchLeader Index63.163.9
Agents & tools score68.856.1
Coding score62.371.7
Composite score69.270.8
Human preference score64.667.9
Instruction following score53.7
Knowledge score70.562.3
Long context score65.565.7
Maths score65.6
Multimodal score63.667.2
Reasoning score62.367.7
Blended price $/M$10.00$2.67
Output speed38 tok/s39 tok/s
Time to first answer2.0 s53.2 s
Context window1M1M
GPQA Diamond90.5%
OTIS Mock AIME94.4%
SWE-bench Verified (Epoch)78.7%
Humanity's Last Exam19.0%
Terminal-Bench79.8%
SimpleBench67.6%
Cybench93.0%
Remote Labor Index4.2%
WeirdML77.9%
APEX-Agents32.4%
FrontierCode26.6%
GSO-Bench33.3%
Epoch Capabilities Index155.3156.6
LMArena Text14981480
LMArena Hard Prompts15271502
LMArena Coding15461520
LMArena WebDev15371685
LMArena Vision13111313
LMArena Agent3.9
LiveBench78.5%
LiveBench Reasoning88.2%
LiveBench Coding72.9%
LiveBench Agentic Coding64.7%
LiveBench Mathematics91.3%
LiveBench Data Analysis78.4%
LiveBench Language79.7%
AA Intelligence Index31.940.3
IFBench53.1%
AA-LCR78.0%78.3%
MMMU-Pro75.4%82.3%
AA-Omniscience13.73.4
Terminal-Bench Hard48.5%
GPQA Diamond (AA)89.6%92.7%
Humanity's Last Exam (AA)39.9%43.0%
SciCode (AA)53.2%
τ²-Bench Telecom (AA)92.1%
LiveCodeBench87.8%
MMLU-Pro88.6%
IOI73.0%
LegalBench83.6%
CorpFin65.8%
TaxEval75.5%
Terminal-Bench 2.1 (Vals)67.4%
SWE-bench (Vals)85.6%
GPQA Diamond (Vals)93.7%
Vals Index51.8
HiL-Bench38.3%
EQ-Bench 41223
Kagi LLM Benchmark72.4%
SWE-bench Verified (bash only)75.6%
SWE-bench Verified (any scaffold)75.6%

Data as of 2026-09-09. Best configuration of each model; every score links to its source on the model pages.