BenchLeader

Grok 4.6 vs Qwen3 8

Verdict
  • Grok 4.6 (medium) and Qwen3 8 (max) are level on quality (63.8 vs 63.9).
  • Grok 4.6 (medium) is stronger in composite, knowledge, long context.
  • Qwen3 8 (max) is stronger in coding, reasoning, agents & tools, human preference, multimodal.
  • They cost about the same ($2.67 per 1M blended).
  • Grok 4.6 (medium) streams 1.4× faster (55 vs 39 tokens per second).
MetricGrok 4.6 (medium)Qwen3 8 (max)
BenchLeader Index63.863.9
Coding score63.971.7
Composite score83.270.8
Knowledge score77.362.3
Long context score67.165.7
Reasoning score62.167.7
Agents & tools score56.1
Human preference score67.9
Multimodal score67.2
Blended price $/M$3.00$2.67
Output speed55 tok/s39 tok/s
Time to first answer36.7 s53.2 s
Context window500k1M
SciCode54.6%
Epoch Capabilities Index156.6
LMArena Text1480
LMArena Hard Prompts1502
LMArena Coding1520
LMArena WebDev1685
LMArena Vision1313
LMArena Agent3.9
LiveBench78.5%
LiveBench Reasoning88.2%
LiveBench Coding72.9%
LiveBench Agentic Coding64.7%
LiveBench Mathematics91.3%
LiveBench Data Analysis78.4%
LiveBench Language79.7%
AA Intelligence Index43.040.3
AA-LCR81.0%78.3%
MMMU-Pro82.3%
AA-Omniscience283.4
GPQA Diamond (AA)93.5%92.7%
Humanity's Last Exam (AA)42.1%43.0%
SciCode (AA)55.9%53.2%
LiveCodeBench87.8%
MMLU-Pro88.6%
IOI73.0%
LegalBench83.6%
CorpFin65.8%
TaxEval75.5%
Terminal-Bench 2.1 (Vals)67.4%
SWE-bench (Vals)85.6%
GPQA Diamond (Vals)93.7%
Vals Index51.8
ARC-AGI-187.5%
ARC-AGI-261.3%

Data as of 2026-09-09. Best configuration of each model; every score links to its source on the model pages.