BenchLeader

Grok 4 vs Qwen3 6

Verdict
  • Qwen3 6 (max) leads on quality: 61.6 vs 59.8.
  • Grok 4 is stronger in coding, long context, multimodal.
  • Qwen3 6 (max) is stronger in agents & tools, human preference, instruction following, knowledge, maths, reasoning, composite.
  • Grok 4 is 1.9× cheaper ($1.56 vs $2.96 per 1M blended).
MetricGrok 4Qwen3 6 (max)
BenchLeader Index59.861.6
Agents & tools score53.467.1
Coding score61.258.1
Human preference score59.865.8
Instruction following score67.771.2
Knowledge score56.062.6
Long context score77.764.5
Maths score58.064.2
Multimodal score54.5
Reasoning score58.363.1
Composite score59.1
Blended price $/M$1.56$2.96
Output speed59 tok/s
Time to first answer37.0 s
Context window256k246k
GPQA Diamond87.0%87.4%
OTIS Mock AIME84.0%91.1%
SWE-bench Verified (Epoch)76.7%
SimpleQA Verified52.0%
Terminal-Bench27.2%
SimpleBench60.5%63.0%
Fiction.LiveBench 120k96.9%
Cybench43.0%
WeirdML45.7%
APEX-Agents15.2%
Epoch Capabilities Index146.4149.3
LMArena Text14111460
LMArena Hard Prompts14201481
LMArena Coding14351509
LMArena WebDev1479
LMArena Vision1210
AA Intelligence Index28.4
IFBench76.6%
AA-LCR80.7%
AA-Omniscience9.2
Terminal-Bench Hard43.9%
GPQA Diamond (AA)88.8%
Humanity's Last Exam (AA)30.8%
τ²-Bench Telecom (AA)95.9%
AIME (Vals)90.6%
LiveCodeBench83.3%
MMLU-Pro85.3%
LegalBench83.2%
CorpFin66.0%66.5%
TaxEval65.1%
MedQA92.5%
MGSM90.9%
SWE-bench (Vals)57.8%72.8%
GPQA Diamond (Vals)88.1%
IMO 202521.4%
MathArena Apex2.1%
Kagi LLM Benchmark73.6%
IFEval (HELM)94.9%
Omni-MATH (HELM)60.3%
WildBench (HELM)79.7%
MMLU-Pro (HELM)85.1%
GPQA Diamond (HELM)72.6%
HELM Capabilities mean78.5%
Aider Polyglot79.6%
ARC-AGI-179.6%
ARC-AGI-229.4%
BFCL Overall63.0%

Data as of 2026-09-13. Best configuration of each model; every score links to its source on the model pages.

Grok 4 vs Qwen3 6: questions

Is Grok 4 better than Qwen3 6?
Qwen3 6 (max) leads on quality: 61.6 vs 59.8. The BenchLeader Index combines every independent quality benchmark; Qwen3 6 (max) is ahead overall as of 2026-09-13, but check the category scores for your use.
Is Grok 4 better than Qwen3 6 for coding?
Grok 4 scores higher in coding (61 vs 58 on the category index, where 50 is average).
Is Grok 4 better than Qwen3 6 for agentic tasks?
Qwen3 6 scores higher in agentic tasks (67 vs 53 on the category index, where 50 is average).
Which is cheaper, Grok 4 or Qwen3 6?
Grok 4 is cheaper: $1.56 against $2.96 per million tokens, blended at three input tokens per output token.
Which has the larger context window?
Grok 4 accepts more context: 256k against 246k tokens.