BenchLeader

Gemini 3 Pro vs Qwen3 8

Verdict
  • Qwen3 8 (max) leads on quality: 63.6 vs 61.7.
  • Gemini 3 Pro is stronger in agents & tools, human preference, instruction following.
  • Qwen3 8 (max) is stronger in coding, composite, knowledge, long context, maths, multimodal, reasoning.
  • Qwen3 8 (max) is 1.7× cheaper ($2.67 vs $4.50 per 1M blended).
MetricGemini 3 ProQwen3 8 (max)
BenchLeader Index61.763.6
Agents & tools score62.356.0
Coding score58.969.7
Composite score64.370.9
Human preference score69.068.3
Instruction following score64.3
Knowledge score60.962.3
Long context score64.565.7
Maths score48.462.4
Multimodal score65.767.2
Reasoning score67.168.1
Blended price $/M$4.50$2.67
Output speed38 tok/s
Time to first answer55.3 s
Context window1M1M
GPQA Diamond92.6%
OTIS Mock AIME91.4%
SWE-bench Verified (Epoch)72.9%
Humanity's Last Exam37.5%
Terminal-Bench69.4%
SimpleBench76.4%
GDPval40.3%
SciCode52.9%
Remote Labor Index1.3%
WeirdML69.9%
APEX-Agents31.5%
ProofBench20.0%58.0%
GSO-Bench18.6%
Epoch Capabilities Index153.0156.6
LMArena Text14861480
LMArena Hard Prompts15041502
LMArena Coding15181520
LMArena WebDev14391670
LMArena Vision13051313
LMArena Agent3.9
LiveBench78.5%
LiveBench Reasoning88.2%
LiveBench Coding72.9%
LiveBench Agentic Coding64.7%
LiveBench Mathematics91.3%
LiveBench Data Analysis78.4%
LiveBench Language79.7%
AA Intelligence Index28.040.3
IFBench70.4%
AA-LCR76.0%78.3%
MMMU-Pro80.2%82.3%
AA-Omniscience15.33.4
Terminal-Bench Hard41.7%
GPQA Diamond (AA)90.8%92.7%
Humanity's Last Exam (AA)39.7%43.0%
SciCode (AA)53.2%
τ²-Bench Telecom (AA)87.1%
LiveCodeBench86.4%87.8%
MMLU-Pro90.1%88.6%
IOI73.0%
LegalBench83.6%
CorpFin65.8%
TaxEval75.5%
Terminal-Bench 2.1 (Vals)67.4%
SWE-bench (Vals)85.6%
GPQA Diamond (Vals)93.7%
Vals Index51.8
AIME 202691.7%
HMMT February 202686.4%
MathArena Apex23.4%
SWE-Bench Pro43.3%
MCP Atlas70.3%
MultiChallenge65.7%
PRBench Finance39.2%
PRBench Legal40.6%
VISTA51.5%
MultiNRC59.0%
TutorBench53.7%
MMMU-Pro (official)81.0%
Kagi LLM Benchmark80.1%
SWE-bench Verified (bash only)74.2%
SWE-bench Verified (any scaffold)77.4%
ARC-AGI-175.0%
ARC-AGI-254.0%
BFCL Overall72.5%

Data as of 2026-09-10. Best configuration of each model; every score links to its source on the model pages.

Gemini 3 Pro vs Qwen3 8: questions

Is Gemini 3 Pro better than Qwen3 8?
Qwen3 8 (max) leads on quality: 63.6 vs 61.7. The BenchLeader Index combines every independent quality benchmark; Qwen3 8 (max) is ahead overall as of 2026-09-10, but check the category scores for your use.
Is Gemini 3 Pro better than Qwen3 8 for coding?
Qwen3 8 scores higher in coding (70 vs 59 on the category index, where 50 is average).
Is Gemini 3 Pro better than Qwen3 8 for agentic tasks?
Gemini 3 Pro scores higher in agentic tasks (62 vs 56 on the category index, where 50 is average).
Which is cheaper, Gemini 3 Pro or Qwen3 8?
Qwen3 8 is cheaper: $2.67 against $4.50 per million tokens, blended at three input tokens per output token.
Which has the larger context window?
Both accept 1M tokens of context.