BenchLeader

Gemini 3.5 Flash vs Qwen3 8

Verdict
  • Gemini 3.5 Flash (medium) and Qwen3 8 (max) are level on quality (63.9 vs 63.9).
  • Gemini 3.5 Flash (medium) is stronger in agents & tools, composite, instruction following, knowledge, multimodal.
  • Qwen3 8 (max) is stronger in coding, human preference, long context, reasoning.
  • Qwen3 8 (max) is 1.3× cheaper ($2.67 vs $3.38 per 1M blended).
  • Gemini 3.5 Flash (medium) streams 5.3× faster (209 vs 39 tokens per second).
MetricGemini 3.5 Flash (medium)Qwen3 8 (max)
BenchLeader Index63.963.9
Agents & tools score67.856.1
Coding score58.971.7
Composite score71.470.8
Human preference score67.467.9
Instruction following score72.2
Knowledge score73.962.3
Long context score63.665.7
Multimodal score67.667.2
Reasoning score66.867.7
Blended price $/M$3.38$2.67
Output speed209 tok/s39 tok/s
Time to first answer17.0 s53.2 s
Context window1M1M
Epoch Capabilities Index156.6
LMArena Text14761480
LMArena Hard Prompts14931502
LMArena Coding15031520
LMArena WebDev14911685
LMArena Vision13061313
LMArena Agent3.9
LiveBench78.5%
LiveBench Reasoning88.2%
LiveBench Coding72.9%
LiveBench Agentic Coding64.7%
LiveBench Mathematics91.3%
LiveBench Data Analysis78.4%
LiveBench Language79.7%
AA Intelligence Index33.640.3
IFBench74.6%
AA-LCR74.3%78.3%
MMMU-Pro83.9%82.3%
AA-Omniscience20.83.4
Terminal-Bench Hard39.4%
GPQA Diamond (AA)92.1%92.7%
Humanity's Last Exam (AA)41.3%43.0%
SciCode (AA)53.2%
τ²-Bench Telecom (AA)95.6%
LiveCodeBench87.8%
MMLU-Pro88.6%
IOI73.0%
LegalBench83.6%
CorpFin65.8%
TaxEval75.5%
Terminal-Bench 2.1 (Vals)67.4%
SWE-bench (Vals)85.6%
GPQA Diamond (Vals)93.7%
Vals Index51.8

Data as of 2026-09-09. Best configuration of each model; every score links to its source on the model pages.