BenchLeader

Gemini 3.1 Pro vs Qwen3.8 2.4T A95B

Verdict
  • Qwen3.8 2.4T A95B leads on quality: 65.2 vs 63.9.
  • Gemini 3.1 Pro is stronger in coding, human preference, instruction following, long context, maths, multimodal.
  • Qwen3.8 2.4T A95B is stronger in agents & tools, composite, knowledge, reasoning.
  • Qwen3.8 2.4T A95B is 1.5× cheaper ($3.00 vs $4.50 per 1M blended).
  • Gemini 3.1 Pro streams 3.2× faster (121 vs 38 tokens per second).
MetricGemini 3.1 ProQwen3.8 2.4T A95B
BenchLeader Index63.965.2
Agents & tools score60.478.3
Coding score59.8
Composite score67.579.8
Human preference score59.8
Instruction following score69.7
Knowledge score65.966.3
Long context score67.566.6
Maths score61.9
Multimodal score66.0
Reasoning score70.880.5
Blended price $/M$4.50$3.00
Output speed121 tok/s38 tok/s
Time to first answer34.8 s55.2 s
Context window1.0M984k
GPQA Diamond94.1%
FrontierMath Tiers 1–359.6%
FrontierMath Tier 426.8%
OTIS Mock AIME95.6%
Humanity's Last Exam46.4%
Terminal-Bench80.2%
SimpleBench79.6%
SciCode58.9%
WeirdML72.1%
APEX-Agents33.5%
ProofBench26.0%
GSO-Bench22.6%
Epoch Capabilities Index155
LMArena Text1487
LMArena Hard Prompts1508
LMArena Coding1520
LMArena WebDev1447
LMArena Vision1296
LMArena Agent-5.8
AA Intelligence Index30.440.0
IFBench77.1%
AA-LCR82.0%80.3%
MMMU-Pro82.4%
AA-Omniscience31.94.3
Terminal-Bench Hard53.8%
GPQA Diamond (AA)94.1%93.5%
Humanity's Last Exam (AA)47.0%42.5%
SciCode (AA)58.7%54.0%
τ²-Bench Telecom (AA)95.6%
AIME 202698.3%
HMMT February 202694.7%
MathArena Apex60.9%
MultiChallenge71.4%
PRBench Finance41.9%
PRBench Legal44.0%
MultiNRC64.7%
HiL-Bench35.3%
TutorBench53.0%
EQ-Bench 41142
ARC-AGI-198.0%
ARC-AGI-277.1%
ARC-AGI-30.4%
CritPt17.7%20.0%
GDPval (AA)20.2%56.4%
τ²-Bench Banking (AA)21.4%49.1%
ITBench SRE (AA)30.3%
Analyst Agent (AA)41.3%
APEX-Agents (AA)32.0%
CyberBench36.4%
FORTRESS29.8%
MASK42.4%
SWE Atlas: Codebase QnA13.5%
SWE Atlas: Refactoring33.8%
SWE Atlas: Test Writing29.8%
VTB29.0%
LMArena Maths1489
LMArena Creative Writing1480
LMArena Instruction Following1481
LMArena Multi-turn1495
LMArena Longer Queries1500
LMArena Document1459
Chess Puzzles55.0%
EBR-bench14.3%
BALROG57.0%
PostTrainBench22.0%
ExploitBench26.1%
CL-bench20.8%
CL-bench Life16.9%
METR Time Horizons77.0%
DeepSWE11.7%
ForecastBench59.0%
GBAEval0.8%
ALE-Bench1160.6
AlgoTune2.0
Vending-Bench 2911.2
Blueprint-Bench 226.5%
GDP.pdf17.0%

Data as of 2026-09-19. Best configuration of each model; every score links to its source on the model pages.

Gemini 3.1 Pro vs Qwen3.8 2.4T A95B: questions

Is Gemini 3.1 Pro better than Qwen3.8 2.4T A95B?
Qwen3.8 2.4T A95B leads on quality: 65.2 vs 63.9. The BenchLeader Index combines every independent quality benchmark; Qwen3.8 2.4T A95B is ahead overall as of 2026-09-19, but check the category scores for your use.
Is Gemini 3.1 Pro better than Qwen3.8 2.4T A95B for agentic tasks?
Qwen3.8 2.4T A95B scores higher in agentic tasks (78 vs 60 on the category index, where 50 is average).
Which is cheaper, Gemini 3.1 Pro or Qwen3.8 2.4T A95B?
Qwen3.8 2.4T A95B is cheaper: $3.00 against $4.50 per million tokens, blended at three input tokens per output token.
Which is faster, Gemini 3.1 Pro or Qwen3.8 2.4T A95B?
Gemini 3.1 Pro streams faster: 121 against 38 output tokens per second.
Which has the larger context window?
Gemini 3.1 Pro accepts more context: 1.0M against 984k tokens.