BenchLeader

Agnes 3.0 Flash vs Gemini 3.1 Pro

Verdict
  • Gemini 3.1 Pro leads on quality: 63.9 vs 62.3.
  • Agnes 3.0 Flash is stronger in agents & tools, composite, reasoning.
  • Gemini 3.1 Pro is stronger in knowledge, long context, coding, human preference, instruction following, maths, multimodal.
  • Agnes 3.0 Flash is 60× cheaper ($0.075 vs $4.50 per 1M blended).
MetricAgnes 3.0 FlashGemini 3.1 Pro
BenchLeader Index62.363.9
Agents & tools score76.860.4
Composite score74.067.5
Knowledge score59.165.9
Long context score67.067.5
Reasoning score71.170.8
Coding score59.8
Human preference score59.8
Instruction following score69.7
Maths score61.9
Multimodal score66.0
Blended price $/M$0.075$4.50
Output speed121 tok/s
Time to first answer34.8 s
Context window1M1.0M
GPQA Diamond94.1%
FrontierMath Tiers 1–359.6%
FrontierMath Tier 426.8%
OTIS Mock AIME95.6%
Humanity's Last Exam46.4%
Terminal-Bench80.2%
SimpleBench79.6%
SciCode58.9%
WeirdML72.1%
APEX-Agents33.5%
ProofBench26.0%
GSO-Bench22.6%
Epoch Capabilities Index155
LMArena Text1487
LMArena Hard Prompts1508
LMArena Coding1520
LMArena WebDev1447
LMArena Vision1296
LMArena Agent-5.8
AA Intelligence Index35.530.4
IFBench77.1%
AA-LCR81.0%82.0%
MMMU-Pro82.4%
AA-Omniscience-10.631.9
Terminal-Bench Hard53.8%
GPQA Diamond (AA)92.4%94.1%
Humanity's Last Exam (AA)38.5%47.0%
SciCode (AA)51.6%58.7%
τ²-Bench Telecom (AA)95.6%
AIME 202698.3%
HMMT February 202694.7%
MathArena Apex60.9%
MultiChallenge71.4%
PRBench Finance41.9%
PRBench Legal44.0%
MultiNRC64.7%
HiL-Bench35.3%
TutorBench53.0%
EQ-Bench 41142
ARC-AGI-198.0%
ARC-AGI-277.1%
ARC-AGI-30.4%
CritPt15.1%17.7%
GDPval (AA)53.7%20.2%
τ²-Bench Banking (AA)47.6%21.4%
ITBench SRE (AA)30.3%
Analyst Agent (AA)41.3%
APEX-Agents (AA)32.0%
CyberBench36.4%
FORTRESS29.8%
MASK42.4%
SWE Atlas: Codebase QnA13.5%
SWE Atlas: Refactoring33.8%
SWE Atlas: Test Writing29.8%
VTB29.0%
LMArena Maths1489
LMArena Creative Writing1480
LMArena Instruction Following1481
LMArena Multi-turn1495
LMArena Longer Queries1500
LMArena Document1459
Chess Puzzles55.0%
EBR-bench14.3%
BALROG57.0%
PostTrainBench22.0%
ExploitBench26.1%
CL-bench20.8%
CL-bench Life16.9%
METR Time Horizons77.0%
DeepSWE11.7%
ForecastBench59.0%
GBAEval0.8%
ALE-Bench1160.6
AlgoTune2.0
Vending-Bench 2911.2
Blueprint-Bench 226.5%
GDP.pdf17.0%

Data as of 2026-09-19. Best configuration of each model; every score links to its source on the model pages.

Agnes 3.0 Flash vs Gemini 3.1 Pro: questions

Is Agnes 3.0 Flash better than Gemini 3.1 Pro?
Gemini 3.1 Pro leads on quality: 63.9 vs 62.3. The BenchLeader Index combines every independent quality benchmark; Gemini 3.1 Pro is ahead overall as of 2026-09-19, but check the category scores for your use.
Is Agnes 3.0 Flash better than Gemini 3.1 Pro for agentic tasks?
Agnes 3.0 Flash scores higher in agentic tasks (77 vs 60 on the category index, where 50 is average).
Which is cheaper, Agnes 3.0 Flash or Gemini 3.1 Pro?
Agnes 3.0 Flash is cheaper: $0.075 against $4.50 per million tokens, blended at three input tokens per output token.
Which has the larger context window?
Gemini 3.1 Pro accepts more context: 1.0M against 1M tokens.