BenchLeader

Agnes 3.0 Flash vs Gemini 3 Pro

Verdict
  • Agnes 3.0 Flash leads on quality: 62.3 vs 61.1.
  • Agnes 3.0 Flash is stronger in agents & tools, composite, knowledge, long context, reasoning.
  • Gemini 3 Pro is stronger in coding, human preference, instruction following, maths, multimodal.
  • Agnes 3.0 Flash is 60× cheaper ($0.075 vs $4.50 per 1M blended).
MetricAgnes 3.0 FlashGemini 3 Pro
BenchLeader Index62.361.1
Agents & tools score76.861.4
Composite score74.0
Knowledge score59.156.5
Long context score67.0
Reasoning score71.167.1
Coding score58.8
Human preference score68.8
Instruction following score61.9
Maths score54.8
Multimodal score66.0
Blended price $/M$0.075$4.50
Context window1M1.0M
GPQA Diamond92.6%
OTIS Mock AIME91.4%
SWE-bench Verified (Epoch)72.9%
Humanity's Last Exam37.5%
Terminal-Bench69.4%
SimpleBench76.4%
GDPval40.3%
Remote Labor Index1.3%
WeirdML69.9%
APEX-Agents31.5%
ProofBench20.0%
GSO-Bench18.6%
Epoch Capabilities Index153
LMArena Text1486
LMArena Hard Prompts1504
LMArena Coding1518
LMArena WebDev1439
LMArena Vision1304
AA Intelligence Index35.5
AA-LCR81.0%
AA-Omniscience-10.6
GPQA Diamond (AA)92.4%
Humanity's Last Exam (AA)38.5%
SciCode (AA)51.6%
LiveCodeBench86.4%
MMLU-Pro90.1%
AIME 202691.7%
HMMT February 202686.4%
MathArena Apex23.4%
SWE-Bench Pro43.3%
MCP Atlas70.3%
MultiChallenge65.7%
PRBench Finance39.2%
PRBench Legal40.6%
VISTA51.5%
MultiNRC59.0%
TutorBench53.7%
MMMU-Pro (official)81.0%
Kagi LLM Benchmark80.1%
IFEval (HELM)87.6%
Omni-MATH (HELM)55.6%
WildBench (HELM)85.9%
MMLU-Pro (HELM)90.3%
GPQA Diamond (HELM)80.3%
HELM Capabilities mean79.9%
SWE-bench Verified (bash only)74.2%
SWE-bench Verified (any scaffold)77.4%
ARC-AGI-175.0%
ARC-AGI-254.0%
BFCL Overall72.5%
CritPt15.1%
GDPval (AA)53.7%
τ²-Bench Banking (AA)47.6%
Poker Agent1078.9%
FORTRESS41.7%
MASK42.6%
PropensityBench52.9%
SciPredict25.3%
SWE-Bench Pro (private)17.9%
VTB26.9%
LMArena Maths1477
LMArena Creative Writing1483
LMArena Instruction Following1473
LMArena Multi-turn1495
LMArena Longer Queries1491
LMArena Document1451
Chess Puzzles31.0%
BALROG58.1%
GeoBench84.0%
VPCT91.0%
CL-bench15.8%
METR Time Horizons71.0%
ForecastBench61.2%
ALE-Bench1176.8
AlgoTune1.8
Vending-Bench 25478.2

Data as of 2026-09-19. Best configuration of each model; every score links to its source on the model pages.

Agnes 3.0 Flash vs Gemini 3 Pro: questions

Is Agnes 3.0 Flash better than Gemini 3 Pro?
Agnes 3.0 Flash leads on quality: 62.3 vs 61.1. The BenchLeader Index combines every independent quality benchmark; Agnes 3.0 Flash is ahead overall as of 2026-09-19, but check the category scores for your use.
Is Agnes 3.0 Flash better than Gemini 3 Pro for agentic tasks?
Agnes 3.0 Flash scores higher in agentic tasks (77 vs 61 on the category index, where 50 is average).
Which is cheaper, Agnes 3.0 Flash or Gemini 3 Pro?
Agnes 3.0 Flash is cheaper: $0.075 against $4.50 per million tokens, blended at three input tokens per output token.
Which has the larger context window?
Gemini 3 Pro accepts more context: 1.0M against 1M tokens.