BenchLeader

Agnes 3.0 Flash vs DeepSeek V4 Pro

Verdict
  • DeepSeek V4 Pro (max) leads on quality: 64.2 vs 62.3.
  • Agnes 3.0 Flash is stronger in agents & tools, knowledge, long context, reasoning.
  • DeepSeek V4 Pro (max) is stronger in composite, coding, instruction following, maths.
  • Agnes 3.0 Flash is 7.3× cheaper ($0.075 vs $0.544 per 1M blended).
MetricAgnes 3.0 FlashDeepSeek V4 Pro (max)
BenchLeader Index62.364.2
Agents & tools score76.870.2
Composite score74.075.0
Knowledge score59.158.1
Long context score67.066.6
Reasoning score71.170.9
Coding score58.8
Instruction following score74.3
Maths score53.7
Blended price $/M$0.075$0.544
Output speed81 tok/s
Time to first answer55.6 s
Context window1M1M
GPQA Diamond89.7%
FrontierMath Tiers 1–345.3%
FrontierMath Tier 42.4%
OTIS Mock AIME96.7%
SWE-bench Verified (Epoch)77.6%
SimpleQA Verified47.0%
SciCode50.0%
WeirdML48.9%
ProofBench16.0%
AA Intelligence Index35.536.3
IFBench76.5%
AA-LCR81.0%80.3%
AA-Omniscience-10.60.8
Terminal-Bench Hard46.2%
GPQA Diamond (AA)92.4%92.8%
Humanity's Last Exam (AA)38.5%41.0%
SciCode (AA)51.6%51.0%
τ²-Bench Telecom (AA)96.2%
LiveCodeBench87.5%
MMLU-Pro87.3%
LegalBench80.3%
CorpFin61.4%
TaxEval72.1%
SWE-bench (Vals)77.4%
GPQA Diamond (Vals)89.4%
Vals Index42.9
AIME 202696.7%
HMMT February 202693.9%
MathArena Apex28.1%
CritPt15.1%18.0%
GDPval (AA)53.7%49.7%
τ²-Bench Banking (AA)47.6%39.6%
ITBench SRE (AA)38.3%
Analyst Agent (AA)18.8%
APEX-Agents (AA)24.3%
CaseLaw v259.4%
Code Migration26.2%
Excel Modeling Benchmark51.6%
Finance Agent v244.1%
Harvey's Legal Agent Benchmark3.8%
Legal Research Bench23.1%
MedCode40.5%
MedScribe75.1%
ProgramBench0.0%
Public Benefits Bench62.9%
SkillsBench51.3%
Vibe Code Bench v1.149.9%
Chess Puzzles20.0%
LMCA41.2%
DTBench90.7%

Data as of 2026-09-19. Best configuration of each model; every score links to its source on the model pages.

Agnes 3.0 Flash vs DeepSeek V4 Pro: questions

Is Agnes 3.0 Flash better than DeepSeek V4 Pro?
DeepSeek V4 Pro (max) leads on quality: 64.2 vs 62.3. The BenchLeader Index combines every independent quality benchmark; DeepSeek V4 Pro (max) is ahead overall as of 2026-09-19, but check the category scores for your use.
Is Agnes 3.0 Flash better than DeepSeek V4 Pro for agentic tasks?
Agnes 3.0 Flash scores higher in agentic tasks (77 vs 70 on the category index, where 50 is average).
Which is cheaper, Agnes 3.0 Flash or DeepSeek V4 Pro?
Agnes 3.0 Flash is cheaper: $0.075 against $0.544 per million tokens, blended at three input tokens per output token.
Which has the larger context window?
Both accept 1M tokens of context.