BenchLeader

DeepSeek V4.1 Flash 1017 vs Gemini 3 Pro

Full profiles: DeepSeek V4.1 Flash 1017 (DeepSeek) and Gemini 3 Pro (Google): every benchmark, price and rank.

Updated · Data from 19 sources

As of 16 Nov 2026, DeepSeek V4.1 Flash and Gemini 3 Pro are neck and neck on quality (57.7 vs 60.0 on the BenchLeader Index, inside the ±4.9 margin), and DeepSeek V4.1 Flash is 8.6× cheaper at $0.525 vs $4.50 per 1M tokens blended. Choose DeepSeek V4.1 Flash for maths (61 vs 54) and coding (63 vs 58); choose Gemini 3 Pro for knowledge (56 vs 48), reasoning (63 vs 56), and agents & tools (62 vs 58).

Key facts (as of 16 Nov 2026)

  • DeepSeek V4.1 Flash scores 57.7 on the BenchLeader Index and Gemini 3 Pro scores 60.0 (BenchLeader, 16 Nov 2026).
  • DeepSeek V4.1 Flash costs $0.525 per 1M tokens blended (list price, 16 Nov 2026).
  • Gemini 3 Pro costs $4.50 per 1M tokens blended (list price, 16 Nov 2026).
  • Of the 7 benchmarks both models have, DeepSeek V4.1 Flash leads 6 (BenchLeader, 16 Nov 2026).
  • On Arena WebDev, DeepSeek V4.1 Flash 1017 is rated 1664 and Gemini 3 Pro 1441 (LMArena, as published by 16 Nov 2026).

Which to pick for…

The pick's numbers come first. Category scores on the BenchLeader scale (50 is the average model, 15 points one standard deviation). High confidence means a lead of half a standard deviation or more; under one point is called either.

Use casePickWhyConfidence
CodingDeepSeek V4.1 Flash 101763 vs 58 category score; Arena WebDev 1664 vs 1441Medium
Agents & tool useGemini 3 Pro62 vs 58 category score; Terminal-Bench 69.4% vs 38.5%Medium
MathsDeepSeek V4.1 Flash 101761 vs 54 category score; OTIS Mock AIME 99.4% vs 91.4%Medium
ReasoningGemini 3 Pro63 vs 56 category score; GPQA Diamond 92.6% vs 93.2%Medium
KnowledgeGemini 3 Pro56 vs 48 category scoreHigh
Images and other mediaGemini 3 Pro66 vs 63 category scoreMedium
Chat quality (human preference)–Only Gemini 3 Pro has an Arena rating (68 category score)Not comparable
High volume on a budgetNeither flagshipA smaller model is usually the better fit: Cheapest good LLMs, Fastest LLMs–

Key differences

  • DeepSeek V4.1 Flash 1017 (max) and Gemini 3 Pro are neck and neck on quality (57.7 vs 60.0, within the ±4.9 margin).
  • DeepSeek V4.1 Flash 1017 (max) is stronger in coding, maths.
  • Gemini 3 Pro is stronger in agents & tools, knowledge, multimodal, reasoning.
  • DeepSeek V4.1 Flash 1017 (max) is 8.6× cheaper ($0.525 vs $4.50 per 1M blended).

At a glance

SpecDeepSeek V4.1 Flash 1017Gemini 3 Pro
DeveloperDeepSeekGoogle
Released17 Oct 202618 Nov 2025
Context window (tokens)1,048,576–
Compared atDeepSeek V4.1 Flash 1017 (max)Gemini 3 Pro
Open weightsYesNo
Price in / out / cached input per 1M$0.300 / $1.20 / $0.0060–

Category by category

Category scores on the BenchLeader scale: 50 is the average evaluated model, 15 points is one standard deviation. A gap under one point is called level.

CategoryDeepSeek V4.1 Flash 1017 (max)Gemini 3 ProLeader
Reasoning55.762.6Gemini 3 Pro
Coding63.057.8DeepSeek V4.1 Flash 1017
Agents & tools57.661.7Gemini 3 Pro
Maths60.954.0DeepSeek V4.1 Flash 1017
Knowledge47.755.9Gemini 3 Pro
Instruction following–61.1not comparable
Human preference–67.7not comparable
Multimodal63.065.6Gemini 3 Pro
Long context66.0–not comparable
Composite55.5–not comparable

On one chart

Each domain on the index's own scale, where 50 is an average model. Click a domain to see the benchmarks behind it. Pick up to 5 models from the list.

2550 avg75ReasoningCodingAgents & toolsMathsKnowledgeMultimodalDeepSeek V4.1 Flash 1017, Reasoning: 55.7DeepSeek V4.1 Flash 1017, Coding: 63.0DeepSeek V4.1 Flash 1017, Agents & tools: 57.6DeepSeek V4.1 Flash 1017, Maths: 60.9DeepSeek V4.1 Flash 1017, Knowledge: 47.7DeepSeek V4.1 Flash 1017, Multimodal: 63.0Gemini 3 Pro, Reasoning: 62.6Gemini 3 Pro, Coding: 57.8Gemini 3 Pro, Agents & tools: 61.7Gemini 3 Pro, Maths: 54.0Gemini 3 Pro, Knowledge: 55.9Gemini 3 Pro, Multimodal: 65.6

Not drawn, measured for fewer than two of these models: Instruction following, Long context, Human preference.

Model, click to add or removeIndex

Where sources disagree

Across the 7 benchmarks both have, DeepSeek V4.1 Flash 1017 leads 6, Gemini 3 Pro leads 1.

Overall indexDeepSeek V4.1 Flash 1017 (max)Gemini 3 ProLeader
BenchLeader Index57.760.0neck and neck

Each publisher runs its own tasks, harnesses and effort settings, so their overall verdicts can differ; BenchLeader reconciles them on one scale. † measured at another effort setting of the same model (the publisher did not test the one compared here).

Price, speed and latency

List prices blended at three input tokens per output token. Per-task prices use the token counts on the methodology page. Cost, tokens and time per benchmark task are measured: Artificial Analysis’ averages over its whole Intelligence Index run.

MeasureDeepSeek V4.1 Flash 1017 (max)Gemini 3 Pro
Blended price per 1M tokens$0.525–
Input / output per 1M$0.300 / $1.20– / –
Cached input per 1M$0.0060–
Price per task: chat reply$0.0005–
Price per task: summarize a 30-page report$0.0043–
Price per task: code edit$0.0036–
Price per task: agentic coding session$0.023–
Price per task: structured extraction$0.0008–
Agentic coding session, input mostly cached$0.0096–
Cost per benchmark task (AA Index)$0.602–
Output tokens per task (AA Index)139k–
Of which reasoning91k–
Time per task (AA Index)13 min–
Output speed174 tok/s–
Time to first answer39.7 s–
Time to a complete answer, last measured 13 Nov 202691.2 s–

Each model is compared at its best-ranked reasoning-effort setting. DeepSeek V4.1 Flash 1017 (max) scores 57.7 and takes 40 s to its first answer token; DeepSeek V4.1 Flash 1017 (high) scores 51.2 in 20 s, DeepSeek V4.1 Flash 1017 (no reasoning) scores 44.9 in 1 s. Gemini 3 Pro scores 60.0; Gemini 3 Pro (high) scores 60.0. Higher effort means more thinking before the answer: better scores, longer waits and more tokens billed. How reasoning effort changes scores and cost.

Every benchmark

172 benchmarks, grouped by category; each name links to the board and its leaders. † measured at another effort setting of the same model, shown for reference and not counted as a win.

MetricPublisherDeepSeek V4.1 Flash 1017 (max)Gemini 3 Pro
BenchLeader IndexBenchLeader57.760.0
Agents & tools scoreBenchLeader57.661.7
Coding scoreBenchLeader63.057.8
Composite scoreBenchLeader55.5–
Knowledge scoreBenchLeader47.755.9
Long context scoreBenchLeader66.0–
Maths scoreBenchLeader60.954.0
Multimodal scoreBenchLeader63.065.6
Reasoning scoreBenchLeader55.762.6
Human preference scoreBenchLeader–67.7
Instruction following scoreBenchLeader–61.1
Blended price $/MBenchLeader$0.525–
Output speedBenchLeader174 tok/s–
Time to first answerBenchLeader39.7 s–
Context windowBenchLeader1,048,576 tokens–
Reasoning
GPQA DiamondEpoch AI Benchmarking Hub93.2%92.6%
Humanity's Last ExamScale AI / CAIS–37.5%
SimpleBenchSimpleBench–76.4%
Arena Hard PromptsArena (LMArena)–1502
LiveBench 2.0 ReasoningLiveBench89.1%–
GPQA Diamond (AA)Artificial Analysis–90.8%†
Humanity's Last Exam (AA)Artificial Analysis43.3%39.7%†
HLE-Diamond (AA)Artificial Analysis25.3%–
GPQA Diamond (Vals)Vals AI–91.7%†
Kagi LLM BenchmarkKagi LLM Benchmark–80.1%
GPQA Diamond (HELM)HELM Capabilities–80.3%
ARC-AGI-1ARC Prize93.5%75.0%
ARC-AGI-2ARC Prize78.1%31.1%
ARC-AGI-3ARC Prize5.8%–
CritPtArtificial Analysis24.0%9.1%†
CritPt v2 hard subset (AA)Artificial Analysis25.0%–
SciPredictScale AI SEAL–25.3%
HLE-Diamond (Scale)Scale AI SEAL20.5%†–
Arena ExpertArena (LMArena)–1499
Chess PuzzlesEpoch AI Benchmarking Hub46.0%–
Mystery Game PuzzlesEpoch AI Benchmarking Hub49.0%–
CL-benchEpoch AI Benchmarking Hub–15.8%
ForecastBenchForecastBench–65.0%
Coding
SWE-bench Verified (Epoch)Epoch AI Benchmarking Hub–72.9%
SciCodeSciCode55.9%–
Show all 172 benchmarks
MetricPublisherDeepSeek V4.1 Flash 1017 (max)Gemini 3 Pro
Coding
WeirdMLWeirdML–69.9%
GSO-BenchGSO-Bench–18.6%
Arena CodingArena (LMArena)–1517
Arena WebDevArena (LMArena)16641441
LiveBench 2.0 CodingLiveBench80.4%–
LiveCodeBenchVals AI–86.4%
SWE-bench (Vals)Vals AI–76.4%†
SWE-Bench ProScale AI SEAL–43.3%
SWE-bench Verified (bash only)SWE-bench–74.2%
SWE-bench Multilingual (bash only)SWE-bench–68.7%
SWE-bench Verified (any scaffold)SWE-bench–77.4%
Code MigrationVals AI44.2%–
Code Migration v1.1Vals AI67.5%–
Vibe Code Bench v1.1Vals AI87.7%14.3%†
Vibe Code Bench 1-100 v1.1Vals AI26.1%–
SWE-Bench Pro (private)Scale AI SEAL–17.9%
CursorBenchCursor47.7%–
ALE-BenchEpoch AI Benchmarking Hub16221176.8
AlgoTuneAlgoTune–1.8
WeirdML v3WeirdML9.2%†–
Terminal-Bench 4.0 (AA)Artificial Analysis33.8%–
GameBench 2 OverallDuelLab GameBench 261.4†–
GameBench 2 by reasoning settingDuelLab GameBench 269.9–
Design Arena WebsiteDesign Arena1295†1244
FrontierCode 1.1 (AA)Artificial Analysis43.7%–
FrontierCode 2.0 (AA)Artificial Analysis28.5%–
LiveCodeBench (AA)Artificial Analysis–91.8%†
Agents & tools
Terminal-BenchTerminal-Bench38.5%69.4%
GDPvalOpenAI–40.3%
Remote Labor IndexScale AI / CAIS–1.3%
APEX-AgentsMercor69.8%–
Arena AgentArena (LMArena)2–
LiveBench Long AgenticLiveBench38.8%–
LiveBench BrowserLiveBench67.2%–
Terminal-Bench HardArtificial Analysis–41.7%†
τ²-Bench Telecom (AA)Artificial Analysis–87.1%†
MCP AtlasScale AI SEAL–70.3%
BFCL OverallBerkeley Function Calling Leaderboard–72.5%
τ²-benchτ²-bench–82.5%†
τ³-bench Bankingτ²-bench–18.0%†
GDPval-AA v2.1, normalised scoreArtificial Analysis62.3%–
GDPval-AA v2.1Artificial Analysis1746–
Finance Agent v2Vals AI57.0%–
Finance Agent v2.1Vals AI62.9%–
Harvey's Legal Agent Benchmark v1.1Vals AI14.2%–
Harvey's Legal Agent Benchmark v1Vals AI9.2%–
Legal Research BenchVals AI45.2%–
Poker AgentVals AI–1078.9%
Tax Agent BenchVals AI44.4%–
Terminal-Bench 2.0 (Vals)Vals AI–55.1%†
Terminal-Bench 4.0 (Vals)Vals AI31.8%–
Arena SearchArena (LMArena)–1201
Arena Agent Task CompletionArena (LMArena)2.3–
BALROGBALROG–58.1%
DeepResearch BenchDeepResearch Bench–46.3%†
METR Time HorizonsMETR–71.0%
Vending-Bench 2Andon Labs–5478.2
AutomationBenchArtificial Analysis66.6%–
GDP.pdf (AA)Artificial Analysis17.2%–
AA-Briefcase v1.1Artificial Analysis1570–
GDPxGDPx by SemiAnalysis5.4%–
Design Arena AgenticDesign Arena1282†1080
Terminal-Bench-Science 0.1 (AA)Artificial Analysis12.9%–
CWE-Bench (AA)Artificial Analysis69.2%–
DeepSec-Bench (AA)Artificial Analysis24.9%–
CyberGym end-to-end (AA)Artificial Analysis76.3%–
MKA (AA)Artificial Analysis38.5%–
Maths
FrontierMath Tiers 1–3Epoch AI Benchmarking Hub71.2%–
FrontierMath Tier 4Epoch AI Benchmarking Hub46.3%–
OTIS Mock AIMEEpoch AI Benchmarking Hub99.4%91.4%
ProofBenchVals AI–20.0%
AIME (Vals)Vals AI–96.7%†
MGSMVals AI–93.9%†
AIME 2026MathArena–91.7%
HMMT February 2026MathArena–86.4%
MathArena ApexMathArena–23.4%
ArXivMathMathArena42.5%–
BrokenArXivMathArena48.7%–
Omni-MATH (HELM)HELM Capabilities–55.6%
MATH 500Vals AI–96.4%†
Arena MathsArena (LMArena)–1475
AIME 2025 (AA)Artificial Analysis–95.7%†
Knowledge
SimpleQA VerifiedEpoch AI Benchmarking Hub42.5%–
LiveBench 2.0 Data AnalysisLiveBench79.5%–
LiveBench ResearchLiveBench78.6%–
AA-Omniscience v1.1Artificial Analysis0.9–
MMLU-ProVals AI–90.1%
LegalBenchVals AI–87.0%†
CorpFinVals AI–63.7%†
TaxEvalVals AI–72.6%†
MedQAVals AI–96.0%†
PRBench FinanceScale AI SEAL47.1%†39.2%
PRBench LegalScale AI SEAL47.3%†40.6%
MultiNRCScale AI SEAL–59.0%
MMLU-Pro (HELM)HELM Capabilities–90.3%
CaseLaw v2Vals AI–53.1%†
Excel Modeling BenchmarkVals AI61.8%–
Excel Modeling Benchmark v1.1Vals AI69.2%–
MedCodeVals AI–52.2%†
MedScribeVals AI–72.0%†
Access to Justice BenchmarkVals AI73.1%–
DrugDiscoveryBenchScale AI SEAL60.6%†–
AA-Omniscience v1.1: accuracyArtificial Analysis39.6%–
AA-Omniscience v1.1: non-hallucinationArtificial Analysis35.9%–
Global-MMLU-Lite (AA)Artificial Analysis–92.2%†
Instruction following
IFBenchArtificial Analysis–70.4%†
MultiChallengeScale AI SEAL74.9%†65.7%
TutorBenchScale AI SEAL–53.7%
IFEval (HELM)HELM Capabilities–87.6%
WildBench (HELM)HELM Capabilities–85.9%
Arena Instruction FollowingArena (LMArena)–1473
Human preference
Arena TextArena (LMArena)–1486
EQ-Bench Creative Writing v3EQ-Bench–1524
Arena Creative WritingArena (LMArena)–1484
Arena Multi-turnArena (LMArena)–1495
Arena Longer QueriesArena (LMArena)–1491
Multimodal
Arena VisionArena (LMArena)–1305
LiveBench DesignLiveBench79.8%–
MMMU-ProArtificial Analysis80.6%80.2%†
VISTAScale AI SEAL–51.5%
MMMU-Pro (Vals)Vals AI–87.5%†
MortgageTaxVals AI–69.1%†
AudioMCScale AI SEAL–54.6%†
AudioMC (text output)Scale AI SEAL–54.6%†
Humanity's Sixth SenseScale AI SEAL30.1%–
VTBScale AI SEAL–26.9%
GeoBenchGeoBench–84.0%
VPCTEpoch AI Benchmarking Hub–91.0%
VIALS-AAHandshake AI40.4%–
Long context
AA-LCR v1.1Artificial Analysis82.7%76.0%†
Arena DocumentArena (LMArena)–1451
MLCRArtificial Analysis26.7%–
Composite
Epoch Capabilities IndexEpoch AI Benchmarking Hub159.4†153.0
LiveBench 2.0LiveBench70.3%–
AA Intelligence Index v5.0.1Artificial Analysis32.6–
AA Intelligence Index v4.3.2Artificial Analysis45.128.0†
AA Progress Index v1Artificial Analysis323.7290.7†
Vals IndexVals AI61.3–
HELM Capabilities meanHELM Capabilities–79.9%
Vals Finance IndexVals AI60.9%–
Vals Router IndexVals AI61.3%†–
Vals Legal IndexVals AI71.9%–
AA Cyber IndexArtificial Analysis56.8–
Safety & honesty
FORTRESSScale AI SEAL27.2%†41.7%
MASKScale AI SEAL–42.6%
PropensityBenchScale AI SEAL–52.9%
Metadata
AA Openness IndexArtificial Analysis44.45.6†

Data as of 2026-11-16. Best configuration of each model; every score links to its source on the model pages.

DuelLab GameBench 2, release gb2-20261111-7b598bb13de4 (https://benchmarks.duellab.org/releases/gb2-20261111-7b598bb13de4/), CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Scores mapped to BenchLeader model names; not endorsed by DuelLab.

What changed

  • DeepSeek V4.1 Flash 1017 (max): 8 new results (LiveBench 2.0, LiveBench Long Agentic, LiveBench 2.0 Reasoning…).
  • Gemini 3 Pro: 1 score revision.
  • DeepSeek V4.1 Flash 1017 (max): BenchLeader Index 58.5 → 58.0.
  • DeepSeek V4.1 Flash 1017 (max): 1 new result (Terminal-Bench); 1 score revision.
  • DeepSeek V4.1 Flash 1017 (max): BenchLeader Index 59.0 → 58.5.
  • DeepSeek V4.1 Flash 1017 (max): 1 score revision.
  • Gemini 3 Pro: 1 new result (Arena Search).
  • DeepSeek V4.1 Flash 1017 (max): 1 score revision.
  • DeepSeek V4.1 Flash 1017 (max): 3 score revisions.
  • DeepSeek V4.1 Flash 1017 (max): 1 new result (ARC-AGI-3); 2 score revisions.

Rankings: Best LLM overall · Best LLM for agents · Best cheap LLMs

DeepSeek V4.1 Flash 1017 vs Gemini 3 Pro: questions

Is DeepSeek V4.1 Flash 1017 better than Gemini 3 Pro?
DeepSeek V4.1 Flash 1017 (max) and Gemini 3 Pro are neck and neck on quality (57.7 vs 60.0, within the ±4.9 margin). The BenchLeader Index combines every independent quality benchmark; the two are within the margin of error as of 16 Nov 2026, so check the category scores for your use.
DeepSeek V4.1 Flash 1017 vs Gemini 3 Pro: which is cheaper, and will that change?
DeepSeek V4.1 Flash 1017 is cheaper today: $0.525 against $4.50 per million tokens, blended at three input tokens per output token. No price change has been announced for either.
Is DeepSeek V4.1 Flash 1017 or Gemini 3 Pro better for coding?
DeepSeek V4.1 Flash 1017 scores higher in coding (63 vs 58 on the category index, where 50 is average). On Arena WebDev, the top shared coding benchmark, it is 1664 for DeepSeek V4.1 Flash 1017 against 1441 for Gemini 3 Pro.
Is DeepSeek V4.1 Flash the same as DeepSeek V4.1 Flash 1017?
DeepSeek V4.1 Flash 1017 is the checkpoint compared here (BenchLeader Index 57.7); people searching for DeepSeek V4.1 Flash land on this page because it replaced that earlier build.
Is DeepSeek V4.1 Flash 1017 or Gemini 3 Pro better for agents and tool use?
Gemini 3 Pro scores higher in agentic tasks (62 vs 58 on the category index, where 50 is average). On Terminal-Bench, the top shared agents & tools benchmark, it is 38.5% for DeepSeek V4.1 Flash 1017 against 69.4% for Gemini 3 Pro.
More questions (2)
Do independent benchmarks agree on DeepSeek V4.1 Flash 1017 vs Gemini 3 Pro?
Across the 7 benchmarks both have, DeepSeek V4.1 Flash 1017 leads 6, Gemini 3 Pro leads 1.
When was DeepSeek V4.1 Flash 1017 released?
DeepSeek V4.1 Flash 1017 was released on 17 Oct 2026.