BenchLeader

Claude Opus 4.7 vs Gemini 3.5 Flash

Full profiles: Claude Opus 4.7 (Anthropic) and Gemini 3.5 Flash (Google): every benchmark, price and rank.

Updated · Data from 11 sources

As of 25 Oct 2026, Claude Opus 4.7 and Gemini 3.5 Flash (high) are neck and neck on quality (63.2 vs 63.1 on the BenchLeader Index, inside the ±3.8 margin of error), and Gemini 3.5 Flash (high) costs 3.0× less, which makes it the better buy for most workloads. Pick Claude Opus 4.7 for maths (67 vs 58); pick Gemini 3.5 Flash for knowledge (65 vs 62).

Which to pick for…

The pick's numbers come first. Category scores on the BenchLeader scale (50 is the average model, 15 points one standard deviation). High confidence means a lead of half a standard deviation or more; under one point is called either.

Use casePickWhyConfidence
CodingClaude Opus 4.761 vs 60 category score; Arena WebDev 1555 vs 1499Medium
Agents & tool useClaude Opus 4.765 vs 63 category score; Terminal-Bench 2.1 (Vals) 68.5% vs 74.2%Medium
MathsClaude Opus 4.767 vs 58 category score; Arena Maths 1491 vs 1497High
ReasoningClaude Opus 4.765 vs 61 category score; Arena Hard Prompts 1519 vs 1495Medium
KnowledgeGemini 3.5 Flash65 vs 62 category score; MMLU-Pro 89.5% vs 89.9%Medium
Images and other mediaEither67 vs 67 category score; Arena Vision 1317 vs 1308Either
Chat quality (human preference)Either68 vs 67 on Arena votesEither
Lowest costGemini 3.5 Flash$3.38 vs $10.00 per 1M blended; agentic coding session $0.126 vs $0.400–
Fastest first answerClaude Opus 4.71.2 s (Claude Opus 4.7) vs 14.2 s (Gemini 3.5 Flash (high)) to the first answer token–
High volume on a budgetNeither flagshipA smaller model is usually the better fit: Cheapest good LLMs, Fastest LLMs–

Key differences

  • Claude Opus 4.7 and Gemini 3.5 Flash (high) are neck and neck on quality (63.2 vs 63.1, within the ±3.8 margin).
  • Claude Opus 4.7 is stronger in agents & tools, coding, human preference, maths, multimodal, reasoning.
  • Gemini 3.5 Flash (high) is stronger in knowledge, composite, instruction following, long context.
  • Gemini 3.5 Flash (high) is 3.0× cheaper ($3.38 vs $10.00 per 1M blended).
  • Gemini 3.5 Flash (high) streams 3.7× faster (222 vs 60 tokens per second).

At a glance

SpecClaude Opus 4.7Gemini 3.5 Flash
DeveloperAnthropicGoogle
Released16 Apr 202619 May 2026
Context window (tokens)1,000,0001,048,576
Compared atClaude Opus 4.7Gemini 3.5 Flash (high)
Open weightsNoNo
Price in / out / cached input per 1M$5.00 / $25.00 / $0.500$1.50 / $9.00 / $0.150

Category by category

Category scores on the BenchLeader scale: 50 is the average evaluated model, 15 points is one standard deviation. A gap under one point is called level.

CategoryClaude Opus 4.7Gemini 3.5 Flash (high)Leader
Reasoning64.861.3Claude Opus 4.7
Coding61.459.8Claude Opus 4.7
Agents & tools65.463.4Claude Opus 4.7
Maths66.758.3Claude Opus 4.7
Knowledge62.365.2Gemini 3.5 Flash
Instruction following–74.3not comparable
Human preference67.566.8level
Multimodal66.866.6level
Long context–61.6not comparable
Composite–65.9not comparable

Where sources disagree

Across the 36 benchmarks both have, Claude Opus 4.7 leads 27, Gemini 3.5 Flash leads 8 and 1 is a tie. Independent sources split: Claude Opus 4.7 leads on Arena Text; Gemini 3.5 Flash leads on AA Intelligence Index v4.3.2.

Overall indexClaude Opus 4.7Gemini 3.5 Flash (high)Leader
BenchLeader Index63.263.1neck and neck
AA Intelligence Index v4.3.230.9†32.6Gemini 3.5 Flash
Arena Text14941477Claude Opus 4.7

Each publisher runs its own tasks, harnesses and effort settings, so their overall verdicts can differ; BenchLeader reconciles them on one scale. † measured at another effort setting of the same model (the publisher did not test the one compared here).

Price, speed and latency

List prices blended at three input tokens per output token. Per-task prices use the token counts on the methodology page; suite cost is what Artificial Analysis paid to run its whole Intelligence Index.

MeasureClaude Opus 4.7Gemini 3.5 Flash (high)
Blended price per 1M tokens$10.00$3.38
Input / output per 1M$5.00 / $25.00$1.50 / $9.00
Cached input per 1M$0.500$0.150
Price per task: chat reply$0.0095$0.0033
Price per task: summarize a 30-page report$0.075$0.023
Price per task: code edit$0.068$0.022
Price per task: agentic coding session$0.400$0.126
Price per task: structured extraction$0.015$0.0048
Cost to run a full benchmark suite–$3.69
Output speed60 tok/s222 tok/s
Time to first answer1.2 s14.2 s
Time to a complete answer–16.4 s

Each model is compared at its best-ranked reasoning-effort setting. Claude Opus 4.7 scores 63.2 and takes 1 s to its first answer token; Claude Opus 4.7 (max) scores 62.4 in 23 s, Claude Opus 4.7 (high) scores 61.0 in 1 s. Gemini 3.5 Flash (high) scores 63.1 and takes 14 s to its first answer token; Gemini 3.5 Flash (medium) scores 62.8 in 12 s, Gemini 3.5 Flash (minimal) scores 56.4 in 1 s. Higher effort means more thinking before the answer: better scores, longer waits and more tokens billed. How reasoning effort changes scores and cost.

Every benchmark

125 benchmarks, grouped by category; each name links to the board and its leaders. † measured at another effort setting of the same model, shown for reference and not counted as a win.

MetricPublisherClaude Opus 4.7Gemini 3.5 Flash (high)
BenchLeader IndexBenchLeader63.263.1
Agents & tools scoreBenchLeader65.463.4
Coding scoreBenchLeader61.459.8
Human preference scoreBenchLeader67.566.8
Knowledge scoreBenchLeader62.365.2
Maths scoreBenchLeader66.758.3
Multimodal scoreBenchLeader66.866.6
Reasoning scoreBenchLeader64.861.3
Composite scoreBenchLeader–65.9
Instruction following scoreBenchLeader–74.3
Long context scoreBenchLeader–61.6
Blended price $/MBenchLeader$10.00$3.38
Output speedBenchLeader60 tok/s222 tok/s
Time to first answerBenchLeader1.2 s14.2 s
Context windowBenchLeader1,000,000 tokens1,048,576 tokens
Reasoning
GPQA DiamondEpoch AI Benchmarking Hub86.4%†92.8%
Humanity's Last ExamScale AI / CAIS36.2%–
SimpleBenchSimpleBench61.7%76.7%†
Arena Hard PromptsArena (LMArena)15191495
LiveBench 1.0 ReasoningLiveBench87.2%†82.0%
GPQA Diamond (AA)Artificial Analysis91.4%†92.2%
Humanity's Last Exam (AA)Artificial Analysis42.3%†42.7%
GPQA Diamond (Vals)Vals AI90.2%92.7%
EnigmaEvalScale AI SEAL–25.4%
Kagi LLM BenchmarkKagi LLM Benchmark73.3%–
ARC-AGI-1ARC Prize–92.5%
ARC-AGI-2ARC Prize–72.1%
ARC-AGI-3ARC Prize0.2%†–
CritPtArtificial Analysis12.0%†13.1%
Chess PuzzlesEpoch AI Benchmarking Hub41.0%†45.0%
Mystery Game PuzzlesEpoch AI Benchmarking Hub13.0%32.0%
LMCAEpoch AI Benchmarking Hub52.2%†47.1%
DTBenchEpoch AI Benchmarking Hub94.7%†94.7%
ForecastBenchForecastBench63.1%64.3%†
Coding
SWE-bench Verified (Epoch)Epoch AI Benchmarking Hub83.5%†79.3%
SciCodeSciCode54.5%†53.9%
WeirdMLWeirdML76.4%62.6%
FrontierCodeCognition38.5%–
GSO-BenchGSO-Bench44.1%–
Arena CodingArena (LMArena)15461508
Show all 125 benchmarks
MetricPublisherClaude Opus 4.7Gemini 3.5 Flash (high)
Coding
Arena WebDevArena (LMArena)15551499
LiveBench 1.0 CodingLiveBench82.1%†78.2%
SciCode (AA)Artificial Analysis–53.9%
LiveCodeBenchVals AI85.1%87.6%
SWE-bench (Vals)Vals AI82.0%78.8%
Code MigrationVals AI43.9%26.8%
ProgramBenchVals AI0.0%0.0%
Vibe Code Bench v1.1Vals AI71.0%48.7%
SWE Atlas: Codebase QnAScale AI SEAL40.3%–
SWE Atlas: RefactoringScale AI SEAL48.6%–
SWE Atlas: Test WritingScale AI SEAL38.5%–
MirrorCodeEpoch AI Benchmarking Hub31.1%†–
Surface Evolver BenchEpoch AI Benchmarking Hub–58.1%†
DeepSWE v1.1Epoch AI Benchmarking Hub–36.1%
ALE-BenchEpoch AI Benchmarking Hub1323.0911.0
Terminal-Bench 4.0 (AA)Artificial Analysis–6.6%
Terminal-Bench 2.1 (AA)Artificial Analysis83.2%†78.7%
Agents & tools
Terminal-BenchTerminal-Bench80.2%–
OSWorld-Verified 2.0OSWorld18.2%†–
APEX-AgentsMercor49.2%†27.5%†
LiveBench Agentic CodingLiveBench50.7%†49.0%
Terminal-Bench HardArtificial Analysis51.5%†40.9%
τ²-Bench Telecom (AA)Artificial Analysis88.6%†95.3%
Terminal-Bench 2.1 (Vals)Vals AI68.5%74.2%
MCP AtlasScale AI SEAL79.1%†83.6%
HiL-BenchScale AI SEAL41.7%27.7%†
τ³-bench Bankingτ²-bench40.2%†–
τ³-Banking (AA)Artificial Analysis34.6%†32.2%
ITBench SRE (AA)Artificial Analysis46.7%†40.4%
Analyst Agent (AA)Artificial Analysis43.8%†45.0%
APEX-Agents (AA)Artificial Analysis–47.0%
Finance Agent v2Vals AI51.5%57.9%
Harvey's Legal Agent Benchmark v1Vals AI6.7%2.5%
Legal Research BenchVals AI38.5%30.8%
SkillsBenchVals AI–52.7%
Tax Agent BenchVals AI23.7%21.6%
Terminal-Bench 2.0 (Vals)Vals AI68.5%67.4%
Terminal-Bench 4.0 (Vals)Vals AI–6.1%
Terminal-Bench ScienceVals AI–5.7%
Web Search IndexVals AI–37.0%
Arena SearchArena (LMArena)1210–
PostTrainBenchEpoch AI Benchmarking Hub28.6%†–
ExploitBenchEpoch AI Benchmarking Hub26.5%–
GBAEvalEpoch AI Benchmarking Hub43.8%6.7%†
Vending-Bench 2Andon Labs10936.85396.4†
AutomationBenchArtificial Analysis–42.1%
GDP.pdf (AA)Artificial Analysis–19.8%
EnterpriseOps-GymArtificial Analysis–50.1%
AA-Briefcase v1.1Artificial Analysis–874
FACTS SearchGoogle–64.3%†
Maths
FrontierMath Tiers 1–3Epoch AI Benchmarking Hub70.2%†62.8%
FrontierMath Tier 4Epoch AI Benchmarking Hub31.7%†26.8%
OTIS Mock AIMEEpoch AI Benchmarking Hub86.7%†95.6%
ProofBenchVals AI54.0%†31.0%
LiveBench MathematicsLiveBench92.8%†88.2%
AIME (Vals)Vals AI96.3%–
AIME 2026MathArena95.8%†95.0%†
HMMT February 2026MathArena93.9%†95.5%†
MathArena ApexMathArena40.6%†32.3%†
Arena MathsArena (LMArena)14911497
Knowledge
SimpleQA VerifiedEpoch AI Benchmarking Hub51.7%†66.2%
LiveBench 1.0 Data AnalysisLiveBench78.3%†64.9%
AA-OmniscienceArtificial Analysis27.3†21.2
MMLU-ProVals AI89.9%89.5%
LegalBenchVals AI85.3%83.6%
CorpFinVals AI66.1%64.7%
TaxEvalVals AI75.3%74.4%
CaseLaw v2Vals AI68.4%–
Excel Modeling BenchmarkVals AI63.7%63.5%
MedCodeVals AI54.9%55.8%
MedScribeVals AI83.0%76.6%
Public Benefits Bench v1.1Vals AI–59.5%
DrugDiscoveryBenchScale AI SEAL–50.0%
EBR-benchEpoch AI Benchmarking Hub19.1%†4.8%
GDP.pdfEpoch AI Benchmarking Hub21.0%†14.0%†
AA-Omniscience: accuracyArtificial Analysis48.9%†51.4%
AA-Omniscience: non-hallucinationArtificial Analysis57.7%†37.8%
Instruction following
LiveBench LanguageLiveBench77.9%†84.6%
LiveBench Instruction FollowingLiveBench66.7%†75.6%
IFBenchArtificial Analysis58.6%†76.3%
Arena Instruction FollowingArena (LMArena)14931465
Human preference
Arena TextArena (LMArena)14941477
EQ-Bench 4EQ-Bench12941081†
Arena Creative WritingArena (LMArena)14821464
Arena Multi-turnArena (LMArena)15141480
Arena Longer QueriesArena (LMArena)15081482
Multimodal
Arena VisionArena (LMArena)13171308
MMMU-ProArtificial Analysis78.8%†84.3%
MMMU-Pro (Vals)Vals AI85.5%88.3%
MortgageTaxVals AI70.3%68.1%
SAGEVals AI56.1%49.9%
Blueprint-Bench 2Epoch AI Benchmarking Hub24.5%33.6%†
Long context
AA-LCRArtificial Analysis78.7%†73.3%
Arena DocumentArena (LMArena)14941453
MLCRArtificial Analysis–10.0%
Composite
Epoch Capabilities IndexEpoch AI Benchmarking Hub156.8154.9†
LiveBench 1.0LiveBench76.5%†74.6%
AA Intelligence Index v4.3.2Artificial Analysis40.7†32.6
Vals RSI IndexVals AI19.1%†–
Vals Multimodal IndexVals AI67.4%62.9%

Data as of 2026-10-25. Best configuration of each model; every score links to its source on the model pages.

What changed

  • Claude Opus 4.7: 1 score revision.
  • Claude Opus 4.7: 1 new result (Harvey's Legal Agent Benchmark v1).
  • Gemini 3.5 Flash (high): 1 new result (Harvey's Legal Agent Benchmark v1).
  • Gemini 3.5 Flash (high): 1 score revision.
  • Claude Opus 4.7: 1 score revision.
  • Gemini 3.5 Flash (high): BenchLeader Index 62.5 → 63.2.
  • Claude Opus 4.7: 1 score revision.
  • Gemini 3.5 Flash (high): 3 new results (GDPval-AA v2.1, AA-Omniscience: accuracy, AA-Omniscience: non-hallucination).
  • Claude Opus 4.7: 1 score revision.
  • Gemini 3.5 Flash (high): 1 score revision.

Rankings: Best LLM overall · Best LLM for agents · Best cheap LLMs

Claude Opus 4.7 vs Gemini 3.5 Flash: questions

Is Claude Opus 4.7 better than Gemini 3.5 Flash?
Claude Opus 4.7 and Gemini 3.5 Flash (high) are neck and neck on quality (63.2 vs 63.1, within the ±3.8 margin). The BenchLeader Index combines every independent quality benchmark; the two are within the margin of error as of 2026-10-25, so check the category scores for your use.
Which is cheaper, Claude Opus 4.7 or Gemini 3.5 Flash, and will that change?
Gemini 3.5 Flash is cheaper today: $3.38 against $10.00 per million tokens, blended at three input tokens per output token. No price change has been announced for either.
Is Claude Opus 4.7 better than Gemini 3.5 Flash for coding?
Claude Opus 4.7 scores higher in coding (61 vs 60 on the category index, where 50 is average). On Arena WebDev, the top shared coding benchmark, it is 1555 for Claude Opus 4.7 against 1499 for Gemini 3.5 Flash.
Is Claude Opus 4.7 better than Gemini 3.5 Flash for agents and tool use?
Claude Opus 4.7 scores higher in agentic tasks (65 vs 63 on the category index, where 50 is average). On Terminal-Bench 2.1 (Vals), the top shared agents & tools benchmark, it is 68.5% for Claude Opus 4.7 against 74.2% for Gemini 3.5 Flash.
Which is better for long documents?
Both take about 1M tokens: Claude Opus 4.7 1,000,000, Gemini 3.5 Flash 1,048,576.
Which has lower latency?
Claude Opus 4.7 answers first: 1.2 s against 14.2 s to the first answer token, as Artificial Analysis measures it. Reasoning effort drives most of this: a higher setting thinks longer before it answers.
Which is faster, Claude Opus 4.7 or Gemini 3.5 Flash?
Gemini 3.5 Flash streams faster: 222 against 60 output tokens per second.
Do independent benchmarks agree on Claude Opus 4.7 vs Gemini 3.5 Flash?
Across the 36 benchmarks both have, Claude Opus 4.7 leads 27, Gemini 3.5 Flash leads 8 and 1 is a tie. Independent sources split: Claude Opus 4.7 leads on Arena Text; Gemini 3.5 Flash leads on AA Intelligence Index v4.3.2.
When was Gemini 3.5 Flash released?
Gemini 3.5 Flash was released on 19 May 2026.