BenchLeader

Claude Opus 4.7 vs Gemini 3.8 Flash

Full profiles: Claude Opus 4.7 (Anthropic) and Gemini 3.8 Flash (Google): every benchmark, price and rank.

Updated · Data from 12 sources

As of 24 Oct 2026, Claude Opus 4.7 and Gemini 3.8 Flash (high) are neck and neck on quality (63.3 vs 64.4 on the BenchLeader Index, inside the ±4.7 margin of error), and Gemini 3.8 Flash (high) costs 6.7× less, which makes it the better buy for most workloads. Gemini 3.8 Flash (high)'s current price runs until 31 Dec 2026; from 1 Jan 2027 Gemini 3.8 Flash (high) costs 3.3× less ($3.00 vs $10.00 per 1M blended); on use case, pick Claude Opus 4.7 for agents & tools (65 vs 51), Gemini 3.8 Flash for knowledge (68 vs 62).

Which to pick for…

The pick's numbers come first. Category scores on the BenchLeader scale (50 is the average model, 15 points one standard deviation). High confidence means a lead of half a standard deviation or more; under one point is called either.

Use casePickWhyConfidence
CodingGemini 3.8 Flash64 vs 61 category score; Arena WebDev 1585 vs 1555Medium
Agents & tool useClaude Opus 4.765 vs 51 category score; Terminal-Bench 80.2% vs 19.1%High
MathsClaude Opus 4.767 vs 62 category score; Arena Maths 1491 vs 1526Medium
ReasoningGemini 3.8 Flash68 vs 65 category score; Arena Hard Prompts 1517 vs 1519Medium
KnowledgeGemini 3.8 Flash68 vs 62 category score; MMLU-Pro 90.2% vs 89.9%Medium
Images and other mediaEither67 vs 68 category score; Arena Vision 1317 vs 1315Either
Chat quality (human preference)Either68 vs 69 on Arena votesEither
Lowest costGemini 3.8 Flash$1.50 vs $10.00 per 1M blended; agentic coding session $0.060 vs $0.400; from 1 Jan 2027: $3.00 vs $10.00–
Fastest first answerClaude Opus 4.71.2 s (Claude Opus 4.7) vs 25.1 s (Gemini 3.8 Flash (high)) to the first answer token–
High volume on a budgetNeither flagshipA smaller model is usually the better fit: Cheapest good LLMs, Fastest LLMs–

Key differences

  • Claude Opus 4.7 and Gemini 3.8 Flash (high) are neck and neck on quality (63.3 vs 64.4, within the ±4.7 margin).
  • Claude Opus 4.7 is stronger in agents & tools, maths.
  • Gemini 3.8 Flash (high) is stronger in coding, human preference, knowledge, multimodal, reasoning, composite, long context.
  • Gemini 3.8 Flash (high) is 6.7× cheaper ($1.50 vs $10.00 per 1M blended) until 31 Dec 2026, then $3.00 vs $10.00 from 1 Jan 2027.
  • Gemini 3.8 Flash (high) streams 2.4× faster (141 vs 60 tokens per second).

At a glance

SpecClaude Opus 4.7Gemini 3.8 Flash
DeveloperAnthropicGoogle
Released16 Apr 20262 Sept 2026
Context window (tokens)1,000,0001,048,576
Compared atClaude Opus 4.7Gemini 3.8 Flash (high)
Open weightsNoNo
Price in / out / cached input per 1M$5.00 / $25.00 / $0.500$0.750 / $3.75 / $0.075
Announced price changeNone announced$1.50 / $7.50 from 1 Jan 2027

Limits, availability and announced prices from the vendors' own pages: ai.google.dev pricing (checked 20 Oct 2026). Everything else is from the day's data.

Category by category

Category scores on the BenchLeader scale: 50 is the average evaluated model, 15 points is one standard deviation. A gap under one point is called level.

CategoryClaude Opus 4.7Gemini 3.8 Flash (high)Leader
Reasoning64.868.2Gemini 3.8 Flash
Coding61.463.5Gemini 3.8 Flash
Agents & tools65.450.9Claude Opus 4.7
Maths66.762.4Claude Opus 4.7
Knowledge62.368.4Gemini 3.8 Flash
Human preference68.269.1level
Multimodal66.867.7level
Long context–65.7not comparable
Composite–75.3not comparable

Where sources disagree

Across the 33 benchmarks both have, Claude Opus 4.7 leads 13, Gemini 3.8 Flash leads 20. Every overall index that rates both puts Gemini 3.8 Flash ahead.

Overall indexClaude Opus 4.7Gemini 3.8 Flash (high)Leader
BenchLeader Index63.364.4neck and neck
AA Intelligence Index v4.3.230.9†40.9Gemini 3.8 Flash
Arena Text14941496Gemini 3.8 Flash

Each publisher runs its own tasks, harnesses and effort settings, so their overall verdicts can differ; BenchLeader reconciles them on one scale. † measured at another effort setting of the same model (the publisher did not test the one compared here).

Price, speed and latency

List prices blended at three input tokens per output token. Per-task prices use the token counts on the methodology page; suite cost is what Artificial Analysis paid to run its whole Intelligence Index.

MeasureClaude Opus 4.7Gemini 3.8 Flash (high)
Blended price per 1M tokens, until 31 Dec 2026$10.00$1.50
Input / output per 1M$5.00 / $25.00$0.750 / $3.75
Blended price per 1M from 1 Jan 2027$10.00$3.00
Input / output per 1M from 1 Jan 2027$5.00 / $25.00$1.50 / $7.50
Cached input per 1M$0.500$0.075
Price per task: chat reply$0.0095$0.0014
Price per task: summarize a 30-page report$0.075$0.011
Price per task: code edit$0.068$0.010
Price per task: agentic coding session$0.400$0.060
Price per task: structured extraction$0.015$0.0023
Cost to run a full benchmark suite–$1.24
Output speed60 tok/s141 tok/s
Time to first answer1.2 s25.1 s
Time to a complete answer–28.7 s

Each model is compared at its best-ranked reasoning-effort setting. Claude Opus 4.7 scores 63.3 and takes 1 s to its first answer token; Claude Opus 4.7 (max) scores 62.4 in 21 s, Claude Opus 4.7 (high) scores 61.0 in 1 s. Gemini 3.8 Flash (high) scores 64.4 and takes 25 s to its first answer token; Gemini 3.8 Flash (medium) scores 64.4 in 3 s, Gemini 3.8 Flash (low) scores 61.0 in 3 s. Higher effort means more thinking before the answer: better scores, longer waits and more tokens billed. How reasoning effort changes scores and cost.

Every benchmark

163 benchmarks, grouped by category; each name links to the board and its leaders. † measured at another effort setting of the same model, shown for reference and not counted as a win.

MetricPublisherClaude Opus 4.7Gemini 3.8 Flash (high)
BenchLeader IndexBenchLeader63.364.4
Agents & tools scoreBenchLeader65.450.9
Coding scoreBenchLeader61.463.5
Human preference scoreBenchLeader68.269.1
Knowledge scoreBenchLeader62.368.4
Maths scoreBenchLeader66.762.4
Multimodal scoreBenchLeader66.867.7
Reasoning scoreBenchLeader64.868.2
Composite scoreBenchLeader–75.3
Long context scoreBenchLeader–65.7
Blended price $/MBenchLeader$10.00$1.50
Output speedBenchLeader60 tok/s141 tok/s
Time to first answerBenchLeader1.2 s25.1 s
Context windowBenchLeader1,000,000 tokens1,048,576 tokens
Reasoning
GPQA DiamondEpoch AI Benchmarking Hub86.4%†95.4%
Humanity's Last ExamScale AI / CAIS36.2%44.5%†
SimpleBenchSimpleBench61.7%–
Arena Hard PromptsArena (LMArena)15191517
LiveBench 2.0 ReasoningLiveBench–89.3%†
LiveBench 1.0 ReasoningLiveBench87.2%†89.3%
GPQA Diamond (AA)Artificial Analysis91.4%†95.3%
Humanity's Last Exam (AA)Artificial Analysis42.3%†47.8%
GPQA Diamond (Vals)Vals AI90.2%94.4%
Kagi LLM BenchmarkKagi LLM Benchmark73.3%–
ARC-AGI-1ARC Prize–98.5%
ARC-AGI-2ARC Prize–89.2%
ARC-AGI-3ARC Prize0.2%†35.0%
CritPtArtificial Analysis12.0%†18.3%
MysteryMechanismVals AI–36.5%
Chess PuzzlesEpoch AI Benchmarking Hub41.0%†58.0%
Mystery Game PuzzlesEpoch AI Benchmarking Hub13.0%47.0%
LMCAEpoch AI Benchmarking Hub52.2%†51.5%†
DTBenchEpoch AI Benchmarking Hub94.7%†95.7%†
ForecastBenchForecastBench63.1%–
Coding
SWE-bench Verified (Epoch)Epoch AI Benchmarking Hub83.5%†–
SciCodeSciCode54.5%†56.6%
WeirdMLWeirdML76.4%84.8%
FrontierCodeCognition38.5%41.2%†
GSO-BenchGSO-Bench44.1%–
Show all 163 benchmarks
MetricPublisherClaude Opus 4.7Gemini 3.8 Flash (high)
Coding
Arena CodingArena (LMArena)15461528
Arena WebDevArena (LMArena)15551585
LiveBench 2.0 CodingLiveBench–82.2%†
LiveBench 1.0 CodingLiveBench82.1%†72.5%
SciCode (AA)Artificial Analysis–56.6%
LiveCodeBenchVals AI85.1%89.5%
IOIVals AI–56.9%
SWE-bench (Vals)Vals AI82.0%80.0%
Code MigrationVals AI43.9%36.5%
Code Migration v1.1Vals AI–38.6%
ProgramBenchVals AI0.0%1.0%
SWE-bench MultimodalVals AI–40.8%
Vibe Code Bench 1-100Vals AI–18.8%
Vibe Code Bench v1.1Vals AI71.0%78.7%
SWE Atlas: Codebase QnAScale AI SEAL40.3%47.0%†
SWE Atlas: RefactoringScale AI SEAL48.6%44.8%†
SWE Atlas: Test WritingScale AI SEAL38.5%53.7%†
MirrorCodeEpoch AI Benchmarking Hub31.1%†–
Surface Evolver BenchEpoch AI Benchmarking Hub–76.9%
DeepSWE v1.1Epoch AI Benchmarking Hub–73.8%
CursorBenchCursor–39.6%
ALE-BenchEpoch AI Benchmarking Hub1323.01269.7
FrontierSWEEpoch AI Benchmarking Hub–19.6%
Terminal-Bench 4.0 (AA)Artificial Analysis–19.7%
Terminal-Bench 2.1 (AA)Artificial Analysis83.2%†87.6%
Startrise FrontendStartrise–64.6%†
FrontierCode 1.1 (AA)Artificial Analysis–36.4%
Agents & tools
Terminal-BenchTerminal-Bench80.2%19.1%
OSWorld-Verified 2.0OSWorld18.2%†–
Remote Labor IndexScale AI / CAIS–5.8%†
APEX-AgentsMercor49.2%†64.3%†
Arena AgentArena (LMArena)–3.6
LiveBench Long AgenticLiveBench–30.1%†
LiveBench BrowserLiveBench–64.0%†
LiveBench Agentic CodingLiveBench50.7%†54.2%
Terminal-Bench HardArtificial Analysis51.5%†–
τ²-Bench Telecom (AA)Artificial Analysis88.6%†–
Terminal-Bench 2.1 (Vals)Vals AI68.5%81.3%
MCP AtlasScale AI SEAL79.1%†–
HiL-BenchScale AI SEAL41.7%41.5%†
τ³-bench Bankingτ²-bench40.2%†–
GDPval-AA v2.1Artificial Analysis–46.8%
τ³-Banking (AA)Artificial Analysis34.6%†45.0%
ITBench SRE (AA)Artificial Analysis46.7%†52.5%
Analyst Agent (AA)Artificial Analysis43.8%†46.3%
CUA-benchVals AI–4.2%
CyberBenchVals AI–43.8%
Finance Agent v2Vals AI51.5%61.4%
Finance Agent v2.1Vals AI–65.8%
Harvey's Legal Agent Benchmark v1.1Vals AI–12.1%
Harvey's Legal Agent Benchmark v1Vals AI6.7%10.0%
Legal Research BenchVals AI38.5%38.9%
SkillsBenchVals AI–58.0%
SREBenchVals AI–11.1%
Tax Agent BenchVals AI23.7%32.1%
Terminal-Bench 2.0 (Vals)Vals AI68.5%–
Terminal-Bench 4.0 (Vals)Vals AI–19.7%
Terminal-Bench ScienceVals AI–8.6%
Time Horizon Index: KSPVals AI–18.8%
Arena SearchArena (LMArena)1210–
PostTrainBenchEpoch AI Benchmarking Hub28.6%†–
ExploitBenchEpoch AI Benchmarking Hub26.5%–
GBAEvalEpoch AI Benchmarking Hub43.8%–
Vending-Bench 2Andon Labs10936.85093.8†
AutomationBenchArtificial Analysis–59.9%
GDP.pdf (AA)Artificial Analysis–21.0%
Harvey LAB-AA v1.1Harvey–0.0%
AA-Briefcase v1.1Artificial Analysis–1202
Terminal-Bench-Science 0.1 (AA)Artificial Analysis–10.0%
CWE-Bench (AA)Artificial Analysis–52.5%
DeepSec-Bench (AA)Artificial Analysis–14.5%
CyberGym end-to-end (AA)Artificial Analysis–8.4%
FACTS SearchGoogle–76.3%†
Maths
FrontierMath Tiers 1–3Epoch AI Benchmarking Hub70.2%†68.4%
FrontierMath Tier 4Epoch AI Benchmarking Hub31.7%†21.9%
OTIS Mock AIMEEpoch AI Benchmarking Hub86.7%†98.9%
ProofBenchVals AI54.0%†48.0%†
LiveBench MathematicsLiveBench92.8%†91.6%
AIME (Vals)Vals AI96.3%–
AIME 2026MathArena95.8%†–
HMMT February 2026MathArena93.9%†–
MathArena ApexMathArena40.6%†–
Arena MathsArena (LMArena)14911526
Knowledge
SimpleQA VerifiedEpoch AI Benchmarking Hub51.7%†69.7%
LiveBench 2.0 Data AnalysisLiveBench–54.0%†
LiveBench ResearchLiveBench–79.1%†
LiveBench 1.0 Data AnalysisLiveBench78.3%†54.0%
AA-OmniscienceArtificial Analysis27.3†29.6
MMLU-ProVals AI89.9%90.2%
LegalBenchVals AI85.3%87.0%
CorpFinVals AI66.1%–
TaxEvalVals AI75.3%74.5%
PRBench FinanceScale AI SEAL–49.5%†
PRBench LegalScale AI SEAL–48.9%†
BioMysteryBenchVals AI–62.2%
CaseLaw v2Vals AI68.4%–
Excel Modeling BenchmarkVals AI63.7%72.2%
Excel Modeling Benchmark v1.1Vals AI–72.9%
MedCodeVals AI54.9%48.1%
MedScribeVals AI83.0%84.5%
Public Benefits Bench v1.1Vals AI–65.3%
EBR-benchEpoch AI Benchmarking Hub19.1%†–
GDP.pdfEpoch AI Benchmarking Hub21.0%†23.2%
AA-Omniscience: accuracyArtificial Analysis48.9%†54.6%
AA-Omniscience: non-hallucinationArtificial Analysis57.7%†44.8%
Instruction following
LiveBench LanguageLiveBench77.9%†87.8%
LiveBench Instruction FollowingLiveBench66.7%†81.4%
IFBenchArtificial Analysis58.6%†–
Arena Instruction FollowingArena (LMArena)14931490
Human preference
Arena TextArena (LMArena)14941496
EQ-Bench 4EQ-Bench1311–
Arena Creative WritingArena (LMArena)14821485
Arena Multi-turnArena (LMArena)15141504
Arena Longer QueriesArena (LMArena)15081510
Multimodal
Arena VisionArena (LMArena)13171315
LiveBench DesignLiveBench–72.7%†
MMMU-ProArtificial Analysis78.8%†85.6%
MMMU-Pro (Vals)Vals AI85.5%89.1%
MortgageTaxVals AI70.3%65.3%
SAGEVals AI56.1%35.1%
AudioMCScale AI SEAL–60.4%
AudioMC (text output)Scale AI SEAL–60.4%
Blueprint-Bench 2Epoch AI Benchmarking Hub24.5%38.6%†
AA-3DArtificial Analysis–969
Long context
AA-LCRArtificial Analysis78.7%†81.3%
Arena DocumentArena (LMArena)1494–
MLCRArtificial Analysis–10.6%
Composite
Epoch Capabilities IndexEpoch AI Benchmarking Hub156.8157.4†
LiveBench 2.0LiveBench–67.3%†
LiveBench 1.0LiveBench76.5%†75.8%
AA Intelligence Index v4.3.2Artificial Analysis40.7†40.9
Vals IndexVals AI–56.0
Vals Finance IndexVals AI–60.5%
Vals RSI IndexVals AI19.1%†19.9%
Vals Science IndexVals AI–35.8%
Vals Multimodal IndexVals AI67.4%–
Vals Router IndexVals AI–56.0%†
AA Cyber IndexArtificial Analysis–25.1

Data as of 2026-10-24. Best configuration of each model; every score links to its source on the model pages.

What changed

  • Gemini 3.8 Flash: list price moves to $1.50 / $7.50 per 1M input / output tokens (announced).
  • Claude Opus 4.7: 1 new result (Harvey's Legal Agent Benchmark v1).
  • Gemini 3.8 Flash (high): 8 new results (Code Migration v1.1, Excel Modeling Benchmark v1.1, Finance Agent v2.1…).
  • Gemini 3.8 Flash (high): 1 score revision.
  • Claude Opus 4.7: 1 score revision.
  • Gemini 3.8 Flash (high): 3 score revisions.
  • Gemini 3.8 Flash (high): BenchLeader Index 63.7 → 64.5.
  • Claude Opus 4.7: 1 score revision.
  • Gemini 3.8 Flash (high): 1 new result (AudioMC (text output)).
  • Claude Opus 4.7: 1 score revision.

Rankings: Best LLM overall · Best LLM for agents · Best cheap LLMs

Claude Opus 4.7 vs Gemini 3.8 Flash: questions

Is Claude Opus 4.7 better than Gemini 3.8 Flash?
Claude Opus 4.7 and Gemini 3.8 Flash (high) are neck and neck on quality (63.3 vs 64.4, within the ±4.7 margin). The BenchLeader Index combines every independent quality benchmark; the two are within the margin of error as of 2026-10-24, so check the category scores for your use.
Which is cheaper, Claude Opus 4.7 or Gemini 3.8 Flash, and will that change?
Gemini 3.8 Flash is cheaper today: $1.50 against $10.00 per million tokens, blended at three input tokens per output token. Yes, that changes: Gemini 3.8 Flash's list price changes on 1 Jan 2027, and from then Gemini 3.8 Flash is cheaper ($3.00 vs $10.00 blended).
Is Claude Opus 4.7 better than Gemini 3.8 Flash for coding?
Gemini 3.8 Flash scores higher in coding (64 vs 61 on the category index, where 50 is average). On Arena WebDev, the top shared coding benchmark, it is 1555 for Claude Opus 4.7 against 1585 for Gemini 3.8 Flash.
Is Claude Opus 4.7 better than Gemini 3.8 Flash for agents and tool use?
Claude Opus 4.7 scores higher in agentic tasks (65 vs 51 on the category index, where 50 is average). On Terminal-Bench, the top shared agents & tools benchmark, it is 80.2% for Claude Opus 4.7 against 19.1% for Gemini 3.8 Flash.
Which is better for long documents?
Both take about 1M tokens: Claude Opus 4.7 1,000,000, Gemini 3.8 Flash 1,048,576.
Which has lower latency?
Claude Opus 4.7 answers first: 1.2 s against 25.1 s to the first answer token, as Artificial Analysis measures it. Reasoning effort drives most of this: a higher setting thinks longer before it answers.
Which is faster, Claude Opus 4.7 or Gemini 3.8 Flash?
Gemini 3.8 Flash streams faster: 141 against 60 output tokens per second.
Do independent benchmarks agree on Claude Opus 4.7 vs Gemini 3.8 Flash?
Across the 33 benchmarks both have, Claude Opus 4.7 leads 13, Gemini 3.8 Flash leads 20. Every overall index that rates both puts Gemini 3.8 Flash ahead.
When was Gemini 3.8 Flash released?
Gemini 3.8 Flash was released on 2 Sept 2026.