BenchLeader

Gemini 3.8 Flash vs Step 5 Preview

Full profiles: Gemini 3.8 Flash (Google) and Step 5 Preview (StepFun): every benchmark, price and rank.

Updated · Data from 12 sources

As of 6 Nov 2026, Gemini 3.8 Flash is ahead of Step 5 Preview on quality (62.0 vs 54.9 on the BenchLeader Index), and they cost about the same at $1.50 vs $1.43 per 1M tokens blended. Choose Gemini 3.8 Flash for reasoning (64 vs 53), coding (60 vs 50), and knowledge (65 vs 55); choose Step 5 Preview for long context (69 vs 66). Gemini 3.8 Flash's current price runs until 31 Dec 2026, then $3.00.

Key facts (as of 6 Nov 2026)

  • Gemini 3.8 Flash scores 62.0 on the BenchLeader Index and Step 5 Preview scores 54.9 (BenchLeader, 6 Nov 2026).
  • Gemini 3.8 Flash costs $1.50 per 1M tokens blended until 31 Dec 2026, then $3.00 (https://ai.google.dev/gemini-api/docs/pricing, checked 20 Oct 2026).
  • Step 5 Preview costs $1.43 per 1M tokens blended (list price, 6 Nov 2026).
  • Of the 59 benchmarks both models have, Gemini 3.8 Flash leads 37 (BenchLeader, 6 Nov 2026).

Which to pick for…

The pick's numbers come first. Category scores on the BenchLeader scale (50 is the average model, 15 points one standard deviation). High confidence means a lead of half a standard deviation or more; under one point is called either.

Use casePickWhyConfidence
CodingGemini 3.8 Flash60 vs 50 category score; FrontierCode 2.0 (AA) 18.7% vs 12.0%High
Agents & tool useEither51 vs 51 category score; Arena Agent 2.6 vs -2.9Either
MathsGemini 3.8 Flash62 vs 60 category score; Arena Maths 1524 vs 1466Medium
ReasoningGemini 3.8 Flash64 vs 53 category score; HLE-Diamond (AA) 33.1% vs 24.3%High
KnowledgeGemini 3.8 Flash65 vs 55 category score; AA-Omniscience v1.1 23.3 vs 16.4High
Long documentsStep 5 Preview69 vs 66 category score; AA-LCR v1.1 88.3% vs 81.3%Medium
Images and other mediaGemini 3.8 Flash67 vs 59 category score; Arena Vision 1315 vs 1265High
Chat quality (human preference)Gemini 3.8 Flash69 vs 63 on Arena votesMedium
Lowest costEither$1.50 vs $1.43 per 1M blended; agentic coding session $0.060 vs $0.071; from 1 Jan 2027: $3.00 vs $1.43–
Fastest first answerEither21.6 s (Gemini 3.8 Flash (high)) vs 25.9 s (Step 5 Preview) to the first answer token–
High volume on a budgetNeither flagshipA smaller model is usually the better fit: Cheapest good LLMs, Fastest LLMs–

Key differences

  • Gemini 3.8 Flash (high) leads on quality: 62.0 vs 54.9.
  • Gemini 3.8 Flash (high) is stronger in agents & tools, coding, human preference, knowledge, maths, multimodal, reasoning.
  • Step 5 Preview is stronger in long context, composite.
  • They cost about the same ($1.43 per 1M blended) until 31 Dec 2026, then $1.43 vs $3.00 from 1 Jan 2027.

At a glance

SpecGemini 3.8 FlashStep 5 Preview
DeveloperGoogleStepFun
Released2 Sep 202618 Sep 2026
Context window (tokens)1,048,5761,000,000
Compared atGemini 3.8 Flash (high)Step 5 Preview
Open weightsNoYes
Price in / out / cached input per 1M$0.750 / $3.75 / $0.075$1.00 / $2.70 / $0.105
Announced price change$1.50 / $7.50 from 1 Jan 2027None announced

Limits, availability and announced prices from the vendors' own pages: ai.google.dev pricing (checked 20 Oct 2026). Everything else is from the day's data.

Category by category

Category scores on the BenchLeader scale: 50 is the average evaluated model, 15 points is one standard deviation. A gap under one point is called level.

CategoryGemini 3.8 Flash (high)Step 5 PreviewLeader
Reasoning64.052.7Gemini 3.8 Flash
Coding60.350.2Gemini 3.8 Flash
Agents & tools51.150.6level
Maths62.159.7Gemini 3.8 Flash
Knowledge64.755.2Gemini 3.8 Flash
Human preference69.063.2Gemini 3.8 Flash
Multimodal67.459.4Gemini 3.8 Flash
Long context65.569.2Step 5 Preview
Composite–40.8not comparable

On one chart

Each domain on the index's own scale, where 50 is an average model. Click a domain to see the benchmarks behind it. Pick up to 5 models from the list.

2550 avg75ReasoningCodingAgents & toolsMathsKnowledgeLong contextMultimodalHumanpreferenceGemini 3.8 Flash, Reasoning: 64.0Gemini 3.8 Flash, Coding: 60.3Gemini 3.8 Flash, Agents & tools: 51.1Gemini 3.8 Flash, Maths: 62.1Gemini 3.8 Flash, Knowledge: 64.7Gemini 3.8 Flash, Long context: 65.5Gemini 3.8 Flash, Multimodal: 67.4Gemini 3.8 Flash, Human preference: 69.0Step 5 Preview, Reasoning: 52.7Step 5 Preview, Coding: 50.2Step 5 Preview, Agents & tools: 50.6Step 5 Preview, Maths: 59.7Step 5 Preview, Knowledge: 55.2Step 5 Preview, Long context: 69.2Step 5 Preview, Multimodal: 59.4Step 5 Preview, Human preference: 63.2

Not drawn, measured for fewer than two of these models: Instruction following.

ModelIndex

Where sources disagree

Across the 59 benchmarks both have, Gemini 3.8 Flash leads 37, Step 5 Preview leads 20 and 2 are tied. Every overall index that rates both puts Gemini 3.8 Flash ahead.

Overall indexGemini 3.8 Flash (high)Step 5 PreviewLeader
BenchLeader Index62.054.9Gemini 3.8 Flash
AA Intelligence Index v5.030.928.5Gemini 3.8 Flash
Vals Index56.054.8Gemini 3.8 Flash
Arena Text14961448Gemini 3.8 Flash

Each publisher runs its own tasks, harnesses and effort settings, so their overall verdicts can differ; BenchLeader reconciles them on one scale. † measured at another effort setting of the same model (the publisher did not test the one compared here).

Price, speed and latency

List prices blended at three input tokens per output token. Per-task prices use the token counts on the methodology page. Cost, tokens and time per benchmark task are measured: Artificial Analysis’ averages over its whole Intelligence Index run.

MeasureGemini 3.8 Flash (high)Step 5 Preview
Blended price per 1M tokens, until 31 Dec 2026$1.50$1.43
Input / output per 1M$0.750 / $3.75$1.00 / $2.70
Blended price per 1M from 1 Jan 2027$3.00$1.43
Input / output per 1M from 1 Jan 2027$1.50 / $7.50$1.00 / $2.70
Cached input per 1M$0.075$0.105
Price per task: chat reply$0.0014$0.0012
Price per task: summarize a 30-page report$0.011$0.014
Price per task: code edit$0.010$0.010
Price per task: agentic coding session$0.060$0.071
Price per task: structured extraction$0.0023$0.0025
Agentic coding session, input mostly cached$0.030$0.030
Cost per benchmark task (AA Index)$7.77$2.35
Output tokens per task (AA Index)99k113k
Of which reasoning60k80k
Time per task (AA Index)14 min14 min
Output speed115 tok/s132 tok/s
Time to first answer21.6 s25.9 s
Time to a complete answer76.8 s57.3 s

Per token is not per task: an average task of Artificial Analysis' Intelligence Index cost $7.77 on Gemini 3.8 Flash (high) and $2.35 on Step 5 Preview, and Step 5 Preview wrote 1.1× as many output tokens for the same work.

Each model is compared at its best-ranked reasoning-effort setting. Gemini 3.8 Flash (high) scores 62.0 and takes 22 s to its first answer token; Gemini 3.8 Flash (medium) scores 60.7 in 8 s, Gemini 3.8 Flash (low) scores 56.2 in 2 s. Step 5 Preview scores 54.9 and takes 26 s to its first answer token. Higher effort means more thinking before the answer: better scores, longer waits and more tokens billed. How reasoning effort changes scores and cost.

Every benchmark

148 benchmarks, grouped by category; each name links to the board and its leaders. † measured at another effort setting of the same model, shown for reference and not counted as a win.

MetricPublisherGemini 3.8 Flash (high)Step 5 Preview
BenchLeader IndexBenchLeader62.054.9
Agents & tools scoreBenchLeader51.150.6
Coding scoreBenchLeader60.350.2
Human preference scoreBenchLeader69.063.2
Knowledge scoreBenchLeader64.755.2
Long context scoreBenchLeader65.569.2
Maths scoreBenchLeader62.159.7
Multimodal scoreBenchLeader67.459.4
Reasoning scoreBenchLeader64.052.7
Composite scoreBenchLeader–40.8
Blended price $/MBenchLeader$1.50$1.43
Output speedBenchLeader115 tok/s132 tok/s
Time to first answerBenchLeader21.6 s25.9 s
Context windowBenchLeader1,048,576 tokens1,000,000 tokens
Reasoning
GPQA DiamondEpoch AI Benchmarking Hub95.4%–
Humanity's Last ExamScale AI / CAIS44.5%†–
Arena Hard PromptsArena (LMArena)15171477
LiveBench 2.0 ReasoningLiveBench89.3%†83.8%
LiveBench 1.0 ReasoningLiveBench89.3%–
GPQA Diamond (AA)Artificial Analysis95.3%–
Humanity's Last Exam (AA)Artificial Analysis47.8%46.5%
HLE-Diamond (AA)Artificial Analysis33.1%24.3%
GPQA Diamond (Vals)Vals AI94.4%–
ARC-AGI-1ARC Prize98.5%–
ARC-AGI-2ARC Prize89.2%–
ARC-AGI-3ARC Prize35.0%–
CritPtArtificial Analysis18.3%20.9%
CritPt v2 hard subset (AA)Artificial Analysis46.5%32.5%
MysteryMechanismVals AI36.5%18.5%
Chess PuzzlesEpoch AI Benchmarking Hub58.0%–
Mystery Game PuzzlesEpoch AI Benchmarking Hub47.0%–
LMCAEpoch AI Benchmarking Hub51.5%†–
DTBenchEpoch AI Benchmarking Hub95.7%†–
Coding
SciCodeSciCode56.6%58.9%
WeirdMLWeirdML84.8%–
FrontierCodeCognition41.2%†–
Arena CodingArena (LMArena)15301506
Arena WebDevArena (LMArena)15831571†
LiveBench 2.0 CodingLiveBench82.2%†85.6%
Show all 148 benchmarks
MetricPublisherGemini 3.8 Flash (high)Step 5 Preview
Coding
LiveBench 1.0 CodingLiveBench72.5%–
LiveCodeBenchVals AI89.5%–
IOIVals AI56.9%38.1%
SWE-bench (Vals)Vals AI80.0%–
Code MigrationVals AI36.5%39.0%
Code Migration v1.1Vals AI38.6%47.0%
ProgramBenchVals AI1.0%–
SWE-bench MultimodalVals AI40.8%40.8%
Vibe Code Bench 1-100Vals AI18.8%–
Vibe Code Bench v1.1Vals AI78.7%70.4%
SWE Atlas: Codebase QnAScale AI SEAL47.0%†–
SWE Atlas: RefactoringScale AI SEAL44.8%†–
SWE Atlas: Test WritingScale AI SEAL53.7%†–
Surface Evolver BenchEpoch AI Benchmarking Hub76.9%–
DeepSWE v1.1Epoch AI Benchmarking Hub73.8%–
CursorBenchCursor39.6%–
ALE-BenchEpoch AI Benchmarking Hub1269.7–
FrontierSWEEpoch AI Benchmarking Hub19.6%–
Terminal-Bench 4.0 (AA)Artificial Analysis19.7%33.3%
Terminal-Bench 2.1 (AA)Artificial Analysis87.6%–
Startrise FrontendStartrise64.6%†–
GameBench 2 OverallDuelLab GameBench 259.0†–
GameBench 2 by reasoning settingDuelLab GameBench 264.2–
FrontierCode 1.1 (AA)Artificial Analysis36.4%38.4%
FrontierCode 2.0 (AA)Artificial Analysis18.7%12.0%
Agents & tools
Terminal-BenchTerminal-Bench19.1%–
Remote Labor IndexScale AI / CAIS5.8%†–
APEX-AgentsMercor64.3%†–
Arena AgentArena (LMArena)2.6-2.9
LiveBench Long AgenticLiveBench16.5%†19.4%
LiveBench BrowserLiveBench45.1%†24.8%
LiveBench Agentic CodingLiveBench54.2%–
Terminal-Bench 2.1 (Vals)Vals AI81.3%–
HiL-BenchScale AI SEAL41.5%†–
GDPval-AA v2.1, normalised scoreArtificial Analysis46.8%54.3%
GDPval-AA v2.1Artificial Analysis14451594
τ³-Banking (AA)Artificial Analysis45.0%–
ITBench SRE (AA)Artificial Analysis52.5%55.6%
Analyst Agent (AA)Artificial Analysis46.3%35.0%
APEX-Agents (AA)Artificial Analysis–38.0%
CUA-benchVals AI4.2%–
CyberBenchVals AI43.8%–
Finance Agent v2Vals AI61.4%50.7%
Finance Agent v2.1Vals AI65.8%58.9%
Harvey's Legal Agent Benchmark v1.1Vals AI12.1%12.9%
Harvey's Legal Agent Benchmark v1Vals AI10.0%9.2%
Legal Research BenchVals AI38.9%40.4%
SkillsBenchVals AI58.0%–
SREBenchVals AI11.1%0.4%
Tax Agent BenchVals AI32.1%27.3%
Terminal-Bench 4.0 (Vals)Vals AI19.7%31.8%
Terminal-Bench ScienceVals AI8.6%2.9%
Time Horizon Index: KSPVals AI18.8%–
Vending-Bench 2Andon Labs5093.8†–
AutomationBenchArtificial Analysis59.9%51.0%
GDP.pdf (AA)Artificial Analysis21.0%14.8%
Harvey LAB-AA v1.1Harvey0.0%–
EnterpriseOps-GymArtificial Analysis–47.2%
AA-Briefcase v1.1Artificial Analysis12031425
Terminal-Bench-Science 0.1 (AA)Artificial Analysis10.0%2.4%
CWE-Bench (AA)Artificial Analysis52.5%52.5%
DeepSec-Bench (AA)Artificial Analysis14.5%15.8%
CyberGym end-to-end (AA)Artificial Analysis8.4%74.8%
FACTS SearchGoogle80.4%†–
Maths
FrontierMath Tiers 1–3Epoch AI Benchmarking Hub68.4%–
FrontierMath Tier 4Epoch AI Benchmarking Hub21.9%–
OTIS Mock AIMEEpoch AI Benchmarking Hub98.9%–
ProofBenchVals AI48.0%†42.0%
LiveBench MathematicsLiveBench91.6%–
Arena MathsArena (LMArena)15241466
Knowledge
SimpleQA VerifiedEpoch AI Benchmarking Hub69.7%–
LiveBench 2.0 Data AnalysisLiveBench54.0%†63.5%
LiveBench ResearchLiveBench79.1%†72.8%
LiveBench 1.0 Data AnalysisLiveBench54.0%–
AA-Omniscience v1.1Artificial Analysis23.316.4
MMLU-ProVals AI90.2%–
LegalBenchVals AI87.0%–
TaxEvalVals AI74.5%–
PRBench FinanceScale AI SEAL49.5%†–
PRBench LegalScale AI SEAL48.9%†–
BioMysteryBenchVals AI62.2%67.4%
Excel Modeling BenchmarkVals AI72.2%57.1%
Excel Modeling Benchmark v1.1Vals AI72.9%69.5%
MedCodeVals AI48.1%–
MedScribeVals AI84.5%–
Public Benefits Bench v1.1Vals AI65.3%58.1%
GDP.pdfEpoch AI Benchmarking Hub23.2%–
AA-Omniscience v1.1: accuracyArtificial Analysis50.5%36.4%
AA-Omniscience v1.1: non-hallucinationArtificial Analysis44.9%68.7%
HealthBench Professional (AA)OpenAI51.7%–
Instruction following
LiveBench LanguageLiveBench87.8%–
LiveBench Instruction FollowingLiveBench81.4%–
Arena Instruction FollowingArena (LMArena)14911446
Human preference
Arena TextArena (LMArena)14961448
Arena Creative WritingArena (LMArena)14871411
Arena Multi-turnArena (LMArena)15051442
Arena Longer QueriesArena (LMArena)15121460
Multimodal
Arena VisionArena (LMArena)13151265
LiveBench DesignLiveBench72.7%†76.9%
MMMU-ProArtificial Analysis85.6%76.4%
MMMU-Pro (Vals)Vals AI89.1%–
MortgageTaxVals AI65.3%–
SAGEVals AI88.2%–
AudioMCScale AI SEAL60.4%–
AudioMC (text output)Scale AI SEAL60.4%–
Blueprint-Bench 2Epoch AI Benchmarking Hub38.6%†–
Code2Video-AAArtificial Analysis899821
AA-3DArtificial Analysis966854
Long context
AA-LCR v1.1Artificial Analysis81.3%88.3%
MLCRArtificial Analysis10.6%18.3%
Composite
Epoch Capabilities IndexEpoch AI Benchmarking Hub158.6†–
LiveBench 2.0LiveBench59.2%†58.6%
LiveBench 1.0LiveBench75.8%–
AA Intelligence Index v5.0Artificial Analysis30.928.5
AA Intelligence Index v4.3.2Artificial Analysis40.943.7
AA Progress Index v1Artificial Analysis320.3318.2
Vals IndexVals AI56.054.8
Vals Finance IndexVals AI60.5%55.4%
Vals RSI IndexVals AI19.9%–
Vals Science IndexVals AI35.8%29.6%
Vals Router IndexVals AI56.0%†–
AA Cyber IndexArtificial Analysis25.147.7
Metadata
AA Openness IndexArtificial Analysis–33.3

Data as of 2026-11-06. Best configuration of each model; every score links to its source on the model pages.

DuelLab GameBench 2, release gb2-20261103-09b2218cbd85 (https://benchmarks.duellab.org/releases/gb2-20261103-09b2218cbd85/), CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Scores mapped to BenchLeader model names; not endorsed by DuelLab.

What changed

  • Gemini 3.8 Flash: list price moves to $1.50 / $7.50 per 1M input / output tokens (announced).
  • Gemini 3.8 Flash (high): 2 score revisions.
  • Gemini 3.8 Flash (high): 1 new result (MirrorCode).
  • Step 5 Preview: 2 new results (Vals Index, Harvey's Legal Agent Benchmark v1.1).
  • Gemini 3.8 Flash (high): 1 score revision.
  • Step 5 Preview: 1 score revision.
  • Gemini 3.8 Flash (high): BenchLeader Index 63.3 → 61.8.
  • Step 5 Preview: BenchLeader Index 58.0 → 54.7.
  • Gemini 3.8 Flash (high): 5 new results (AA Intelligence Index v5.0, AA Progress Index v1, HLE-Diamond (AA)…); 3 score revisions; cost per task moved from $3.49/M to $7.77/M (123% up).
  • Step 5 Preview: 5 new results (AA Intelligence Index v5.0, AA Progress Index v1, HLE-Diamond (AA)…); 2 score revisions; Step 5 Preview cost per task moved from $1.03/M to $2.35/M (128% up).

Rankings: Best LLM overall · Best LLM for agents · Best cheap LLMs

Gemini 3.8 Flash vs Step 5 Preview: questions

Is Gemini 3.8 Flash better than Step 5 Preview?
Gemini 3.8 Flash (high) leads on quality: 62.0 vs 54.9. The BenchLeader Index combines every independent quality benchmark; Gemini 3.8 Flash (high) is ahead overall as of 6 Nov 2026, but check the category scores for your use.
Gemini 3.8 Flash vs Step 5 Preview: which is cheaper, and will that change?
Step 5 Preview is cheaper today: $1.43 against $1.50 per million tokens, blended at three input tokens per output token. Gemini 3.8 Flash's current price runs until 31 Dec 2026, then $3.00.
Is Gemini 3.8 Flash or Step 5 Preview better for coding?
Gemini 3.8 Flash scores higher in coding (60 vs 50 on the category index, where 50 is average). On FrontierCode 2.0 (AA), the top shared coding benchmark, it is 18.7% for Gemini 3.8 Flash against 12.0% for Step 5 Preview.
Which is faster, Gemini 3.8 Flash or Step 5 Preview?
Step 5 Preview streams faster (132 vs 115 output tokens per second, Artificial Analysis 7-day median).
Is Gemini 3.8 Flash or Step 5 Preview better for agents and tool use?
They are level in agentic tasks (51 vs 51 on the category index). On Arena Agent, the top shared agents & tools benchmark, it is 2.6 for Gemini 3.8 Flash against -2.9 for Step 5 Preview.
More questions (4)
Which is better for long documents?
Step 5 Preview scores higher on long-context benchmarks (69 vs 66). Both take about 1M tokens: Gemini 3.8 Flash 1,048,576, Step 5 Preview 1,000,000.
Which has lower latency?
Gemini 3.8 Flash answers first: 21.6 s against 25.9 s to the first answer token, as Artificial Analysis measures it. Reasoning effort drives most of this: a higher setting thinks longer before it answers.
Do independent benchmarks agree on Gemini 3.8 Flash vs Step 5 Preview?
Across the 59 benchmarks both have, Gemini 3.8 Flash leads 37, Step 5 Preview leads 20 and 2 are tied. Every overall index that rates both puts Gemini 3.8 Flash ahead.
When was Step 5 Preview released?
Step 5 Preview was released on 18 Sep 2026.