BenchLeader

Gemini 3.8 Flash vs GPT-6 Sol

Full profiles: Gemini 3.8 Flash (Google) and GPT-6 Sol (OpenAI): every benchmark, price and rank.

Updated · Data from 12 sources

As of 9 Nov 2026, Gemini 3.8 Flash and GPT-6 Sol are neck and neck on quality (61.8 vs 62.9 on the BenchLeader Index, inside the ±4.9 margin), and Gemini 3.8 Flash is 2.7× cheaper at $1.50 vs $4.00 per 1M tokens blended. Choose Gemini 3.8 Flash for multimodal (68 vs 61), human preference (69 vs 64), and knowledge (64 vs 62) and fast first answers (17.5 s vs 72.1 s); choose GPT-6 Sol for agents & tools (60 vs 51), maths (69 vs 62), and coding (67 vs 60). Gemini 3.8 Flash's current price runs until 31 Dec 2026, then $3.00.

Key facts (as of 9 Nov 2026)

  • Gemini 3.8 Flash scores 61.8 on the BenchLeader Index and GPT-6 Sol scores 62.9 (BenchLeader, 9 Nov 2026).
  • Gemini 3.8 Flash costs $1.50 per 1M tokens blended until 31 Dec 2026, then $3.00 (https://ai.google.dev/gemini-api/docs/pricing, checked 20 Oct 2026).
  • GPT-6 Sol costs $4.00 per 1M tokens blended (list price, 9 Nov 2026).
  • Of the 78 benchmarks both models have, GPT-6 Sol leads 47 (BenchLeader, 9 Nov 2026).
  • On Arena WebDev, Gemini 3.8 Flash is rated 1584 and GPT-6 Sol 1674 (LMArena, as published by 9 Nov 2026).

Which to pick for…

The pick's numbers come first. Category scores on the BenchLeader scale (50 is the average model, 15 points one standard deviation). High confidence means a lead of half a standard deviation or more; under one point is called either.

Use casePickWhyConfidence
CodingGPT-6 Sol67 vs 60 category score; Arena WebDev 1674 vs 1584Medium
Agents & tool useGPT-6 Sol60 vs 51 category score; Terminal-Bench 50.3% vs 18.2%High
MathsGPT-6 Sol69 vs 62 category score; FrontierMath Tiers 1–3 89.8% vs 68.4%Medium
ReasoningGPT-6 Sol66 vs 63 category score; HLE-Diamond (AA) 45.2% vs 33.1%Medium
KnowledgeGemini 3.8 Flash64 vs 62 category score; SimpleQA Verified 69.7% vs 60.7%Medium
Long documentsGPT-6 Sol67 vs 65 category score; AA-LCR v1.1 83.7% vs 81.3%Medium
Images and other mediaGemini 3.8 Flash68 vs 61 category score; Arena Vision 1317 vs 1232Medium
Chat quality (human preference)Gemini 3.8 Flash69 vs 64 on Arena votesMedium
Lowest costGemini 3.8 Flash$1.50 vs $4.00 per 1M blended; agentic coding session $0.060 vs $0.160; from 1 Jan 2027: $3.00 vs $4.00–
Fastest first answerGemini 3.8 Flash17.5 s (Gemini 3.8 Flash (high)) vs 72.1 s (GPT-6 Sol (max)) to the first answer token–
High volume on a budgetNeither flagshipA smaller model is usually the better fit: Cheapest good LLMs, Fastest LLMs–

Key differences

  • Gemini 3.8 Flash (high) and GPT-6 Sol (max) are neck and neck on quality (61.8 vs 62.9, within the ±4.9 margin).
  • Gemini 3.8 Flash (high) is stronger in human preference, knowledge, multimodal.
  • GPT-6 Sol (max) is stronger in agents & tools, coding, long context, maths, reasoning.
  • Gemini 3.8 Flash (high) is 2.7× cheaper ($1.50 vs $4.00 per 1M blended) until 31 Dec 2026, then $3.00 vs $4.00 from 1 Jan 2027.

At a glance

SpecGemini 3.8 FlashGPT-6 Sol
DeveloperGoogleOpenAI
Released2 Sep 202622 Sep 2026
Context window (tokens)1,048,5761,050,000
Compared atGemini 3.8 Flash (high)GPT-6 Sol (max)
Open weightsNoNo
Price in / out / cached input per 1M$0.750 / $3.75 / $0.075$2.00 / $10.00 / $0.200
Announced price change$1.50 / $7.50 from 1 Jan 2027None announced

Limits, availability and announced prices from the vendors' own pages: ai.google.dev pricing (checked 20 Oct 2026). Everything else is from the day's data.

Category by category

Category scores on the BenchLeader scale: 50 is the average evaluated model, 15 points is one standard deviation. A gap under one point is called level.

CategoryGemini 3.8 Flash (high)GPT-6 Sol (max)Leader
Reasoning63.266.2GPT-6 Sol
Coding60.266.5GPT-6 Sol
Agents & tools51.059.6GPT-6 Sol
Maths61.968.5GPT-6 Sol
Knowledge64.361.5Gemini 3.8 Flash
Human preference69.264.2Gemini 3.8 Flash
Multimodal67.560.7Gemini 3.8 Flash
Long context65.466.6GPT-6 Sol

On one chart

Each domain on the index's own scale, where 50 is an average model. Click a domain to see the benchmarks behind it. Pick up to 5 models from the list.

2550 avg75ReasoningCodingAgents & toolsMathsKnowledgeLong contextMultimodalHumanpreferenceGemini 3.8 Flash, Reasoning: 63.2Gemini 3.8 Flash, Coding: 60.2Gemini 3.8 Flash, Agents & tools: 51.0Gemini 3.8 Flash, Maths: 61.9Gemini 3.8 Flash, Knowledge: 64.3Gemini 3.8 Flash, Long context: 65.4Gemini 3.8 Flash, Multimodal: 67.5Gemini 3.8 Flash, Human preference: 69.2GPT-6 Sol, Reasoning: 66.2GPT-6 Sol, Coding: 66.5GPT-6 Sol, Agents & tools: 59.6GPT-6 Sol, Maths: 68.5GPT-6 Sol, Knowledge: 61.5GPT-6 Sol, Long context: 66.6GPT-6 Sol, Multimodal: 60.7GPT-6 Sol, Human preference: 64.2

Not drawn, measured for fewer than two of these models: Instruction following.

ModelIndex

Where sources disagree

Across the 78 benchmarks both have, Gemini 3.8 Flash leads 31, GPT-6 Sol leads 47. Independent sources split: Gemini 3.8 Flash leads on Arena Text; GPT-6 Sol leads on AA Intelligence Index v5.0.

Overall indexGemini 3.8 Flash (high)GPT-6 Sol (max)Leader
BenchLeader Index61.862.9neck and neck
AA Intelligence Index v5.030.944.2GPT-6 Sol
Arena Text14981457Gemini 3.8 Flash

Each publisher runs its own tasks, harnesses and effort settings, so their overall verdicts can differ; BenchLeader reconciles them on one scale. † measured at another effort setting of the same model (the publisher did not test the one compared here).

Price, speed and latency

List prices blended at three input tokens per output token. Per-task prices use the token counts on the methodology page. Cost, tokens and time per benchmark task are measured: Artificial Analysis’ averages over its whole Intelligence Index run.

MeasureGemini 3.8 Flash (high)GPT-6 Sol (max)
Blended price per 1M tokens, until 31 Dec 2026$1.50$4.00
Input / output per 1M$0.750 / $3.75$2.00 / $10.00
Blended price per 1M from 1 Jan 2027$3.00$4.00
Input / output per 1M from 1 Jan 2027$1.50 / $7.50$2.00 / $10.00
Cached input per 1M$0.075$0.200
Price per task: chat reply$0.0014$0.0038
Price per task: summarize a 30-page report$0.011$0.030
Price per task: code edit$0.010$0.027
Price per task: agentic coding session$0.060$0.160
Price per task: structured extraction$0.0023$0.0060
Agentic coding session, input mostly cached$0.030$0.079
Cost per benchmark task (AA Index)$7.77$2.47
Output tokens per task (AA Index)99k54k
Of which reasoning60k35k
Time per task (AA Index)15 min7 min
Output speed112 tok/s121 tok/s
Time to first answer17.5 s72.1 s
Time to a complete answer52.0 s130.2 s

Per token is not per task: an average task of Artificial Analysis' Intelligence Index cost $7.77 on Gemini 3.8 Flash (high) and $2.47 on GPT-6 Sol (max), and Gemini 3.8 Flash (high) wrote 1.8× as many output tokens for the same work, which a per-token price hides.

Each model is compared at its best-ranked reasoning-effort setting. Gemini 3.8 Flash (high) scores 61.8 and takes 18 s to its first answer token; Gemini 3.8 Flash (medium) scores 60.3 in 11 s, Gemini 3.8 Flash (low) scores 55.9 in 4 s. GPT-6 Sol (max) scores 62.9 and takes 72 s to its first answer token; GPT-6 Sol (xhigh) scores 58.6 in 24 s, GPT-6 Sol (high) scores 58.2 in 9 s. Higher effort means more thinking before the answer: better scores, longer waits and more tokens billed. How reasoning effort changes scores and cost.

Every benchmark

151 benchmarks, grouped by category; each name links to the board and its leaders. † measured at another effort setting of the same model, shown for reference and not counted as a win.

MetricPublisherGemini 3.8 Flash (high)GPT-6 Sol (max)
BenchLeader IndexBenchLeader61.862.9
Agents & tools scoreBenchLeader51.059.6
Coding scoreBenchLeader60.266.5
Human preference scoreBenchLeader69.264.2
Knowledge scoreBenchLeader64.361.5
Long context scoreBenchLeader65.466.6
Maths scoreBenchLeader61.968.5
Multimodal scoreBenchLeader67.560.7
Reasoning scoreBenchLeader63.266.2
Blended price $/MBenchLeader$1.50$4.00
Output speedBenchLeader112 tok/s121 tok/s
Time to first answerBenchLeader17.5 s72.1 s
Context windowBenchLeader1,048,576 tokens1,050,000 tokens
Reasoning
GPQA DiamondEpoch AI Benchmarking Hub95.4%94.3%
Humanity's Last ExamScale AI / CAIS44.5%†–
Arena Hard PromptsArena (LMArena)15191483
LiveBench 2.0 ReasoningLiveBench89.3%†–
LiveBench 1.0 ReasoningLiveBench89.3%88.7%
GPQA Diamond (AA)Artificial Analysis95.3%–
Humanity's Last Exam (AA)Artificial Analysis47.8%47.9%
HLE-Diamond (AA)Artificial Analysis33.1%45.2%
GPQA Diamond (Vals)Vals AI94.4%–
ARC-AGI-1ARC Prize98.5%95.5%
ARC-AGI-2ARC Prize89.2%89.6%
ARC-AGI-3ARC Prize35.0%23.0%
CritPtArtificial Analysis18.3%30.9%
CritPt v2 hard subset (AA)Artificial Analysis46.5%66.5%
MysteryMechanismVals AI36.5%30.2%
Chess PuzzlesEpoch AI Benchmarking Hub58.0%56.0%
Mystery Game PuzzlesEpoch AI Benchmarking Hub47.0%56.0%
LMCAEpoch AI Benchmarking Hub51.5%†59.1%
DTBenchEpoch AI Benchmarking Hub95.7%†97.3%
Coding
SciCodeSciCode56.6%57.6%
WeirdMLWeirdML84.8%–
FrontierCodeCognition41.2%†49.3%
Arena CodingArena (LMArena)15301520
Arena WebDevArena (LMArena)15841674
LiveBench 2.0 CodingLiveBench65.7%†–
Show all 151 benchmarks
MetricPublisherGemini 3.8 Flash (high)GPT-6 Sol (max)
Coding
LiveBench 1.0 CodingLiveBench72.5%81.8%
LiveCodeBenchVals AI89.5%–
IOIVals AI56.9%82.6%
SWE-bench (Vals)Vals AI80.0%–
Code MigrationVals AI36.5%57.2%
Code Migration v1.1Vals AI38.6%–
ProgramBenchVals AI1.0%2.0%
SWE-bench MultimodalVals AI40.8%–
Vibe Code Bench 1-100Vals AI18.8%–
Vibe Code Bench v1.1Vals AI78.7%87.8%
SWE Atlas: Codebase QnAScale AI SEAL47.0%†–
SWE Atlas: RefactoringScale AI SEAL44.8%†–
SWE Atlas: Test WritingScale AI SEAL53.7%†–
Surface Evolver BenchEpoch AI Benchmarking Hub76.9%–
DeepSWE v1.1Epoch AI Benchmarking Hub73.8%–
CursorBenchCursor39.6%–
ALE-BenchEpoch AI Benchmarking Hub1269.72462
FrontierSWEEpoch AI Benchmarking Hub19.6%–
Terminal-Bench 4.0 (AA)Artificial Analysis19.7%43.9%
Terminal-Bench 2.1 (AA)Artificial Analysis87.6%–
Startrise FrontendStartrise64.6%†–
GameBench 2 OverallDuelLab GameBench 259.0†72.9†
GameBench 2 by reasoning settingDuelLab GameBench 264.279.3†
Design Arena WebsiteDesign Arena1297†1285†
FrontierCode 1.1 (AA)Artificial Analysis36.4%–
FrontierCode 2.0 (AA)Artificial Analysis18.7%35.6%
Agents & tools
Terminal-BenchTerminal-Bench18.2%50.3%
Remote Labor IndexScale AI / CAIS5.8%†–
APEX-AgentsMercor64.3%†54.3%
Arena AgentArena (LMArena)2.47
LiveBench Long AgenticLiveBench16.5%†–
LiveBench BrowserLiveBench45.1%†–
LiveBench Agentic CodingLiveBench54.2%52.9%
Terminal-Bench 2.1 (Vals)Vals AI81.3%83.2%
HiL-BenchScale AI SEAL41.5%†–
GDPval-AA v2.1, normalised scoreArtificial Analysis46.8%–
GDPval-AA v2.1Artificial Analysis1445–
τ³-Banking (AA)Artificial Analysis45.0%–
ITBench SRE (AA)Artificial Analysis52.5%49.4%
Analyst Agent (AA)Artificial Analysis46.3%–
CUA-benchVals AI4.2%–
CyberBenchVals AI43.8%78.0%
Finance Agent v2Vals AI61.4%49.0%
Finance Agent v2.1Vals AI65.8%–
Harvey's Legal Agent Benchmark v1.1Vals AI12.1%–
Harvey's Legal Agent Benchmark v1Vals AI10.0%1.7%
Legal Research BenchVals AI38.9%28.9%
SkillsBenchVals AI58.0%–
SREBenchVals AI11.1%30.5%
Tax Agent BenchVals AI32.1%15.0%
Terminal-Bench 4.0 (Vals)Vals AI19.7%44.4%
Terminal-Bench ScienceVals AI8.6%30.0%
Time Horizon Index: KSPVals AI18.8%–
Arena SearchArena (LMArena)–1229
Vending-Bench 2Andon Labs5093.8†14427.9†
AutomationBenchArtificial Analysis59.9%61.6%
GDP.pdf (AA)Artificial Analysis21.0%25.2%
Harvey LAB-AA v1.1Harvey0.0%3.6%
AA-Briefcase v1.1Artificial Analysis12031476
Design Arena AgenticDesign Arena1220†1212†
Terminal-Bench-Science 0.1 (AA)Artificial Analysis10.0%30.0%
CWE-Bench (AA)Artificial Analysis52.5%64.2%
DeepSec-Bench (AA)Artificial Analysis14.5%46.3%
CyberGym end-to-end (AA)Artificial Analysis8.4%0.0%
FACTS SearchGoogle80.4%†–
Maths
FrontierMath Tiers 1–3Epoch AI Benchmarking Hub68.4%89.8%
FrontierMath Tier 4Epoch AI Benchmarking Hub21.9%90.0%
OTIS Mock AIMEEpoch AI Benchmarking Hub98.9%100.0%
ProofBenchVals AI48.0%†83.0%†
LiveBench MathematicsLiveBench91.6%96.4%
Arena MathsArena (LMArena)15191440
Knowledge
SimpleQA VerifiedEpoch AI Benchmarking Hub69.7%60.7%
LiveBench 2.0 Data AnalysisLiveBench54.0%†–
LiveBench ResearchLiveBench79.4%†–
LiveBench 1.0 Data AnalysisLiveBench54.0%81.2%
AA-Omniscience v1.1Artificial Analysis23.321.4
MMLU-ProVals AI90.2%–
LegalBenchVals AI87.0%–
TaxEvalVals AI74.5%–
PRBench FinanceScale AI SEAL49.5%†–
PRBench LegalScale AI SEAL48.9%†38.6%†
BioMysteryBenchVals AI62.2%74.8%
Excel Modeling BenchmarkVals AI72.2%71.5%
Excel Modeling Benchmark v1.1Vals AI72.9%–
MedCodeVals AI48.1%47.1%
MedScribeVals AI84.5%82.0%
Public Benefits Bench v1.1Vals AI65.3%56.6%
EBR-benchEpoch AI Benchmarking Hub–53.3%
GDP.pdfEpoch AI Benchmarking Hub23.2%26.4%
AA-Omniscience v1.1: accuracyArtificial Analysis50.5%51.1%
AA-Omniscience v1.1: non-hallucinationArtificial Analysis44.9%39.1%
HealthBench Professional (AA)OpenAI51.7%62.3%
Instruction following
LiveBench LanguageLiveBench87.8%85.3%
LiveBench Instruction FollowingLiveBench81.4%68.6%
Arena Instruction FollowingArena (LMArena)14921448
Human preference
Arena TextArena (LMArena)14981457
Arena Creative WritingArena (LMArena)14891430
Arena Multi-turnArena (LMArena)15051466
Arena Longer QueriesArena (LMArena)15121466
Multimodal
Arena VisionArena (LMArena)13171232
LiveBench DesignLiveBench69.7%†–
MMMU-ProArtificial Analysis85.6%83.0%
MMMU-Pro (Vals)Vals AI89.1%–
MortgageTaxVals AI65.3%–
SAGEVals AI88.2%–
AudioMCScale AI SEAL60.4%–
AudioMC (text output)Scale AI SEAL60.4%–
Blueprint-Bench 2Epoch AI Benchmarking Hub38.6%†36.9%†
Code2Video-AAArtificial Analysis899–
AA-3DArtificial Analysis9741131
Long context
AA-LCR v1.1Artificial Analysis81.3%83.7%
Arena DocumentArena (LMArena)1469–
MLCRArtificial Analysis10.6%33.9%
Composite
Epoch Capabilities IndexEpoch AI Benchmarking Hub158.6†164.1†
LiveBench 2.0LiveBench56.0%†–
LiveBench 1.0LiveBench75.8%79.3%
AA Intelligence Index v5.0Artificial Analysis30.944.2
AA Intelligence Index v4.3.2Artificial Analysis40.947.6
AA Progress Index v1Artificial Analysis320.3334
Vals IndexVals AI56.0–
Vals Finance IndexVals AI60.5%–
Vals RSI IndexVals AI19.9%28.1%
Vals Science IndexVals AI35.8%45.0%
Vals Router IndexVals AI56.0%†–
AA Cyber IndexArtificial Analysis25.136.8
Safety & honesty
FORTRESSScale AI SEAL–13.5%†

Data as of 2026-11-09. Best configuration of each model; every score links to its source on the model pages.

DuelLab GameBench 2, release gb2-20261103-eaea31df94e6 (https://benchmarks.duellab.org/releases/gb2-20261103-eaea31df94e6/), CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Scores mapped to BenchLeader model names; not endorsed by DuelLab.

What changed

  • Gemini 3.8 Flash: list price moves to $1.50 / $7.50 per 1M input / output tokens (announced).
  • GPT-6 Sol (max): BenchLeader Index 63.5 → 62.9.
  • Gemini 3.8 Flash (high): 2 score revisions.
  • GPT-6 Sol (max): 2 score revisions.
  • Gemini 3.8 Flash (high): 1 new result (Arena Document); 1 score revision.
  • GPT-6 Sol (max): 1 score revision.
  • GPT-6 Sol (max): 1 score revision.
  • Gemini 3.8 Flash (high): 2 score revisions.
  • GPT-6 Sol (max): 6 new results (AA Intelligence Index v5.0, AA-Omniscience v1.1, CritPt v2 hard subset (AA)…).
  • GPT-6 Sol (max): 1 score revision.

Rankings: Best LLM overall · Best LLM for agents · Best cheap LLMs

Gemini 3.8 Flash vs GPT-6 Sol: questions

Is Gemini 3.8 Flash better than GPT-6 Sol?
Gemini 3.8 Flash (high) and GPT-6 Sol (max) are neck and neck on quality (61.8 vs 62.9, within the ±4.9 margin). The BenchLeader Index combines every independent quality benchmark; the two are within the margin of error as of 9 Nov 2026, so check the category scores for your use.
Gemini 3.8 Flash vs GPT-6 Sol: which is cheaper, and will that change?
Gemini 3.8 Flash is cheaper today: $1.50 against $4.00 per million tokens, blended at three input tokens per output token. Gemini 3.8 Flash's current price runs until 31 Dec 2026, then $3.00.
Is Gemini 3.8 Flash or GPT-6 Sol better for coding?
GPT-6 Sol scores higher in coding (67 vs 60 on the category index, where 50 is average). On Arena WebDev, the top shared coding benchmark, it is 1584 for Gemini 3.8 Flash against 1674 for GPT-6 Sol.
Which is faster, Gemini 3.8 Flash or GPT-6 Sol?
GPT-6 Sol streams faster (121 vs 112 output tokens per second, Artificial Analysis 7-day median).
Is Gemini 3.8 Flash or GPT-6 Sol better for agents and tool use?
GPT-6 Sol scores higher in agentic tasks (60 vs 51 on the category index, where 50 is average). On Terminal-Bench, the top shared agents & tools benchmark, it is 18.2% for Gemini 3.8 Flash against 50.3% for GPT-6 Sol.
More questions (4)
Which is better for long documents?
GPT-6 Sol scores higher on long-context benchmarks (67 vs 65). Both take about 1.1M tokens: Gemini 3.8 Flash 1,048,576, GPT-6 Sol 1,050,000.
Which has lower latency?
Gemini 3.8 Flash answers first: 17.5 s against 72.1 s to the first answer token, as Artificial Analysis measures it. Reasoning effort drives most of this: a higher setting thinks longer before it answers.
Do independent benchmarks agree on Gemini 3.8 Flash vs GPT-6 Sol?
Across the 78 benchmarks both have, Gemini 3.8 Flash leads 31, GPT-6 Sol leads 47. Independent sources split: Gemini 3.8 Flash leads on Arena Text; GPT-6 Sol leads on AA Intelligence Index v5.0.
When was GPT-6 Sol released?
GPT-6 Sol was released on 22 Sep 2026.