BenchLeader

Gemini 3.8 Flash vs GPT-5.3-Codex

Full profiles: Gemini 3.8 Flash (Google) and GPT-5.3-Codex (OpenAI): every benchmark, price and rank.

Updated · Data from 12 sources

As of 10 Nov 2026, Gemini 3.8 Flash and GPT-5.3-Codex are neck and neck on quality (61.8 vs 62.9 on the BenchLeader Index, inside the ±7.8 margin), and Gemini 3.8 Flash is 3.2× cheaper at $1.50 vs $4.81 per 1M tokens blended. Choose Gemini 3.8 Flash for multimodal (68 vs 61) and fast first answers (16.6 s vs 39.0 s), where it also streams faster; choose GPT-5.3-Codex for agents & tools (80 vs 51) and long context (66 vs 65). Gemini 3.8 Flash's current price runs until 31 Dec 2026, then $3.00.

Key facts (as of 10 Nov 2026)

  • Gemini 3.8 Flash scores 61.8 on the BenchLeader Index and GPT-5.3-Codex scores 62.9 (BenchLeader, 10 Nov 2026).
  • Gemini 3.8 Flash costs $1.50 per 1M tokens blended until 31 Dec 2026, then $3.00 (https://ai.google.dev/gemini-api/docs/pricing, checked 20 Oct 2026).
  • GPT-5.3-Codex costs $4.81 per 1M tokens blended (list price, 10 Nov 2026).
  • Gemini 3.8 Flash streams faster than GPT-5.3-Codex (Artificial Analysis, 7-day median, 10 Nov 2026).
  • Of the 13 benchmarks both models have, Gemini 3.8 Flash leads 11 (BenchLeader, 10 Nov 2026).

Which to pick for…

The pick's numbers come first. Category scores on the BenchLeader scale (50 is the average model, 15 points one standard deviation). High confidence means a lead of half a standard deviation or more; under one point is called either.

Use casePickWhyConfidence
CodingEither60 vs 61 category score; LiveCodeBench 89.5% vs 87.3%Either
Agents & tool useGPT-5.3-Codex80 vs 51 category score; AA-Briefcase v1.1 868 vs 1203High
Long documentsGPT-5.3-Codex66 vs 65 category score; AA-LCR v1.1 83.3% vs 81.3%Medium
Images and other mediaGemini 3.8 Flash68 vs 61 category score; MMMU-Pro 85.6% vs 78.5%Medium
Chat quality (human preference)–Only Gemini 3.8 Flash has an Arena rating (69 category score)Not comparable
Lowest costGemini 3.8 Flash$1.50 vs $4.81 per 1M blended; agentic coding session $0.060 vs $0.161; from 1 Jan 2027: $3.00 vs $4.81–
Fastest first answerGemini 3.8 Flash16.6 s (Gemini 3.8 Flash (high)) vs 39.0 s (GPT-5.3-Codex (xhigh)) to the first answer token–
High volume on a budgetNeither flagshipA smaller model is usually the better fit: Cheapest good LLMs, Fastest LLMs–

Key differences

  • Gemini 3.8 Flash (high) and GPT-5.3-Codex (xhigh) are neck and neck on quality (61.8 vs 62.9, within the ±7.8 margin).
  • Gemini 3.8 Flash (high) is stronger in human preference, knowledge, maths, multimodal, reasoning.
  • GPT-5.3-Codex (xhigh) is stronger in agents & tools, coding, long context, instruction following.
  • Gemini 3.8 Flash (high) is 3.2× cheaper ($1.50 vs $4.81 per 1M blended) until 31 Dec 2026, then $3.00 vs $4.81 from 1 Jan 2027.
  • Gemini 3.8 Flash (high) streams 1.5× faster (112 vs 76 tokens per second).

At a glance

SpecGemini 3.8 FlashGPT-5.3-Codex
DeveloperGoogleOpenAI
Released2 Sep 20265 Feb 2026
Context window (tokens)1,048,576400,000
Compared atGemini 3.8 Flash (high)GPT-5.3-Codex (xhigh)
Open weightsNoNo
Price in / out / cached input per 1M$0.750 / $3.75 / $0.075$1.75 / $14.00 / $0.175
Announced price change$1.50 / $7.50 from 1 Jan 2027None announced

Limits, availability and announced prices from the vendors' own pages: ai.google.dev pricing (checked 20 Oct 2026). Everything else is from the day's data.

Category by category

Category scores on the BenchLeader scale: 50 is the average evaluated model, 15 points is one standard deviation. A gap under one point is called level.

CategoryGemini 3.8 Flash (high)GPT-5.3-Codex (xhigh)Leader
Reasoning63.2–not comparable
Coding60.261.0level
Agents & tools51.080.1GPT-5.3-Codex
Maths61.8–not comparable
Knowledge64.1–not comparable
Instruction following–73.6not comparable
Human preference69.2–not comparable
Multimodal67.560.9Gemini 3.8 Flash
Long context65.466.4GPT-5.3-Codex

On one chart

Each domain on the index's own scale, where 50 is an average model. Click a domain to see the benchmarks behind it. Pick up to 5 models from the list.

2550 avg75CodingAgents & toolsLong contextMultimodalGemini 3.8 Flash, Coding: 60.2Gemini 3.8 Flash, Agents & tools: 51.0Gemini 3.8 Flash, Long context: 65.4Gemini 3.8 Flash, Multimodal: 67.5GPT-5.3-Codex, Coding: 61.0GPT-5.3-Codex, Agents & tools: 80.1GPT-5.3-Codex, Long context: 66.4GPT-5.3-Codex, Multimodal: 60.9

Not drawn, measured for fewer than two of these models: Reasoning, Maths, Knowledge, Instruction following, Human preference.

ModelIndex

Where sources disagree

Across the 13 benchmarks both have, Gemini 3.8 Flash leads 11, GPT-5.3-Codex leads 2.

Overall indexGemini 3.8 Flash (high)GPT-5.3-Codex (xhigh)Leader
BenchLeader Index61.862.9neck and neck

Each publisher runs its own tasks, harnesses and effort settings, so their overall verdicts can differ; BenchLeader reconciles them on one scale. † measured at another effort setting of the same model (the publisher did not test the one compared here).

Price, speed and latency

List prices blended at three input tokens per output token. Per-task prices use the token counts on the methodology page. Cost, tokens and time per benchmark task are measured: Artificial Analysis’ averages over its whole Intelligence Index run.

MeasureGemini 3.8 Flash (high)GPT-5.3-Codex (xhigh)
Blended price per 1M tokens, until 31 Dec 2026$1.50$4.81
Input / output per 1M$0.750 / $3.75$1.75 / $14.00
Blended price per 1M from 1 Jan 2027$3.00$4.81
Input / output per 1M from 1 Jan 2027$1.50 / $7.50$1.75 / $14.00
Cached input per 1M$0.075$0.175
Price per task: chat reply$0.0014$0.0049
Price per task: summarize a 30-page report$0.011$0.029
Price per task: code edit$0.010$0.032
Price per task: agentic coding session$0.060$0.161
Price per task: structured extraction$0.0023$0.0063
Agentic coding session, input mostly cached$0.030$0.090
Cost per benchmark task (AA Index)$7.77–
Output tokens per task (AA Index)99k–
Of which reasoning60k–
Time per task (AA Index)15 min–
Output speed112 tok/s76 tok/s
Time to first answer16.6 s39.0 s
Time to a complete answer50.3 s87.0 s

Each model is compared at its best-ranked reasoning-effort setting. Gemini 3.8 Flash (high) scores 61.8 and takes 17 s to its first answer token; Gemini 3.8 Flash (medium) scores 60.3 in 11 s, Gemini 3.8 Flash (low) scores 56.0 in 4 s. GPT-5.3-Codex (xhigh) scores 62.9 and takes 39 s to its first answer token. Higher effort means more thinking before the answer: better scores, longer waits and more tokens billed. How reasoning effort changes scores and cost.

Every benchmark

154 benchmarks, grouped by category; each name links to the board and its leaders. † measured at another effort setting of the same model, shown for reference and not counted as a win.

MetricPublisherGemini 3.8 Flash (high)GPT-5.3-Codex (xhigh)
BenchLeader IndexBenchLeader61.862.9
Agents & tools scoreBenchLeader51.080.1
Coding scoreBenchLeader60.261.0
Human preference scoreBenchLeader69.2–
Knowledge scoreBenchLeader64.1–
Long context scoreBenchLeader65.466.4
Maths scoreBenchLeader61.8–
Multimodal scoreBenchLeader67.560.9
Reasoning scoreBenchLeader63.2–
Instruction following scoreBenchLeader–73.6
Blended price $/MBenchLeader$1.50$4.81
Output speedBenchLeader112 tok/s76 tok/s
Time to first answerBenchLeader16.6 s39.0 s
Context windowBenchLeader1,048,576 tokens400,000 tokens
Reasoning
GPQA DiamondEpoch AI Benchmarking Hub95.4%–
Humanity's Last ExamScale AI / CAIS44.5%†–
Arena Hard PromptsArena (LMArena)1520–
LiveBench 2.0 ReasoningLiveBench89.3%†–
LiveBench 1.0 ReasoningLiveBench89.3%–
GPQA Diamond (AA)Artificial Analysis95.3%91.5%
Humanity's Last Exam (AA)Artificial Analysis47.8%42.5%
HLE-Diamond (AA)Artificial Analysis33.1%–
GPQA Diamond (Vals)Vals AI94.4%–
ARC-AGI-1ARC Prize98.5%–
ARC-AGI-2ARC Prize89.2%–
ARC-AGI-3ARC Prize35.0%–
CritPtArtificial Analysis18.3%16.9%
CritPt v2 hard subset (AA)Artificial Analysis46.5%–
MysteryMechanismVals AI36.5%–
Chess PuzzlesEpoch AI Benchmarking Hub58.0%–
Mystery Game PuzzlesEpoch AI Benchmarking Hub47.0%–
LMCAEpoch AI Benchmarking Hub51.5%†–
DTBenchEpoch AI Benchmarking Hub95.7%†–
Coding
SWE-bench Verified (Epoch)Epoch AI Benchmarking Hub–74.8%†
SciCodeSciCode56.6%–
WeirdMLWeirdML84.8%77.9%
FrontierCodeCognition41.2%†–
Arena CodingArena (LMArena)1531–
Arena WebDevArena (LMArena)15841406†
Show all 154 benchmarks
MetricPublisherGemini 3.8 Flash (high)GPT-5.3-Codex (xhigh)
Coding
LiveBench 2.0 CodingLiveBench65.7%†–
LiveBench 1.0 CodingLiveBench72.5%–
LiveCodeBenchVals AI89.5%87.3%
IOIVals AI56.9%53.8%
SWE-bench (Vals)Vals AI80.0%78.0%
Code MigrationVals AI36.5%–
Code Migration v1.1Vals AI38.6%–
ProgramBenchVals AI1.0%–
SWE-bench MultimodalVals AI40.8%–
Vibe Code Bench 1-100Vals AI18.8%–
Vibe Code Bench v1.1Vals AI78.7%61.8%
SWE Atlas: Codebase QnAScale AI SEAL47.0%†–
SWE Atlas: RefactoringScale AI SEAL44.8%†–
SWE Atlas: Test WritingScale AI SEAL53.7%†–
Surface Evolver BenchEpoch AI Benchmarking Hub76.9%–
DeepSWE v1.1Epoch AI Benchmarking Hub73.8%–
CursorBenchCursor39.6%–
ALE-BenchEpoch AI Benchmarking Hub1269.71655.2
FrontierSWEEpoch AI Benchmarking Hub19.6%–
Terminal-Bench 4.0 (AA)Artificial Analysis19.7%–
Terminal-Bench 2.1 (AA)Artificial Analysis87.6%–
Startrise FrontendStartrise64.6%†–
GameBench 2 OverallDuelLab GameBench 259.0†–
GameBench 2 by reasoning settingDuelLab GameBench 264.2–
Design Arena WebsiteDesign Arena1296†1159†
FrontierCode 1.1 (AA)Artificial Analysis36.4%–
FrontierCode 2.0 (AA)Artificial Analysis18.7%–
Agents & tools
Terminal-BenchTerminal-Bench18.2%78.4%†
Remote Labor IndexScale AI / CAIS5.8%†–
APEX-AgentsMercor64.3%†–
Arena AgentArena (LMArena)2.4–
LiveBench Long AgenticLiveBench16.5%†–
LiveBench BrowserLiveBench45.1%†–
LiveBench Agentic CodingLiveBench54.2%–
Terminal-Bench HardArtificial Analysis–53.0%
τ²-Bench Telecom (AA)Artificial Analysis–86.0%
Terminal-Bench 2.1 (Vals)Vals AI81.3%–
HiL-BenchScale AI SEAL41.5%†4.3%†
GDPval-AA v2.1, normalised scoreArtificial Analysis46.8%–
GDPval-AA v2.1Artificial Analysis1445–
τ³-Banking (AA)Artificial Analysis45.0%–
ITBench SRE (AA)Artificial Analysis52.5%–
Analyst Agent (AA)Artificial Analysis46.3%–
CUA-benchVals AI4.2%–
CyberBenchVals AI43.8%–
Finance Agent v2Vals AI61.4%–
Finance Agent v2.1Vals AI65.8%–
Harvey's Legal Agent Benchmark v1.1Vals AI12.1%–
Harvey's Legal Agent Benchmark v1Vals AI10.0%–
Legal Research BenchVals AI38.9%–
SkillsBenchVals AI58.0%–
SREBenchVals AI11.1%–
Tax Agent BenchVals AI32.1%–
Terminal-Bench 2.0 (Vals)Vals AI–64.0%†
Terminal-Bench 4.0 (Vals)Vals AI19.7%–
Terminal-Bench ScienceVals AI8.6%–
Time Horizon Index: KSPVals AI18.8%–
METR Time HorizonsMETR–74.5%†
Vending-Bench 2Andon Labs5093.8†5940.1†
AutomationBenchArtificial Analysis59.9%–
GDP.pdf (AA)Artificial Analysis21.0%–
Harvey LAB-AA v1.1Harvey0.0%–
AA-Briefcase v1.1Artificial Analysis1203868
Design Arena AgenticDesign Arena1217†1011†
Terminal-Bench-Science 0.1 (AA)Artificial Analysis10.0%–
CWE-Bench (AA)Artificial Analysis52.5%–
DeepSec-Bench (AA)Artificial Analysis14.5%–
CyberGym end-to-end (AA)Artificial Analysis8.4%–
FACTS SearchGoogle80.4%†–
Maths
FrontierMath Tiers 1–3Epoch AI Benchmarking Hub68.4%–
FrontierMath Tier 4Epoch AI Benchmarking Hub21.9%–
OTIS Mock AIMEEpoch AI Benchmarking Hub98.9%–
ProofBenchVals AI48.0%†–
LiveBench MathematicsLiveBench91.6%–
Arena MathsArena (LMArena)1520–
Knowledge
SimpleQA VerifiedEpoch AI Benchmarking Hub69.7%–
LiveBench 2.0 Data AnalysisLiveBench54.0%†–
LiveBench ResearchLiveBench79.4%†–
LiveBench 1.0 Data AnalysisLiveBench54.0%–
AA-Omniscience v1.1Artificial Analysis23.3–
MMLU-ProVals AI90.2%–
LegalBenchVals AI87.0%–
TaxEvalVals AI74.5%–
PRBench FinanceScale AI SEAL49.5%†–
PRBench LegalScale AI SEAL48.9%†–
BioMysteryBenchVals AI62.2%–
Excel Modeling BenchmarkVals AI72.2%–
Excel Modeling Benchmark v1.1Vals AI72.9%–
MedCodeVals AI48.1%–
MedScribeVals AI84.5%–
Public Benefits Bench v1.1Vals AI65.3%–
GDP.pdfEpoch AI Benchmarking Hub23.2%–
AA-Omniscience v1.1: accuracyArtificial Analysis50.5%–
AA-Omniscience v1.1: non-hallucinationArtificial Analysis44.9%–
HealthBench Professional (AA)OpenAI51.7%–
Instruction following
LiveBench LanguageLiveBench87.8%–
LiveBench Instruction FollowingLiveBench81.4%–
IFBenchArtificial Analysis–75.4%
Arena Instruction FollowingArena (LMArena)1492–
Human preference
Arena TextArena (LMArena)1498–
Arena Creative WritingArena (LMArena)1489–
Arena Multi-turnArena (LMArena)1505–
Arena Longer QueriesArena (LMArena)1511–
Multimodal
Arena VisionArena (LMArena)1317–
LiveBench DesignLiveBench69.7%†–
MMMU-ProArtificial Analysis85.6%78.5%
MMMU-Pro (Vals)Vals AI89.1%–
MortgageTaxVals AI65.3%–
SAGEVals AI88.2%–
AudioMCScale AI SEAL60.4%–
AudioMC (text output)Scale AI SEAL60.4%–
Blueprint-Bench 2Epoch AI Benchmarking Hub38.6%†–
Code2Video-AAArtificial Analysis899–
AA-3DArtificial Analysis974–
Long context
AA-LCR v1.1Artificial Analysis81.3%83.3%
Arena DocumentArena (LMArena)1469–
MLCRArtificial Analysis10.6%–
Composite
Epoch Capabilities IndexEpoch AI Benchmarking Hub158.7†–
LiveBench 2.0LiveBench56.0%†–
LiveBench 1.0LiveBench75.8%–
AA Intelligence Index v5.0Artificial Analysis30.9–
AA Intelligence Index v4.3.2Artificial Analysis40.932.5
AA Progress Index v1Artificial Analysis320.3301.3
Vals IndexVals AI56.0–
Vals Finance IndexVals AI60.5%–
Vals RSI IndexVals AI19.9%–
Vals Science IndexVals AI35.8%–
Vals Router IndexVals AI56.0%†–
AA Cyber IndexArtificial Analysis25.1–

Data as of 2026-11-10. Best configuration of each model; every score links to its source on the model pages.

DuelLab GameBench 2, release gb2-20261103-eaea31df94e6 (https://benchmarks.duellab.org/releases/gb2-20261103-eaea31df94e6/), CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Scores mapped to BenchLeader model names; not endorsed by DuelLab.

What changed

  • Gemini 3.8 Flash: list price moves to $1.50 / $7.50 per 1M input / output tokens (announced).
  • Gemini 3.8 Flash (high): 2 score revisions.
  • Gemini 3.8 Flash (high): 1 new result (Arena Document); 1 score revision.
  • Gemini 3.8 Flash (high): 2 score revisions.
  • Gemini 3.8 Flash (high): 1 new result (MirrorCode).
  • Gemini 3.8 Flash (high): 1 score revision.
  • GPT-5.3-Codex (xhigh): 1 new result (AA-Briefcase v1.1).
  • Gemini 3.8 Flash (high): BenchLeader Index 63.3 → 61.8.
  • Gemini 3.8 Flash (high): 5 new results (AA Intelligence Index v5.0, AA Progress Index v1, HLE-Diamond (AA)…); 3 score revisions; cost per task moved from $3.49/M to $7.77/M (123% up).
  • GPT-5.3-Codex (xhigh): 1 new result (AA Progress Index v1).

Rankings: Best LLM overall · Best LLM for agents · Best cheap LLMs

Gemini 3.8 Flash vs GPT-5.3-Codex: questions

Is Gemini 3.8 Flash better than GPT-5.3-Codex?
Gemini 3.8 Flash (high) and GPT-5.3-Codex (xhigh) are neck and neck on quality (61.8 vs 62.9, within the ±7.8 margin). The BenchLeader Index combines every independent quality benchmark; the two are within the margin of error as of 10 Nov 2026, so check the category scores for your use.
Gemini 3.8 Flash vs GPT-5.3-Codex: which is cheaper, and will that change?
Gemini 3.8 Flash is cheaper today: $1.50 against $4.81 per million tokens, blended at three input tokens per output token. Gemini 3.8 Flash's current price runs until 31 Dec 2026, then $3.00.
Is Gemini 3.8 Flash or GPT-5.3-Codex better for coding?
They are level in coding (60 vs 61 on the category index). On LiveCodeBench, the top shared coding benchmark, it is 89.5% for Gemini 3.8 Flash against 87.3% for GPT-5.3-Codex.
Which is faster, Gemini 3.8 Flash or GPT-5.3-Codex?
Gemini 3.8 Flash streams faster (112 vs 76 output tokens per second, Artificial Analysis 7-day median).
Is Gemini 3.8 Flash or GPT-5.3-Codex better for agents and tool use?
GPT-5.3-Codex scores higher in agentic tasks (80 vs 51 on the category index, where 50 is average).
More questions (4)
Which is better for long documents?
GPT-5.3-Codex scores higher on long-context benchmarks (66 vs 65). Gemini 3.8 Flash accepts more context: 1,048,576 against 400,000 tokens for GPT-5.3-Codex.
Which has lower latency?
Gemini 3.8 Flash answers first: 16.6 s against 39.0 s to the first answer token, as Artificial Analysis measures it. Reasoning effort drives most of this: a higher setting thinks longer before it answers.
Do independent benchmarks agree on Gemini 3.8 Flash vs GPT-5.3-Codex?
Across the 13 benchmarks both have, Gemini 3.8 Flash leads 11, GPT-5.3-Codex leads 2.
When was Gemini 3.8 Flash released?
Gemini 3.8 Flash was released on 2 Sep 2026.