BenchLeader

Gemini 3.8 Flash vs o3

Verdict
  • Gemini 3.8 Flash (medium) leads on quality: 63.6 vs 61.6.
  • Gemini 3.8 Flash (medium) is stronger in coding, composite, knowledge, long context, multimodal.
  • o3 is stronger in agents & tools, human preference, instruction following, maths, reasoning.
  • Gemini 3.8 Flash (medium) is 2.3× cheaper ($1.50 vs $3.50 per 1M blended).
  • Gemini 3.8 Flash (medium) streams 2.5× faster (269 vs 107 tokens per second).
MetricGemini 3.8 Flash (medium)o3
BenchLeader Index63.661.6
Coding score63.862.0
Composite score79.754.5
Knowledge score77.958.0
Long context score68.663.8
Multimodal score68.957.9
Agents & tools score70.3
Human preference score62.3
Instruction following score65.0
Maths score78.6
Reasoning score61.5
Blended price $/M$1.50$3.50
Output speed269 tok/s107 tok/s
Time to first answer11.8 s6.3 s
Context window1.0M200k
SciCode54.4%
Epoch Capabilities Index146.9
LMArena Text1432
LMArena Hard Prompts1441
LMArena Coding1460
LMArena Vision1214
AA Intelligence Index4020.2
IFBench71.4%
AA-LCR84.0%74.7%
MMMU-Pro84.2%70.1%
AA-Omniscience28.6-15.6
Terminal-Bench Hard37.1%
GPQA Diamond (AA)93.5%82.7%
Humanity's Last Exam (AA)42.1%20.1%
SciCode (AA)55.1%
τ²-Bench Telecom (AA)80.7%
PRBench Finance47.7%
PRBench Legal48.6%
MMMU (validation)82.9%
MMMU-Pro (official)76.4%
Kagi LLM Benchmark67.6%
IFEval (HELM)86.9%
Omni-MATH (HELM)71.4%
WildBench (HELM)86.1%
MMLU-Pro (HELM)85.9%
GPQA Diamond (HELM)75.3%
HELM Capabilities mean81.1%
Aider Polyglot81.3%
SWE-bench Verified (bash only)58.4%
SWE-bench Verified (any scaffold)58.4%
BFCL Overall63.0%

Data as of 2026-09-12. Best configuration of each model; every score links to its source on the model pages.

Gemini 3.8 Flash vs o3: questions

Is Gemini 3.8 Flash better than o3?
Gemini 3.8 Flash (medium) leads on quality: 63.6 vs 61.6. The BenchLeader Index combines every independent quality benchmark; Gemini 3.8 Flash (medium) is ahead overall as of 2026-09-12, but check the category scores for your use.
Is Gemini 3.8 Flash better than o3 for coding?
Gemini 3.8 Flash scores higher in coding (64 vs 62 on the category index, where 50 is average).
Which is cheaper, Gemini 3.8 Flash or o3?
Gemini 3.8 Flash is cheaper: $1.50 against $3.50 per million tokens, blended at three input tokens per output token.
Which is faster, Gemini 3.8 Flash or o3?
Gemini 3.8 Flash streams faster: 269 against 107 output tokens per second.
Which has the larger context window?
Gemini 3.8 Flash accepts more context: 1.0M against 200k tokens.