BenchLeader

Gemini 3.7 Flash vs o3

Verdict
  • Gemini 3.7 Flash (medium) leads on quality: 64.5 vs 61.6.
  • Gemini 3.7 Flash (medium) is stronger in coding, composite, knowledge, long context, multimodal, reasoning.
  • o3 is stronger in agents & tools, human preference, instruction following, maths.
  • Gemini 3.7 Flash (medium) is 2.3× cheaper ($1.50 vs $3.50 per 1M blended).
  • Gemini 3.7 Flash (medium) streams 2.6× faster (277 vs 107 tokens per second).
MetricGemini 3.7 Flash (medium)o3
BenchLeader Index64.561.6
Coding score68.562.0
Composite score79.254.5
Knowledge score75.558.0
Long context score68.163.8
Multimodal score69.457.9
Reasoning score63.561.5
Agents & tools score70.3
Human preference score62.3
Instruction following score65.0
Maths score78.6
Blended price $/M$1.50$3.50
Output speed277 tok/s107 tok/s
Time to first answer4.4 s6.3 s
Context window1.0M200k
SciCode57.9%
Epoch Capabilities Index146.9
LMArena Text1432
LMArena Hard Prompts1441
LMArena Coding1460
LMArena Vision1214
AA Intelligence Index39.620.2
IFBench71.4%
AA-LCR83.0%74.7%
MMMU-Pro84.7%70.1%
AA-Omniscience23.7-15.6
Terminal-Bench Hard37.1%
GPQA Diamond (AA)92.1%82.7%
Humanity's Last Exam (AA)39.0%20.1%
SciCode (AA)59.8%
τ²-Bench Telecom (AA)80.7%
PRBench Finance47.7%
PRBench Legal48.6%
MMMU (validation)82.9%
MMMU-Pro (official)76.4%
Kagi LLM Benchmark67.6%
IFEval (HELM)86.9%
Omni-MATH (HELM)71.4%
WildBench (HELM)86.1%
MMLU-Pro (HELM)85.9%
GPQA Diamond (HELM)75.3%
HELM Capabilities mean81.1%
Aider Polyglot81.3%
SWE-bench Verified (bash only)58.4%
SWE-bench Verified (any scaffold)58.4%
ARC-AGI-191.2%
ARC-AGI-263.8%
BFCL Overall63.0%

Data as of 2026-09-12. Best configuration of each model; every score links to its source on the model pages.

Gemini 3.7 Flash vs o3: questions

Is Gemini 3.7 Flash better than o3?
Gemini 3.7 Flash (medium) leads on quality: 64.5 vs 61.6. The BenchLeader Index combines every independent quality benchmark; Gemini 3.7 Flash (medium) is ahead overall as of 2026-09-12, but check the category scores for your use.
Is Gemini 3.7 Flash better than o3 for coding?
Gemini 3.7 Flash scores higher in coding (69 vs 62 on the category index, where 50 is average).
Which is cheaper, Gemini 3.7 Flash or o3?
Gemini 3.7 Flash is cheaper: $1.50 against $3.50 per million tokens, blended at three input tokens per output token.
Which is faster, Gemini 3.7 Flash or o3?
Gemini 3.7 Flash streams faster: 277 against 107 output tokens per second.
Which has the larger context window?
Gemini 3.7 Flash accepts more context: 1.0M against 200k tokens.