BenchLeader

Gemini 3.1 Pro vs GPT-6 Sol

Verdict
  • GPT-6 Sol (max) leads on quality: 67.7 vs 63.0.
  • Gemini 3.1 Pro is stronger in agents & tools, coding, human preference, instruction following, maths.
  • GPT-6 Sol (max) is stronger in composite, knowledge, long context, multimodal, reasoning.
  • They cost about the same ($4.00 per 1M blended).
MetricGemini 3.1 ProGPT-6 Sol (max)
BenchLeader Index63.067.7
Agents & tools score57.3
Coding score59.5
Composite score64.886.2
Human preference score59.8
Instruction following score69.7
Knowledge score65.275.4
Long context score66.867.7
Maths score61.9
Multimodal score65.667.1
Reasoning score69.695.0
Blended price $/M$4.50$4.00
Output speed116 tok/s126 tok/s
Time to first answer33.0 s107.2 s
Context window1.0M1.1M
GPQA Diamond94.1%
FrontierMath Tiers 1–359.6%
FrontierMath Tier 426.8%
OTIS Mock AIME95.6%
Humanity's Last Exam46.4%
Terminal-Bench80.2%
SimpleBench79.6%
SciCode58.9%
WeirdML72.1%
APEX-Agents35.3%
ProofBench26.0%
GSO-Bench22.6%
Epoch Capabilities Index154.9
LMArena Text1487
LMArena Hard Prompts1508
LMArena Coding1520
LMArena WebDev1447
LMArena Vision1296
LMArena Agent-5.8
AA Intelligence Index29.747.5
IFBench77.1%
AA-LCR82.0%83.7%
MMMU-Pro82.4%83.3%
AA-Omniscience31.927.1
Terminal-Bench Hard53.8%
GPQA Diamond (AA)94.1%
Humanity's Last Exam (AA)47.0%47.9%
SciCode (AA)58.7%57.6%
τ²-Bench Telecom (AA)95.6%
AIME 202698.3%
HMMT February 202694.7%
MathArena Apex60.9%
MultiChallenge71.4%
PRBench Finance41.9%
PRBench Legal44.0%
MultiNRC64.7%
HiL-Bench35.3%
TutorBench53.0%
EQ-Bench 41142
ARC-AGI-198.0%
ARC-AGI-277.1%
ARC-AGI-30.4%
CritPt17.7%30.9%
GDPval (AA)13.8%49.4%
τ²-Bench Banking (AA)21.4%
ITBench SRE (AA)30.3%
Analyst Agent (AA)41.3%
APEX-Agents (AA)32.0%
FORTRESS29.8%
MASK42.4%
SWE Atlas: Codebase QnA13.5%
SWE Atlas: Refactoring33.8%
SWE Atlas: Test Writing29.8%
VTB29.0%
LMArena Maths1489
LMArena Creative Writing1480
LMArena Instruction Following1481
LMArena Multi-turn1495
LMArena Longer Queries1500
LMArena Document1459
Chess Puzzles55.0%
EBR-bench14.3%
BALROG57.0%
PostTrainBench22.0%
ExploitBench26.1%
CL-bench20.8%
CL-bench Life16.9%
METR Time Horizons77.0%
DeepSWE11.7%
ForecastBench59.0%
GBAEval0.8%
ALE-Bench1160.6
AlgoTune2.0
Vending-Bench 2911.2
Blueprint-Bench 226.5%
GDP.pdf17.0%
Terminal-Bench 4.0 (AA)4.0%43.9%
Terminal-Bench 2.1 (AA)73.8%
AutomationBench61.6%
GDP.pdf24.8%
MLCR16.1%
AA-Omniscience: accuracy54.9%54.5%
AA-Omniscience: non-hallucination49.1%39.9%
AA-Briefcase1483
BrowseComp31.2%
DeepSearchQA60.2%
FACTS Search83.7%

Data as of 2026-09-23. Best configuration of each model; every score links to its source on the model pages.

Gemini 3.1 Pro vs GPT-6 Sol: questions

Is Gemini 3.1 Pro better than GPT-6 Sol?
GPT-6 Sol (max) leads on quality: 67.7 vs 63.0. The BenchLeader Index combines every independent quality benchmark; GPT-6 Sol (max) is ahead overall as of 2026-09-23, but check the category scores for your use.
Which is cheaper, Gemini 3.1 Pro or GPT-6 Sol?
GPT-6 Sol is cheaper: $4.00 against $4.50 per million tokens, blended at three input tokens per output token.
Which is faster, Gemini 3.1 Pro or GPT-6 Sol?
GPT-6 Sol streams faster: 126 against 116 output tokens per second.
Which has the larger context window?
GPT-6 Sol accepts more context: 1.1M against 1.0M tokens.