BenchLeader

Gemini 3.1 Pro vs GPT-5.6 Sol

Verdict
  • GPT-5.6 Sol (high) leads on quality: 68.0 vs 63.9.
  • Gemini 3.1 Pro is stronger in human preference, instruction following, long context, maths, reasoning.
  • GPT-5.6 Sol (high) is stronger in agents & tools, coding, composite, knowledge, multimodal.
  • Gemini 3.1 Pro is 1.8× cheaper ($4.50 vs $8.00 per 1M blended).
  • Gemini 3.1 Pro streams 1.9× faster (110 vs 59 tokens per second).
MetricGemini 3.1 ProGPT-5.6 Sol (high)
BenchLeader Index63.968.0
Agents & tools score63.787.6
Coding score59.872.0
Composite score67.282.5
Human preference score59.6
Instruction following score69.567.6
Knowledge score66.173.7
Long context score67.667.4
Maths score60.7
Multimodal score66.166.5
Reasoning score69.562.9
Blended price $/M$4.50$8.00
Output speed110 tok/s59 tok/s
Time to first answer30.5 s31.4 s
Context window1.0M1M
GPQA Diamond94.1%
FrontierMath Tiers 1–359.6%
FrontierMath Tier 426.8%
OTIS Mock AIME95.6%
Humanity's Last Exam46.4%
Terminal-Bench80.2%
SimpleBench79.6%
SciCode58.9%56.9%
WeirdML72.1%88.8%
APEX-Agents33.5%
ProofBench26.0%
GSO-Bench22.6%
Epoch Capabilities Index155
LMArena Text1487
LMArena Hard Prompts1507
LMArena Coding1521
LMArena WebDev1447
LMArena Vision1295
LMArena Agent-5.3
AA Intelligence Index30.442.5
IFBench77.1%69.2%
AA-LCR82.0%81.7%
MMMU-Pro82.4%81.8%
AA-Omniscience31.920.4
Terminal-Bench Hard53.8%62.1%
GPQA Diamond (AA)94.1%92.8%
Humanity's Last Exam (AA)47.0%46.0%
SciCode (AA)58.7%57.8%
τ²-Bench Telecom (AA)95.6%83.3%
AIME 202698.3%
HMMT February 202694.7%
MathArena Apex60.9%
MultiChallenge71.4%
PRBench Finance41.9%
PRBench Legal44.0%
EnigmaEval37.1%
MultiNRC64.7%
HiL-Bench35.3%
TutorBench53.0%
EQ-Bench 41142
ARC-AGI-198.0%97.0%
ARC-AGI-277.1%85.4%
ARC-AGI-30.4%2.2%

Data as of 2026-09-09. Best configuration of each model; every score links to its source on the model pages.