BenchLeader

Gemini 3.1 Pro vs GPT-6.1 Sol

Verdict
  • GPT-6.1 Sol (max) leads on quality: 69.3 vs 62.1.
  • Gemini 3.1 Pro is stronger in instruction following.
  • GPT-6.1 Sol (max) is stronger in agents & tools, coding, composite, human preference, knowledge, long context, maths, multimodal, reasoning.
  • They cost about the same ($4.00 per 1M blended).
  • Gemini 3.1 Pro streams 2.1× faster (114 vs 56 tokens per second).
MetricGemini 3.1 ProGPT-6.1 Sol (max)
BenchLeader Index62.169.3
Agents & tools score56.763.9
Coding score57.372.4
Composite score63.279.0
Human preference score59.568.1
Instruction following score68.4–
Knowledge score64.578.8
Long context score66.366.8
Maths score61.072.5
Multimodal score64.966.2
Reasoning score68.676.4
Blended price $/M$4.50$4.00
Output speed114 tok/s56 tok/s
Time to first answer24.8 s326.9 s
Context window1.0M1.1M
GPQA Diamond94.1%95.4%
FrontierMath Tiers 1–359.6%93.7%
FrontierMath Tier 426.8%100.0%
OTIS Mock AIME95.6%100.0%
SimpleQA Verified–73.9%
Humanity's Last Exam46.4%–
Terminal-Bench80.2%58.2%
SimpleBench79.6%–
SciCode58.9%54.2%
WeirdML72.1%–
APEX-Agents35.3%60.0%
ProofBench26.0%–
GSO-Bench22.6%–
Epoch Capabilities Index154.8–
LMArena Text14871484
LMArena Hard Prompts15081507
LMArena Coding15221545
LMArena WebDev14471755
LMArena Vision12961288
LMArena Agent-7.811.7
LiveBench–81.6%
LiveBench Reasoning–92.6%
LiveBench Coding–80.4%
LiveBench Agentic Coding–54.5%
LiveBench Mathematics–96.8%
LiveBench Data Analysis–82.7%
LiveBench Language–90.1%
LiveBench Instruction Following–74.2%
AA Intelligence Index v4.3.229.751.8
IFBench77.1%–
AA-LCR82.0%83.0%
MMMU-Pro82.4%86.0%
AA-Omniscience31.941.5
Terminal-Bench Hard53.8%–
GPQA Diamond (AA)94.1%–
Humanity's Last Exam (AA)47.0%52.9%
SciCode (AA)58.7%54.2%
τ²-Bench Telecom (AA)95.6%–
IOI–96.9%
Vals Index–61.1
AIME 202698.3%–
HMMT February 202694.7%–
MathArena Apex60.9%–
MultiChallenge71.4%–
PRBench Finance41.9%–
PRBench Legal44.0%–
MultiNRC64.7%–
HiL-Bench35.3%–
TutorBench53.0%–
EQ-Bench 41142–
ARC-AGI-198.0%96.5%
ARC-AGI-277.1%94.2%
ARC-AGI-30.4%96.2%
CritPt17.7%31.7%
GDPval-AA v2.114.7%53.8%
τ³-Banking (AA)21.4%–
ITBench SRE (AA)30.3%–
Analyst Agent (AA)41.3%50.0%
APEX-Agents (AA)32.0%–
BioMysteryBench–79.6%
Code Migration–65.1%
CyberBench–39.3%
Excel Modeling Benchmark–70.8%
Finance Agent v2–52.0%
Harvey's Legal Agent Benchmark–5.4%
Legal Research Bench–38.5%
MedCode–48.8%
MedScribe–86.5%
MysteryMechanism–46.4%
Public Benefits Bench–59.3%
SAGE–46.5%
SREBench–50.8%
Tax Agent Bench–62.3%
Terminal-Bench 4.0 (Vals)–55.0%
Vibe Code Bench v1.1–88.9%
FORTRESS29.8%–
MASK42.4%–
SWE Atlas: Codebase QnA13.5%–
SWE Atlas: Refactoring33.8%–
SWE Atlas: Test Writing29.8%–
LMArena Maths14881488
LMArena Creative Writing14811462
LMArena Instruction Following14801488
LMArena Multi-turn14971487
LMArena Longer Queries15001496
LMArena Document1459–
Chess Puzzles55.0%61.0%
EBR-bench14.3%54.3%
Mystery Game Puzzles–80.0%
BALROG57.0%–
PostTrainBench22.0%–
ExploitBench26.1%–
CL-bench20.8%–
CL-bench Life16.9%–
METR Time Horizons77.0%–
DeepSWE v1.111.7%–
ForecastBench59.0%–
GBAEval0.8%–
ALE-Bench1160.6–
AlgoTune2.0–
Vending-Bench 2911.2–
Blueprint-Bench 226.5%–
GDP.pdf17.0%–
Terminal-Bench 4.0 (AA)4.0%56.1%
Terminal-Bench 2.1 (AA)73.8%–
AutomationBench35.4%64.9%
GDP.pdf17.8%31.0%
MLCR15.6%33.9%
Harvey LAB0.0%6.9%
EnterpriseOps-Gym42.2%–
AA-Omniscience: accuracy54.9%62.1%
AA-Omniscience: non-hallucination49.1%45.7%
AA-Briefcase v1.14561557
BrowseComp31.2%–
DeepSearchQA60.2%–
FACTS Search83.7%–

Data as of 2026-10-11. Best configuration of each model; every score links to its source on the model pages.

Gemini 3.1 Pro vs GPT-6.1 Sol: questions

Is Gemini 3.1 Pro better than GPT-6.1 Sol?
GPT-6.1 Sol (max) leads on quality: 69.3 vs 62.1. The BenchLeader Index combines every independent quality benchmark; GPT-6.1 Sol (max) is ahead overall as of 2026-10-11, but check the category scores for your use.
Is Gemini 3.1 Pro better than GPT-6.1 Sol for coding?
GPT-6.1 Sol scores higher in coding (72 vs 57 on the category index, where 50 is average).
Is Gemini 3.1 Pro better than GPT-6.1 Sol for agentic tasks?
GPT-6.1 Sol scores higher in agentic tasks (64 vs 57 on the category index, where 50 is average).
Which is cheaper, Gemini 3.1 Pro or GPT-6.1 Sol?
GPT-6.1 Sol is cheaper: $4.00 against $4.50 per million tokens, blended at three input tokens per output token.
Which is faster, Gemini 3.1 Pro or GPT-6.1 Sol?
Gemini 3.1 Pro streams faster: 114 against 56 output tokens per second.
Which has the larger context window?
GPT-6.1 Sol accepts more context: 1.1M against 1.0M tokens.