BenchLeader

Gemini 3 Pro vs GPT-6.1 Sol

Verdict
  • GPT-6.1 Sol (max) leads on quality: 69.3 vs 60.6.
  • Gemini 3 Pro is stronger in human preference, instruction following.
  • GPT-6.1 Sol (max) is stronger in agents & tools, coding, knowledge, maths, multimodal, reasoning, composite, long context.
MetricGemini 3 ProGPT-6.1 Sol (max)
BenchLeader Index60.669.3
Agents & tools score61.863.9
Coding score57.972.4
Human preference score68.368.1
Instruction following score61.0–
Knowledge score56.478.8
Maths score54.472.5
Multimodal score65.666.2
Reasoning score65.876.4
Composite score–79.0
Long context score–66.8
Blended price $/M–$4.00
Output speed–56 tok/s
Time to first answer–326.9 s
Context window–1.1M
GPQA Diamond92.6%95.4%
FrontierMath Tiers 1–3–93.7%
FrontierMath Tier 4–100.0%
OTIS Mock AIME91.4%100.0%
SWE-bench Verified (Epoch)72.9%–
SimpleQA Verified–73.9%
Humanity's Last Exam37.5%–
Terminal-Bench69.4%58.2%
SimpleBench76.4%–
GDPval40.3%–
SciCode–54.2%
Remote Labor Index1.3%–
WeirdML69.9%–
APEX-Agents–60.0%
ProofBench20.0%–
GSO-Bench18.6%–
Epoch Capabilities Index152.9–
LMArena Text14861484
LMArena Hard Prompts15021507
LMArena Coding15171545
LMArena WebDev14401755
LMArena Vision13051288
LMArena Agent–11.7
LiveBench–81.6%
LiveBench Reasoning–92.6%
LiveBench Coding–80.4%
LiveBench Agentic Coding–54.5%
LiveBench Mathematics–96.8%
LiveBench Data Analysis–82.7%
LiveBench Language–90.1%
LiveBench Instruction Following–74.2%
AA Intelligence Index v4.3.2–51.8
AA-LCR–83.0%
MMMU-Pro–86.0%
AA-Omniscience–41.5
Humanity's Last Exam (AA)–52.9%
SciCode (AA)–54.2%
LiveCodeBench86.4%–
MMLU-Pro90.1%–
IOI–96.9%
Vals Index–61.1
AIME 202691.7%–
HMMT February 202686.4%–
MathArena Apex23.4%–
SWE-Bench Pro43.3%–
MCP Atlas70.3%–
MultiChallenge65.7%–
PRBench Finance39.2%–
PRBench Legal40.6%–
VISTA51.5%–
MultiNRC59.0%–
TutorBench53.7%–
MMMU-Pro (official)81.0%–
Kagi LLM Benchmark80.1%–
IFEval (HELM)87.6%–
Omni-MATH (HELM)55.6%–
WildBench (HELM)85.9%–
MMLU-Pro (HELM)90.3%–
GPQA Diamond (HELM)80.3%–
HELM Capabilities mean79.9%–
SWE-bench Verified (bash only)74.2%–
SWE-bench Verified (any scaffold)74.2%–
ARC-AGI-175.0%96.5%
ARC-AGI-254.0%94.2%
ARC-AGI-3–96.2%
BFCL Overall72.5%–
CritPt–31.7%
GDPval-AA v2.1–53.8%
Analyst Agent (AA)–50.0%
BioMysteryBench–79.6%
Code Migration–65.1%
CyberBench–39.3%
Excel Modeling Benchmark–70.8%
Finance Agent v2–52.0%
Harvey's Legal Agent Benchmark–5.4%
Legal Research Bench–38.5%
MedCode–48.8%
MedScribe–86.5%
MysteryMechanism–46.4%
Poker Agent1078.9%–
Public Benefits Bench–59.3%
SAGE–46.5%
SREBench–50.8%
Tax Agent Bench–62.3%
Terminal-Bench 4.0 (Vals)–55.0%
Vibe Code Bench v1.1–88.9%
FORTRESS41.7%–
MASK42.6%–
PropensityBench52.9%–
SciPredict25.3%–
SWE-Bench Pro (private)43.3%–
LMArena Maths14771488
LMArena Creative Writing14851462
LMArena Instruction Following14731488
LMArena Multi-turn14961487
LMArena Longer Queries14911496
LMArena Document1451–
Chess Puzzles31.0%61.0%
EBR-bench–54.3%
Mystery Game Puzzles–80.0%
BALROG58.1%–
GeoBench84.0%–
VPCT91.0%–
CL-bench15.8%–
METR Time Horizons71.0%–
ForecastBench61.2%–
ALE-Bench1176.8–
AlgoTune1.8–
Vending-Bench 25478.2–
Terminal-Bench 4.0 (AA)–56.1%
AutomationBench–64.9%
GDP.pdf–31.0%
MLCR–33.9%
Harvey LAB–6.9%
AA-Omniscience: accuracy–62.1%
AA-Omniscience: non-hallucination–45.7%
AA-Briefcase v1.1–1557

Data as of 2026-10-11. Best configuration of each model; every score links to its source on the model pages.

Gemini 3 Pro vs GPT-6.1 Sol: questions

Is Gemini 3 Pro better than GPT-6.1 Sol?
GPT-6.1 Sol (max) leads on quality: 69.3 vs 60.6. The BenchLeader Index combines every independent quality benchmark; GPT-6.1 Sol (max) is ahead overall as of 2026-10-11, but check the category scores for your use.
Is Gemini 3 Pro better than GPT-6.1 Sol for coding?
GPT-6.1 Sol scores higher in coding (72 vs 58 on the category index, where 50 is average).
Is Gemini 3 Pro better than GPT-6.1 Sol for agentic tasks?
GPT-6.1 Sol scores higher in agentic tasks (64 vs 62 on the category index, where 50 is average).