BenchLeader

GPT-6.1 Sol vs Qwen3.8 Max

Verdict
  • GPT-6.1 Sol (max) leads on quality: 69.3 vs 64.2.
  • GPT-6.1 Sol (max) is stronger in agents & tools, coding, composite, human preference, knowledge, long context, maths, reasoning.
  • Qwen3.8 Max (max) is 1.3× cheaper ($3.00 vs $4.00 per 1M blended).
  • GPT-6.1 Sol (max) streams 1.5× faster (56 vs 37 tokens per second).
MetricGPT-6.1 Sol (max)Qwen3.8 Max (max)
BenchLeader Index69.364.2
Agents & tools score63.958.2
Coding score72.464.6
Composite score79.070.7
Human preference score68.168.0
Knowledge score78.862.7
Long context score66.865.4
Maths score72.565.1
Multimodal score66.266.2
Reasoning score76.472.2
Blended price $/M$4.00$3.00
Output speed56 tok/s37 tok/s
Time to first answer326.9 s58.9 s
Context window1.1M1M
GPQA Diamond95.4%–
FrontierMath Tiers 1–393.7%–
FrontierMath Tier 4100.0%–
OTIS Mock AIME100.0%–
SimpleQA Verified73.9%–
Terminal-Bench58.2%27.0%
SciCode54.2%53.2%
APEX-Agents60.0%63.3%
ProofBench–58.0%
Epoch Capabilities Index–156.4
LMArena Text14841483
LMArena Hard Prompts15071504
LMArena Coding15451524
LMArena WebDev17551672
LMArena Vision12881314
LMArena Agent11.72.3
LiveBench81.6%78.5%
LiveBench Reasoning92.6%88.2%
LiveBench Coding80.4%72.9%
LiveBench Agentic Coding54.5%64.7%
LiveBench Mathematics96.8%91.3%
LiveBench Data Analysis82.7%78.4%
LiveBench Language90.1%79.7%
LiveBench Instruction Following74.2%74.1%
AA Intelligence Index v4.3.251.845.4
AA-LCR83.0%80.3%
MMMU-Pro86.0%82.8%
AA-Omniscience41.512.0
GPQA Diamond (AA)–92.8%
Humanity's Last Exam (AA)52.9%43.1%
SciCode (AA)54.2%53.2%
LiveCodeBench–87.8%
MMLU-Pro–88.6%
IOI96.9%68.9%
LegalBench–83.6%
CorpFin–65.8%
TaxEval–75.5%
Terminal-Bench 2.1 (Vals)–67.4%
SWE-bench (Vals)–85.6%
GPQA Diamond (Vals)–93.7%
Vals Index61.148.3
ARC-AGI-196.5%–
ARC-AGI-294.2%–
ARC-AGI-396.2%–
CritPt31.7%20.0%
GDPval-AA v2.153.8%58.6%
τ³-Banking (AA)–51.3%
ITBench SRE (AA)–40.3%
Analyst Agent (AA)50.0%45.0%
APEX-Agents (AA)–42.4%
BioMysteryBench79.6%–
Code Migration65.1%24.0%
CyberBench39.3%28.6%
Excel Modeling Benchmark70.8%60.1%
Finance Agent v252.0%50.6%
Harvey's Legal Agent Benchmark5.4%10.4%
Legal Research Bench38.5%47.6%
MedCode48.8%40.7%
MedScribe86.5%85.0%
MMMU-Pro (Vals)–88.0%
MortgageTax–64.0%
MysteryMechanism46.4%23.9%
ProgramBench–0.0%
Public Benefits Bench59.3%67.1%
SAGE46.5%51.3%
SkillsBench–42.0%
SREBench50.8%–
Tax Agent Bench62.3%66.0%
Terminal-Bench 4.0 (Vals)55.0%34.3%
Terminal-Bench Science–1.4%
Vals Multimodal Index–65.4%
Vibe Code Bench 1-100–12.8%
Vibe Code Bench v1.188.9%64.7%
LMArena Maths14881497
LMArena Creative Writing14621470
LMArena Instruction Following14881474
LMArena Multi-turn14871492
LMArena Longer Queries14961492
Chess Puzzles61.0%–
EBR-bench54.3%–
Mystery Game Puzzles80.0%–
Terminal-Bench 4.0 (AA)56.1%38.9%
Terminal-Bench 2.1 (AA)–88.8%
AutomationBench64.9%56.2%
GDP.pdf31.0%22.8%
MLCR33.9%20.0%
Harvey LAB6.9%–
EnterpriseOps-Gym–47.6%
AA-Omniscience: accuracy62.1%31.9%
AA-Omniscience: non-hallucination45.7%71.2%
AA-Briefcase v1.115571617

Data as of 2026-10-11. Best configuration of each model; every score links to its source on the model pages.

GPT-6.1 Sol vs Qwen3.8 Max: questions

Is GPT-6.1 Sol better than Qwen3.8 Max?
GPT-6.1 Sol (max) leads on quality: 69.3 vs 64.2. The BenchLeader Index combines every independent quality benchmark; GPT-6.1 Sol (max) is ahead overall as of 2026-10-11, but check the category scores for your use.
Is GPT-6.1 Sol better than Qwen3.8 Max for coding?
GPT-6.1 Sol scores higher in coding (72 vs 65 on the category index, where 50 is average).
Is GPT-6.1 Sol better than Qwen3.8 Max for agentic tasks?
GPT-6.1 Sol scores higher in agentic tasks (64 vs 58 on the category index, where 50 is average).
Which is cheaper, GPT-6.1 Sol or Qwen3.8 Max?
Qwen3.8 Max is cheaper: $3.00 against $4.00 per million tokens, blended at three input tokens per output token.
Which is faster, GPT-6.1 Sol or Qwen3.8 Max?
GPT-6.1 Sol streams faster: 56 against 37 output tokens per second.
Which has the larger context window?
GPT-6.1 Sol accepts more context: 1.1M against 1M tokens.