BenchLeader

GPT-6 Sol vs Qwen3 7

Verdict
  • GPT-6 Sol (max) leads on quality: 67.7 vs 60.7.
  • GPT-6 Sol (max) is stronger in composite, knowledge, long context, multimodal, reasoning.
  • Qwen3 7 (max) is stronger in agents & tools, coding, human preference, instruction following, maths.
  • They cost about the same ($3.75 per 1M blended).
  • Qwen3 7 (max) streams 1.6× faster (197 vs 126 tokens per second).
MetricGPT-6 Sol (max)Qwen3 7 (max)
BenchLeader Index67.760.7
Composite score86.255.1
Knowledge score75.463.3
Long context score67.765.3
Multimodal score67.1
Reasoning score95.066.4
Agents & tools score49.6
Coding score60.7
Human preference score57.1
Instruction following score77.9
Maths score60.4
Blended price $/M$4.00$3.75
Output speed126 tok/s197 tok/s
Time to first answer107.2 s14.5 s
Context window1.1M1M
GPQA Diamond90.9%
FrontierMath Tiers 1–364.6%
FrontierMath Tier 434.1%
OTIS Mock AIME95.6%
SWE-bench Verified (Epoch)77.3%
SimpleQA Verified55.8%
SimpleBench70.4%
SciCode48.8%
ProofBench26.0%
Epoch Capabilities Index153.7
LMArena Text1473
LMArena Hard Prompts1495
LMArena Coding1525
LMArena WebDev1517
LMArena Agent-3.6
LiveBench73.1%
LiveBench Reasoning83.3%
LiveBench Coding74.2%
LiveBench Agentic Coding43.6%
LiveBench Mathematics85.3%
LiveBench Data Analysis71.8%
LiveBench Language79.7%
LiveBench Instruction Following74.0%
AA Intelligence Index47.529.5
IFBench80.5%
AA-LCR83.7%79.0%
MMMU-Pro83.3%
AA-Omniscience27.113.5
Terminal-Bench Hard50.8%
GPQA Diamond (AA)92.3%
Humanity's Last Exam (AA)47.9%40.5%
SciCode (AA)57.6%49.5%
τ²-Bench Telecom (AA)94.7%
LiveCodeBench87.1%
MMLU-Pro89.3%
LegalBench84.9%
CorpFin63.7%
TaxEval75.3%
Terminal-Bench 2.1 (Vals)61.0%
SWE-bench (Vals)68.8%
GPQA Diamond (Vals)90.2%
Vals Index44.8
EQ-Bench 41110
CritPt30.9%13.4%
GDPval (AA)49.4%30.7%
τ²-Bench Banking (AA)11.8%
ITBench SRE (AA)42.5%
Analyst Agent (AA)18.8%
Code Migration13.1%
Excel Modeling Benchmark57.0%
Finance Agent v247.8%
Harvey's Legal Agent Benchmark1.7%
Legal Research Bench25.5%
MedCode38.8%
MedScribe79.4%
Terminal-Bench 2.0 (Vals)59.2%
Vibe Code Bench v1.147.7%
LMArena Maths1489
LMArena Creative Writing1444
LMArena Instruction Following1464
LMArena Multi-turn1482
LMArena Longer Queries1494
Chess Puzzles19.0%
EBR-bench9.5%
Mystery Game Puzzles32.0%
LMCA44.0%
DTBench92.3%
GBAEval0.4%
ALE-Bench1189.4
Terminal-Bench 4.0 (AA)43.9%1.5%
Terminal-Bench 2.1 (AA)74.5%
AutomationBench61.6%
GDP.pdf24.8%
MLCR16.1%
AA-Omniscience: accuracy54.5%31.1%
AA-Omniscience: non-hallucination39.9%74.4%
AA-Briefcase1483

Data as of 2026-09-23. Best configuration of each model; every score links to its source on the model pages.

GPT-6 Sol vs Qwen3 7: questions

Is GPT-6 Sol better than Qwen3 7?
GPT-6 Sol (max) leads on quality: 67.7 vs 60.7. The BenchLeader Index combines every independent quality benchmark; GPT-6 Sol (max) is ahead overall as of 2026-09-23, but check the category scores for your use.
Which is cheaper, GPT-6 Sol or Qwen3 7?
Qwen3 7 is cheaper: $3.75 against $4.00 per million tokens, blended at three input tokens per output token.
Which is faster, GPT-6 Sol or Qwen3 7?
Qwen3 7 streams faster: 197 against 126 output tokens per second.
Which has the larger context window?
GPT-6 Sol accepts more context: 1.1M against 1M tokens.