BenchLeader

GLM 5.3 vs Qwen3.8 2.4T A95B

Full profiles: GLM 5.3 (Zhipu AI) and Qwen3.8 2.4T A95B (Alibaba): every benchmark, price and rank.

Updated · Data from 11 sources

As of 16 Nov 2026, GLM 5.3 and Qwen3.8 2.4T A95B are neck and neck on quality (58.8 vs 51.4 on the BenchLeader Index, inside the ±14.6 margin), and GLM 5.3 is 1.4× cheaper at $2.15 vs $3.00 per 1M tokens blended. GLM 5.3 leads in every category we measure both in. GLM 5.3 streams ~1.5× faster.

Key facts (as of 16 Nov 2026)

  • GLM 5.3 scores 58.8 on the BenchLeader Index and Qwen3.8 2.4T A95B scores 51.4 (BenchLeader, 16 Nov 2026).
  • GLM 5.3 costs $2.15 per 1M tokens blended (list price, 16 Nov 2026).
  • Qwen3.8 2.4T A95B costs $3.00 per 1M tokens blended (list price, 16 Nov 2026).
  • GLM 5.3 streams ~1.5× faster than Qwen3.8 2.4T A95B (Artificial Analysis, 7-day median, 16 Nov 2026).
  • Of the 25 benchmarks both models have, GLM 5.3 leads 15 (BenchLeader, 16 Nov 2026).

Which to pick for…

The pick's numbers come first. Category scores on the BenchLeader scale (50 is the average model, 15 points one standard deviation). High confidence means a lead of half a standard deviation or more; under one point is called either.

Use casePickWhyConfidence
Agents & tool useGLM 5.358 vs 48 category score; τ³-Banking (AA) 50.3% vs 49.1%High
ReasoningGLM 5.355 vs 46 category score; HLE-Diamond (AA) 17.9% vs 20.1%High
KnowledgeGLM 5.354 vs 49 category score; AA-Omniscience v1.1 6.0 vs 7.8Medium
Long documentsEither65 vs 65 category score; AA-LCR v1.1 79.7% vs 80.3%Either
Chat quality (human preference)–Only GLM 5.3 has an Arena rating (67 category score)Not comparable
Lowest costGLM 5.3$2.15 vs $3.00 per 1M blended; agentic coding session $0.102 vs $0.144–
Fastest first answerGLM 5.357.6 s (GLM 5.3 (max)) vs 107.3 s (Qwen3.8 2.4T A95B) to the first answer token–
High volume on a budgetNeither flagshipA smaller model is usually the better fit: Cheapest good LLMs, Fastest LLMs–

Key differences

  • GLM 5.3 (max) and Qwen3.8 2.4T A95B are neck and neck on quality (58.8 vs 51.4, within the ±14.6 margin).
  • GLM 5.3 (max) is stronger in agents & tools, knowledge, reasoning.
  • Qwen3.8 2.4T A95B is stronger in long context.
  • GLM 5.3 (max) is 1.4× cheaper ($2.15 vs $3.00 per 1M blended).
  • GLM 5.3 (max) streams 2.2× faster (88 vs 41 tokens per second).

At a glance

SpecGLM 5.3Qwen3.8 2.4T A95B
DeveloperZhipu AIAlibaba
Released18 Aug 202612 Aug 2026
Context window (tokens)1,000,0001,000,000
Compared atGLM 5.3 (max)Qwen3.8 2.4T A95B
Open weightsYesYes
Price in / out / cached input per 1M$1.40 / $4.40 / $0.260$2.00 / $6.00 / $0.250

Category by category

Category scores on the BenchLeader scale: 50 is the average evaluated model, 15 points is one standard deviation. A gap under one point is called level.

CategoryGLM 5.3 (max)Qwen3.8 2.4T A95BLeader
Reasoning54.746.4GLM 5.3
Coding59.7–not comparable
Agents & tools57.647.8GLM 5.3
Maths60.0–not comparable
Knowledge53.549.0GLM 5.3
Human preference67.2–not comparable
Long context64.564.8level

On one chart

Each domain on the index's own scale, where 50 is an average model. Click a domain to see the benchmarks behind it. Pick up to 5 models from the list.

2550 avg75ReasoningAgents & toolsKnowledgeLong contextGLM 5.3, Reasoning: 54.7GLM 5.3, Agents & tools: 57.6GLM 5.3, Knowledge: 53.5GLM 5.3, Long context: 64.5Qwen3.8 2.4T A95B, Reasoning: 46.4Qwen3.8 2.4T A95B, Agents & tools: 47.8Qwen3.8 2.4T A95B, Knowledge: 49.0Qwen3.8 2.4T A95B, Long context: 64.8

Not drawn, measured for fewer than two of these models: Coding, Maths, Instruction following, Multimodal, Human preference.

Model, click to add or removeIndex

Where sources disagree

Across the 25 benchmarks both have, GLM 5.3 leads 15, Qwen3.8 2.4T A95B leads 10.

Overall indexGLM 5.3 (max)Qwen3.8 2.4T A95BLeader
BenchLeader Index58.851.4neck and neck

Each publisher runs its own tasks, harnesses and effort settings, so their overall verdicts can differ; BenchLeader reconciles them on one scale. † measured at another effort setting of the same model (the publisher did not test the one compared here).

Price, speed and latency

List prices blended at three input tokens per output token. Per-task prices use the token counts on the methodology page. Cost, tokens and time per benchmark task are measured: Artificial Analysis’ averages over its whole Intelligence Index run.

MeasureGLM 5.3 (max)Qwen3.8 2.4T A95B
Blended price per 1M tokens$2.15$3.00
Input / output per 1M$1.40 / $4.40$2.00 / $6.00
Cached input per 1M$0.260$0.250
Price per task: chat reply$0.0019$0.0026
Price per task: summarize a 30-page report$0.019$0.028
Price per task: code edit$0.015$0.021
Price per task: agentic coding session$0.102$0.144
Price per task: structured extraction$0.0037$0.0052
Agentic coding session, input mostly cached$0.050$0.065
Cost per benchmark task (AA Index)$5.01–
Output tokens per task (AA Index)119k–
Of which reasoning85k–
Time per task (AA Index)23 min–
Output speed88 tok/s41 tok/s
Time to first answer57.6 s107.3 s
Time to a complete answer, last measured 13 Nov 2026144.1 s248.5 s

Each model is compared at its best-ranked reasoning-effort setting. GLM 5.3 (max) scores 58.8 and takes 58 s to its first answer token; GLM 5.3 (low) scores 47.3 in 7 s. Qwen3.8 2.4T A95B scores 51.4 and takes 107 s to its first answer token. Higher effort means more thinking before the answer: better scores, longer waits and more tokens billed. How reasoning effort changes scores and cost.

Every benchmark

141 benchmarks, grouped by category; each name links to the board and its leaders. † measured at another effort setting of the same model, shown for reference and not counted as a win.

MetricPublisherGLM 5.3 (max)Qwen3.8 2.4T A95B
BenchLeader IndexBenchLeader58.851.4
Agents & tools scoreBenchLeader57.647.8
Coding scoreBenchLeader59.7–
Human preference scoreBenchLeader67.2–
Knowledge scoreBenchLeader53.549.0
Long context scoreBenchLeader64.564.8
Maths scoreBenchLeader60.0–
Reasoning scoreBenchLeader54.746.4
Blended price $/MBenchLeader$2.15$3.00
Output speedBenchLeader88 tok/s41 tok/s
Time to first answerBenchLeader57.6 s107.3 s
Context windowBenchLeader1,000,000 tokens1,000,000 tokens
Reasoning
GPQA DiamondEpoch AI Benchmarking Hub90.9%–
SimpleBenchSimpleBench66.2%†–
Arena Hard PromptsArena (LMArena)1507–
LiveBench 1.0 ReasoningLiveBench85.8%†–
GPQA Diamond (AA)Artificial Analysis91.7%93.5%
Humanity's Last Exam (AA)Artificial Analysis42.3%42.5%
HLE-Diamond (AA)Artificial Analysis17.9%20.1%
GPQA Diamond (Vals)Vals AI88.1%–
CritPtArtificial Analysis19.1%20.0%
CritPt v2 hard subset (AA)Artificial Analysis33.5%–
MysteryMechanismVals AI23.0%–
HLE-Diamond (Scale)Scale AI SEAL16.4%†–
Arena ExpertArena (LMArena)1522–
Chess PuzzlesEpoch AI Benchmarking Hub37.0%–
Mystery Game PuzzlesEpoch AI Benchmarking Hub33.0%–
LMCAEpoch AI Benchmarking Hub55.5%†–
DTBenchEpoch AI Benchmarking Hub87.7%†–
BTF-3Epoch AI Benchmarking Hub14.9%†–
Coding
SciCodeSciCode59.0%–
WeirdMLWeirdML75.4%–
FrontierCodeCognition40.1%–
Arena CodingArena (LMArena)1522–
Arena WebDevArena (LMArena)1623–
LiveBench 1.0 CodingLiveBench79.0%†–
SciCode (AA)Artificial Analysis59.0%54.0%
Show all 141 benchmarks
MetricPublisherGLM 5.3 (max)Qwen3.8 2.4T A95B
Coding
LiveCodeBenchVals AI80.5%–
IOIVals AI68.4%–
SWE-bench (Vals)Vals AI95.4%–
Code MigrationVals AI44.2%–
Code Migration v1.1Vals AI55.1%–
ProgramBenchVals AI1.5%–
Vibe Code Bench 1-100Vals AI20.0%–
Vibe Code Bench v1.1Vals AI78.1%–
Vibe Code Bench 1-100 v1.1Vals AI29.8%–
SWE Atlas v1.1Scale AI SEAL58.1%†–
SWE Atlas v1.1: Codebase QnAScale AI SEAL70.2%†–
SWE Atlas v1.1: Test WritingScale AI SEAL55.6%†–
SWE Atlas v1.1: RefactoringScale AI SEAL48.6%†–
SWE-Bench Pro V2Scale AI SEAL95.6%–
SWE-Bench Pro V2 HARDScale AI SEAL84.3%–
DeepSWE v1.1Epoch AI Benchmarking Hub69.0%–
CursorBenchCursor42.6%–
ALE-BenchEpoch AI Benchmarking Hub1317.4†–
FrontierSWEEpoch AI Benchmarking Hub30.2%–
Terminal-Bench 4.0 (AA)Artificial Analysis41.9%11.1%
Terminal-Bench 2.1 (AA)Artificial Analysis83.9%82.0%
Startrise FrontendStartrise73.2%†–
GameBench 2 OverallDuelLab GameBench 264.6†52.8
GameBench 2 by reasoning settingDuelLab GameBench 272.349.3†
Design Arena WebsiteDesign Arena1279†–
FrontierCode 1.1 (AA)Artificial Analysis40.1%–
FrontierCode 2.0 (AA)Artificial Analysis21.6%–
Agents & tools
Terminal-BenchTerminal-Bench41.2%–
APEX-AgentsMercor56.6%†–
Arena AgentArena (LMArena)1–
LiveBench Agentic CodingLiveBench60.9%†–
Terminal-Bench 2.1 (Vals)Vals AI71.5%–
MCP AtlasScale AI SEAL84.2%†84.5%†
HiL-BenchScale AI SEAL58.3%†–
GDPval-AA v2.1, normalised scoreArtificial Analysis57.5%55.4%
GDPval-AA v2.1Artificial Analysis16551614
τ³-Banking (AA)Artificial Analysis50.3%49.1%
ITBench SRE (AA)Artificial Analysis46.1%–
Analyst Agent (AA)Artificial Analysis38.8%–
CyberBenchVals AI72.1%–
Finance Agent v2Vals AI55.8%–
Finance Agent v2.1Vals AI65.0%–
Harvey's Legal Agent Benchmark v1.1Vals AI14.6%–
Harvey's Legal Agent Benchmark v1Vals AI8.3%–
Legal Research BenchVals AI49.0%–
SkillsBenchVals AI47.5%–
SREBenchVals AI9.2%–
Tax Agent BenchVals AI43.3%–
Terminal-Bench 4.0 (Vals)Vals AI38.9%–
Terminal-Bench ScienceVals AI5.7%–
Arena Agent Task CompletionArena (LMArena)3.1–
PostTrainBenchEpoch AI Benchmarking Hub34.5%–
Vending-Bench 2Andon Labs8163.6†–
AutomationBenchArtificial Analysis62.2%57.3%
GDP.pdf (AA)Artificial Analysis11.2%15.6%
Harvey LAB-AA v1.1Harvey0.3%–
EnterpriseOps-GymArtificial Analysis36.4%47.4%
AA-Briefcase v1.1Artificial Analysis15011430
GDPxGDPx by SemiAnalysis2.7%–
Design Arena AgenticDesign Arena1239†–
Terminal-Bench-Science 0.1 (AA)Artificial Analysis9.5%–
CWE-Bench (AA)Artificial Analysis55.8%28.3%
DeepSec-Bench (AA)Artificial Analysis24.3%9.5%
CyberGym end-to-end (AA)Artificial Analysis29.0%0.0%
FACTS SearchGoogle87.7%†–
Maths
FrontierMath Tiers 1–3Epoch AI Benchmarking Hub68.8%–
FrontierMath Tier 4Epoch AI Benchmarking Hub29.3%–
OTIS Mock AIMEEpoch AI Benchmarking Hub91.1%–
ProofBenchVals AI49.0%–
LiveBench MathematicsLiveBench87.9%†–
Arena MathsArena (LMArena)1501–
Knowledge
SimpleQA VerifiedEpoch AI Benchmarking Hub41.0%–
LiveBench 1.0 Data AnalysisLiveBench70.2%†–
AA-Omniscience v1.1Artificial Analysis6.07.8
MMLU-ProVals AI86.8%–
LegalBenchVals AI84.8%–
TaxEvalVals AI72.4%–
Excel Modeling BenchmarkVals AI56.3%–
Excel Modeling Benchmark v1.1Vals AI69.1%–
MedCodeVals AI42.9%–
MedScribeVals AI88.8%–
Public Benefits Bench v1.1Vals AI68.5%–
Access to Justice BenchmarkVals AI73.7%–
Financial Coaching BenchVals AI74.1%–
Immigration BenchVals AI66.7%–
AA-Omniscience v1.1: accuracyArtificial Analysis32.3%31.4%
AA-Omniscience v1.1: non-hallucinationArtificial Analysis61.1%65.5%
HealthBench Professional (AA)OpenAI52.8%–
FACTS ParametricGoogle40.3%†–
Instruction following
LiveBench LanguageLiveBench79.9%†–
LiveBench Instruction FollowingLiveBench69.3%†–
Arena Instruction FollowingArena (LMArena)1481–
Human preference
Arena TextArena (LMArena)1482–
EQ-Bench Creative Writing v3EQ-Bench2076†1844
Arena Creative WritingArena (LMArena)1456–
Arena Multi-turnArena (LMArena)1482–
Arena Longer QueriesArena (LMArena)1488–
Multimodal
Code2Video-AAArtificial Analysis1034–
AA-3DArtificial Analysis794–
Long context
AA-LCR v1.1Artificial Analysis79.7%80.3%
MLCRArtificial Analysis17.2%30.6%
FACTS GroundingGoogle55.2%†–
Composite
Epoch Capabilities IndexEpoch AI Benchmarking Hub157.1†–
LiveBench 1.0LiveBench76.1%†–
AA Intelligence Index v5.0.1Artificial Analysis31.6–
AA Intelligence Index v4.3.2Artificial Analysis44.840.0
AA Progress Index v1Artificial Analysis322.7317.8
Vals IndexVals AI59.9–
Vals Finance IndexVals AI61.4%–
Vals RSI IndexVals AI22.9%–
Vals Router IndexVals AI59.7%†–
Vals Legal IndexVals AI74.6%–
AA Cyber IndexArtificial Analysis36.412.6
Safety & honesty
FORTRESSScale AI SEAL28.2%21.6%†
DistressBenchScale AI SEAL72.5%†77.5%
Metadata
AA Openness IndexArtificial Analysis33.327.8

Data as of 2026-11-16. Best configuration of each model; every score links to its source on the model pages.

DuelLab GameBench 2, release gb2-20261111-7b598bb13de4 (https://benchmarks.duellab.org/releases/gb2-20261111-7b598bb13de4/), CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Scores mapped to BenchLeader model names; not endorsed by DuelLab.

What changed

  • Qwen3.8 2.4T A95B: BenchLeader Index 52.0 → 51.5.
  • GLM 5.3 (max): 1 new result (PostTrainBench).
  • GLM 5.3 (max): 4 score revisions.
  • GLM 5.3 (max): 1 score revision; cached input price moved from $0.30/M to $0.26/M (13% down).
  • Qwen3.8 2.4T A95B: 1 score revision.
  • GLM 5.3 (max): cached input price moved from $0.26/M to $0.30/M (15% up).
  • GLM 5.3 (max): cached input price moved from $0.30/M to $0.26/M (13% down).
  • Qwen3.8 2.4T A95B: BenchLeader Index 53.0 → 52.0.
  • GLM 5.3 (max): cached input price moved from $0.26/M to $0.30/M (15% up).
  • Qwen3.8 2.4T A95B: 1 new result (HLE-Diamond (AA)).

Rankings: Best LLM overall · Best LLM for agents · Best cheap LLMs

GLM 5.3 vs Qwen3.8 2.4T A95B: questions

Is GLM 5.3 better than Qwen3.8 2.4T A95B?
GLM 5.3 (max) and Qwen3.8 2.4T A95B are neck and neck on quality (58.8 vs 51.4, within the ±14.6 margin). The BenchLeader Index combines every independent quality benchmark; the two are within the margin of error as of 16 Nov 2026, so check the category scores for your use.
GLM 5.3 vs Qwen3.8 2.4T A95B: which is cheaper, and will that change?
GLM 5.3 is cheaper today: $2.15 against $3.00 per million tokens, blended at three input tokens per output token. No price change has been announced for either.
Which is faster, GLM 5.3 or Qwen3.8 2.4T A95B?
GLM 5.3 streams ~1.5× faster (88 vs 41 output tokens per second, Artificial Analysis 7-day median).
Is GLM 5.3 or Qwen3.8 2.4T A95B better for agents and tool use?
GLM 5.3 scores higher in agentic tasks (58 vs 48 on the category index, where 50 is average). On τ³-Banking (AA), the top shared agents & tools benchmark, it is 50.3% for GLM 5.3 against 49.1% for Qwen3.8 2.4T A95B.
Which is better for long documents?
They are level on long-context benchmarks (65 vs 65). Both accept 1,000,000 tokens of context.
More questions (3)
Which has lower latency?
GLM 5.3 answers first: 57.6 s against 107.3 s to the first answer token, as Artificial Analysis measures it. Reasoning effort drives most of this: a higher setting thinks longer before it answers.
Do independent benchmarks agree on GLM 5.3 vs Qwen3.8 2.4T A95B?
Across the 25 benchmarks both have, GLM 5.3 leads 15, Qwen3.8 2.4T A95B leads 10.
When was GLM 5.3 released?
GLM 5.3 was released on 18 Aug 2026.