BenchLeader

Inkling 2 Small vs Qwen4 Max

Full profiles: Inkling 2 Small (Thinking Machines) and Qwen4 Max (Alibaba): every benchmark, price and rank.

Updated · Data from 10 sources

As of 19 Nov 2026, there are not enough shared benchmarks for a verdict, and Inkling 2 Small is 4.7× cheaper at $0.475 vs $2.25 per 1M tokens blended. Choose Inkling 2 Small for coding (59 vs 55) and fast first answers (40.0 s vs 139.2 s), where it also streams ~2× faster; choose Qwen4 Max for reasoning (59 vs 52) and knowledge (59 vs 53).

Key facts (as of 19 Nov 2026)

  • Inkling 2 Small costs $0.475 per 1M tokens blended (list price, 19 Nov 2026).
  • Qwen4 Max costs $2.25 per 1M tokens blended (list price, 19 Nov 2026).
  • Inkling 2 Small streams ~2× faster than Qwen4 Max (Artificial Analysis, 7-day median, 19 Nov 2026).
  • Of the 16 benchmarks both models have, Qwen4 Max leads 13 (BenchLeader, 19 Nov 2026).

Which to pick for…

The pick's numbers come first. Category scores on the BenchLeader scale (50 is the average model, 15 points one standard deviation). High confidence means a lead of half a standard deviation or more; under one point is called either.

Use casePickWhyConfidence
CodingInkling 2 Small59 vs 55 category score; FrontierCode 2.0 (AA) 25.4% vs 26.4%Medium
ReasoningQwen4 Max59 vs 52 category score; HLE-Diamond (AA) 44.9% vs 28.7%Medium
KnowledgeQwen4 Max59 vs 53 category score; AA-Omniscience v1.1 27.7 vs 16.1Medium
Chat quality (human preference)–Only Inkling 2 Small has an Arena rating (59 category score)Not comparable
Lowest costInkling 2 Small$0.475 vs $2.25 per 1M blended; agentic coding session $0.022 vs $0.108–
Fastest first answerInkling 2 Small40.0 s (Inkling 2 Small) vs 139.2 s (Qwen4 Max) to the first answer token–
High volume on a budgetNeither flagshipA smaller model is usually the better fit: Cheapest good LLMs, Fastest LLMs–

Key differences

  • Not enough shared benchmarks for a verdict.
  • Inkling 2 Small is stronger in coding.
  • Qwen4 Max is stronger in knowledge, reasoning.
  • Inkling 2 Small is 4.7× cheaper ($0.475 vs $2.25 per 1M blended).
  • Inkling 2 Small streams 2.0× faster (117 vs 59 tokens per second).

At a glance

SpecInkling 2 SmallQwen4 Max
DeveloperThinking MachinesAlibaba
Released5 Nov 202616 Nov 2026
Context window (tokens)1,048,576991,808
Compared atInkling 2 SmallQwen4 Max
Open weightsNoNo
Price in / out / cached input per 1M$0.300 / $1.00 / $0.030$1.50 / $4.50 / $0.071

Category by category

Category scores on the BenchLeader scale: 50 is the average evaluated model, 15 points is one standard deviation. A gap under one point is called level.

CategoryInkling 2 SmallQwen4 MaxLeader
Reasoning52.158.5Qwen4 Max
Coding59.455.1Inkling 2 Small
Agents & tools60.6–not comparable
Knowledge53.159.0Qwen4 Max
Human preference58.7–not comparable
Multimodal63.6–not comparable
Long context66.4–not comparable

On one chart

Each domain on the index's own scale, where 50 is an average model. Click a domain to see the benchmarks behind it. Pick up to 5 models from the list.

2550 avg75ReasoningCodingKnowledgeInkling 2 Small, Reasoning: 52.1Inkling 2 Small, Coding: 59.4Inkling 2 Small, Knowledge: 53.1Qwen4 Max, Reasoning: 58.5Qwen4 Max, Coding: 55.1Qwen4 Max, Knowledge: 59.0

Not drawn, measured for fewer than two of these models: Agents & tools, Maths, Instruction following, Long context, Multimodal, Human preference.

Model, click to add or removeIndex

Where sources disagree

Across the 16 benchmarks both have, Inkling 2 Small leads 3, Qwen4 Max leads 13. Every overall index that rates both puts Qwen4 Max ahead.

Overall indexInkling 2 SmallQwen4 MaxLeader
AA Intelligence Index v5.0.130.642.9Qwen4 Max
Vals Index56.163.2†Qwen4 Max

Each publisher runs its own tasks, harnesses and effort settings, so their overall verdicts can differ; BenchLeader reconciles them on one scale. † measured at another effort setting of the same model (the publisher did not test the one compared here).

Price, speed and latency

List prices blended at three input tokens per output token. Per-task prices use the token counts on the methodology page. Cost, tokens and time per benchmark task are measured: Artificial Analysis’ averages over its whole Intelligence Index run.

MeasureInkling 2 SmallQwen4 Max
Blended price per 1M tokens$0.475$2.25
Input / output per 1M$0.300 / $1.00$1.50 / $4.50
Cached input per 1M$0.030$0.071
Price per task: chat reply$0.0004$0.0020
Price per task: summarize a 30-page report$0.0042$0.021
Price per task: code edit$0.0033$0.016
Price per task: agentic coding session$0.022$0.108
Price per task: structured extraction$0.0008$0.0039
Agentic coding session, input mostly cached$0.0099$0.044
Cost per benchmark task (AA Index)$1.18$3.27
Output tokens per task (AA Index)150k105k
Of which reasoning88k69k
Time per task (AA Index)21 min30 min
Output speed117 tok/s59 tok/s
Time to first answer40.0 s139.2 s
Time to a complete answer, last measured 13 Nov 2026163.6 s–

Per token is not per task: an average task of Artificial Analysis' Intelligence Index cost $1.18 on Inkling 2 Small and $3.27 on Qwen4 Max, and Inkling 2 Small wrote 1.4× as many output tokens for the same work, which a per-token price hides.

Each model is compared at its best-ranked reasoning-effort setting. Inkling 2 Small scores 57.6 and takes 40 s to its first answer token. Qwen4 Max and takes 139 s to its first answer token. Higher effort means more thinking before the answer: better scores, longer waits and more tokens billed. How reasoning effort changes scores and cost.

Every benchmark

89 benchmarks, grouped by category; each name links to the board and its leaders. † measured at another effort setting of the same model, shown for reference and not counted as a win.

MetricPublisherInkling 2 SmallQwen4 Max
BenchLeader IndexBenchLeader57.6–
Agents & tools scoreBenchLeader60.6–
Coding scoreBenchLeader59.455.1
Human preference scoreBenchLeader58.7–
Knowledge scoreBenchLeader53.159.0
Long context scoreBenchLeader66.4–
Multimodal scoreBenchLeader63.6–
Reasoning scoreBenchLeader52.158.5
Blended price $/MBenchLeader$0.475$2.25
Output speedBenchLeader117 tok/s59 tok/s
Time to first answerBenchLeader40.0 s139.2 s
Context windowBenchLeader1,048,576 tokens991,808 tokens
Reasoning
Arena Hard PromptsArena (LMArena)1439–
LiveBench 2.0 ReasoningLiveBench–92.2%†
Humanity's Last Exam (AA)Artificial Analysis44.1%–
HLE-Diamond (AA)Artificial Analysis28.7%44.9%
ARC-AGI-1ARC Prize96.5%†–
ARC-AGI-2ARC Prize81.7%†–
ARC-AGI-3ARC Prize2.6%†–
CritPt v2 hard subset (AA)Artificial Analysis35.0%43.0%
MysteryMechanismVals AI25.2%–
Arena ExpertArena (LMArena)1491–
Coding
SciCodeSciCode52.3%–
Arena CodingArena (LMArena)1486–
Arena WebDevArena (LMArena)16441750†
LiveBench 2.0 CodingLiveBench–69.8%†
ProgramBenchVals AI0.5%–
SWE-bench MultimodalVals AI43.1%–
Vibe Code Bench v1.1Vals AI81.5%86.7%†
SWE Atlas v1.1Scale AI SEAL61.9%–
SWE Atlas v1.1: Codebase QnAScale AI SEAL74.2%–
SWE Atlas v1.1: Test WritingScale AI SEAL58.1%–
SWE Atlas v1.1: RefactoringScale AI SEAL53.3%–
SWE-Bench Pro V2Scale AI SEAL97.7%–
SWE-Bench Pro V2 HARDScale AI SEAL86.3%–
FrontierSWEEpoch AI Benchmarking Hub25.1%†–
Terminal-Bench 4.0 (AA)Artificial Analysis13.1%48.5%
Show all 89 benchmarks
MetricPublisherInkling 2 SmallQwen4 Max
Coding
Terminal-Bench 2.1 (AA)Artificial Analysis81.3%–
FrontierCode 2.0 (AA)Artificial Analysis25.4%26.4%
Agents & tools
Terminal-BenchTerminal-Bench13.0%†–
APEX-AgentsMercor46.8%–
Arena AgentArena (LMArena)1.57.3†
LiveBench Long AgenticLiveBench–46.6%†
LiveBench BrowserLiveBench–80.7%†
MCP AtlasScale AI SEAL85.4%–
GDPval-AA v2.1Artificial Analysis16301809
τ³-Banking (AA)Artificial Analysis40.4%–
Analyst Agent (AA)Artificial Analysis51.3%46.3%
APEX-Agents (AA)Artificial Analysis–59.1%
CyberBenchVals AI72.7%–
Finance Agent v2.1Vals AI67.5%66.7%†
Harvey's Legal Agent Benchmark v1.1Vals AI21.7%21.3%†
Legal Research BenchVals AI46.6%41.4%†
SREBenchVals AI1.9%–
Tax Agent BenchVals AI38.9%40.4%†
Terminal-Bench 4.0 (Vals)Vals AI12.6%48.5%†
Terminal-Bench ScienceVals AI2.9%–
Arena Agent Task CompletionArena (LMArena)2.48.8†
AutomationBenchArtificial Analysis45.6%72.6%
GDP.pdf (AA)Artificial Analysis25.2%26.2%
Harvey LAB-AA v1.1Harvey–9.4%
EnterpriseOps-GymArtificial Analysis46.8%48.5%
AA-Briefcase v1.1Artificial Analysis15271686
Design Arena AgenticDesign Arena13061356
Terminal-Bench-Science 0.1 (AA)Artificial Analysis5.7%23.3%
Maths
ArXivMathMathArena31.9%–
BrokenArXivMathArena63.2%–
Knowledge
LiveBench 2.0 Data AnalysisLiveBench–83.4%†
LiveBench ResearchLiveBench–84.7%†
AA-Omniscience v1.1Artificial Analysis16.127.7
BioMysteryBenchVals AI70.0%–
Excel Modeling Benchmark v1.1Vals AI69.5%70.8%†
MedCodeVals AI44.1%–
MedScribeVals AI90.2%–
GDP.pdfEpoch AI Benchmarking Hub43.6%†–
AA-Omniscience v1.1: accuracyArtificial Analysis33.8%43.7%
AA-Omniscience v1.1: non-hallucinationArtificial Analysis73.3%71.6%
Instruction following
Arena Instruction FollowingArena (LMArena)1410–
Human preference
Arena TextArena (LMArena)1412–
Arena Creative WritingArena (LMArena)1343–
Arena Multi-turnArena (LMArena)1412–
Arena Longer QueriesArena (LMArena)1408–
Multimodal
LiveBench DesignLiveBench–79.1%†
MMMU-ProArtificial Analysis81.6%–
SAGEVals AI88.6%–
Humanity's Sixth SenseScale AI SEAL33.3%–
VIALS-AAHandshake AI42.9%–
Code2Video-AAArtificial Analysis1020–
AA-3DArtificial Analysis1027–
Long context
AA-LCR v1.1Artificial Analysis83.3%–
MLCRArtificial Analysis20.6%19.4%
Composite
LiveBench 2.0LiveBench–73.1%†
AA Intelligence Index v5.0.1Artificial Analysis30.642.9
AA Progress Index v1Artificial Analysis317.6–
Vals IndexVals AI56.163.2†
Vals Finance IndexVals AI61.5%62.0%†
Vals Science IndexVals AI32.7%–
Vals Legal IndexVals AI73.9%70.7%†
Safety & honesty
FORTRESSScale AI SEAL16.2%–
DistressBenchScale AI SEAL82.3%–
Metadata
AA Openness IndexArtificial Analysis38.9–

Data as of 2026-11-19. Best configuration of each model; every score links to its source on the model pages.

What changed

  • Inkling 2 Small: 2 score revisions.
  • Inkling 2 Small: 3 new results (AA Progress Index v1, MedCode, MedScribe).
  • Inkling 2 Small: 1 score revision.
  • Inkling 2 Small: 1 score revision; Inkling 2 Small cached input price moved from $0.060/M to $0.030/M (50% down).
  • Inkling 2 Small: 1 score revision.
  • Inkling 2 Small: BenchLeader Index 58.4 → 57.9.
  • Inkling 2 Small: 2 new results (FORTRESS, Design Arena Agentic).
  • Inkling 2 Small: 2 new results (MysteryMechanism, Vals Science Index); 1 score revision.
  • Inkling 2 Small: 3 new results (SciCode, APEX-Agents, MLCR).
  • Inkling 2 Small: 8 new results (Arena Text, Arena Hard Prompts, Arena Coding…); 2 score revisions.

Rankings: Best LLM overall · Best LLM for agents · Best cheap LLMs

Inkling 2 Small vs Qwen4 Max: questions

Inkling 2 Small vs Qwen4 Max: which is cheaper, and will that change?
Inkling 2 Small is cheaper today: $0.475 against $2.25 per million tokens, blended at three input tokens per output token. No price change has been announced for either.
Is Inkling 2 Small or Qwen4 Max better for coding?
Inkling 2 Small scores higher in coding (59 vs 55 on the category index, where 50 is average). On FrontierCode 2.0 (AA), the top shared coding benchmark, it is 25.4% for Inkling 2 Small against 26.4% for Qwen4 Max.
Which is faster, Inkling 2 Small or Qwen4 Max?
Inkling 2 Small streams ~2× faster (117 vs 59 output tokens per second, Artificial Analysis 7-day median).
Which is better for long documents?
Inkling 2 Small accepts more context: 1,048,576 against 991,808 tokens for Qwen4 Max.
Which has lower latency?
Inkling 2 Small answers first: 40.0 s against 139.2 s to the first answer token, as Artificial Analysis measures it. Reasoning effort drives most of this: a higher setting thinks longer before it answers.
More questions (2)
Do independent benchmarks agree on Inkling 2 Small vs Qwen4 Max?
Across the 16 benchmarks both have, Inkling 2 Small leads 3, Qwen4 Max leads 13. Every overall index that rates both puts Qwen4 Max ahead.
When was Qwen4 Max released?
Qwen4 Max was released on 16 Nov 2026.