BenchLeader

Inkling vs Mistral Large 4.0 OSS

Full profiles: Inkling (Thinking Machines) and Mistral Large 4.0 OSS (Mistral AI): every benchmark, price and rank.

Updated · Data from 10 sources

As of 16 Nov 2026, there are not enough shared benchmarks for a verdict. Choose Inkling for knowledge (60 vs 34); choose Mistral Large 4.0 OSS for maths (66 vs 54) and reasoning (64 vs 52).

Key facts (as of 16 Nov 2026)

  • Inkling costs $2.57 per 1M tokens blended (list price, 16 Nov 2026).

Which to pick for…

The pick's numbers come first. Category scores on the BenchLeader scale (50 is the average model, 15 points one standard deviation). High confidence means a lead of half a standard deviation or more; under one point is called either.

Use casePickWhyConfidence
MathsMistral Large 4.0 OSS66 vs 54 category scoreHigh
ReasoningMistral Large 4.0 OSS64 vs 52 category scoreHigh
KnowledgeInkling60 vs 34 category scoreHigh
Chat quality (human preference)–Only Inkling has an Arena rating (59 category score)Not comparable
High volume on a budgetNeither flagshipA smaller model is usually the better fit: Cheapest good LLMs, Fastest LLMs–

Key differences

  • Not enough shared benchmarks for a verdict.
  • Inkling is stronger in knowledge.
  • Mistral Large 4.0 OSS (high) is stronger in maths, reasoning.

At a glance

SpecInklingMistral Large 4.0 OSS
DeveloperThinking MachinesMistral AI
Released15 Jul 202629 Oct 2026
Context window (tokens)65,536–
Compared atInklingMistral Large 4.0 OSS (high)
Open weightsYesNo
Price in / out / cached input per 1M$1.87 / $4.68 / $0.374–

Category by category

Category scores on the BenchLeader scale: 50 is the average evaluated model, 15 points is one standard deviation. A gap under one point is called level.

CategoryInklingMistral Large 4.0 OSS (high)Leader
Reasoning52.264.2Mistral Large 4.0 OSS
Coding46.1–not comparable
Agents & tools31.1–not comparable
Maths54.166.4Mistral Large 4.0 OSS
Knowledge60.234.1Inkling
Human preference58.9–not comparable

On one chart

Each domain on the index's own scale, where 50 is an average model. Click a domain to see the benchmarks behind it. Pick up to 5 models from the list.

2550 avg75ReasoningMathsKnowledgeInkling, Reasoning: 52.2Inkling, Maths: 54.1Inkling, Knowledge: 60.2Mistral Large 4.0 OSS, Reasoning: 64.2Mistral Large 4.0 OSS, Maths: 66.4Mistral Large 4.0 OSS, Knowledge: 34.1

Not drawn, measured for fewer than two of these models: Coding, Agents & tools, Instruction following, Long context, Multimodal, Human preference.

Model, click to add or removeIndex

Price, speed and latency

List prices blended at three input tokens per output token. Per-task prices use the token counts on the methodology page. Cost, tokens and time per benchmark task are measured: Artificial Analysis’ averages over its whole Intelligence Index run.

MeasureInklingMistral Large 4.0 OSS (high)
Blended price per 1M tokens$2.57–
Input / output per 1M$1.87 / $4.68– / –
Cached input per 1M$0.374–
Price per task: chat reply$0.0022–
Price per task: summarize a 30-page report$0.025–
Price per task: code edit$0.018–
Price per task: agentic coding session$0.131–
Price per task: structured extraction$0.0047–
Agentic coding session, input mostly cached$0.064–
Output speed115 tok/s–
Time to first answer0.3 s–

Each model is compared at its best-ranked reasoning-effort setting. Inkling scores 50.4 and takes 0 s to its first answer token; Inkling (xhigh) scores 50.0 in 19 s. Mistral Large 4.0 OSS (high). Higher effort means more thinking before the answer: better scores, longer waits and more tokens billed. How reasoning effort changes scores and cost.

Every benchmark

134 benchmarks, grouped by category; each name links to the board and its leaders. † measured at another effort setting of the same model, shown for reference and not counted as a win.

MetricPublisherInklingMistral Large 4.0 OSS (high)
BenchLeader IndexBenchLeader50.4–
Agents & tools scoreBenchLeader31.1–
Coding scoreBenchLeader46.1–
Human preference scoreBenchLeader58.9–
Knowledge scoreBenchLeader60.234.1
Maths scoreBenchLeader54.166.4
Reasoning scoreBenchLeader52.264.2
Blended price $/MBenchLeader$2.57–
Output speedBenchLeader115 tok/s–
Time to first answerBenchLeader0.3 s–
Context windowBenchLeader65,536 tokens–
Reasoning
GPQA DiamondEpoch AI Benchmarking Hub88.3%†90.2%
SimpleBenchSimpleBench50.0%–
Arena Hard PromptsArena (LMArena)1463–
LiveBench 2.0 ReasoningLiveBench78.3%†–
LiveBench 1.0 ReasoningLiveBench78.3%†–
GPQA Diamond (AA)Artificial Analysis87.2%†–
Humanity's Last Exam (AA)Artificial Analysis31.9%†–
HLE-Diamond (AA)Artificial Analysis10.6%†–
GPQA Diamond (Vals)Vals AI87.1%–
ARC-AGI-1ARC Prize79.5%–
ARC-AGI-2ARC Prize36.5%–
CritPtArtificial Analysis5.4%†–
CritPt v2 hard subset (AA)Artificial Analysis18.0%†–
HLE-Diamond (Scale)Scale AI SEAL11.2%–
Arena ExpertArena (LMArena)1474–
Chess PuzzlesEpoch AI Benchmarking Hub21.0%†29.0%
Mystery Game PuzzlesEpoch AI Benchmarking Hub–20.0%
LMCAEpoch AI Benchmarking Hub37.6%†–
DTBenchEpoch AI Benchmarking Hub87.5%†–
Coding
SciCodeSciCode47.0%†–
WeirdMLWeirdML32.3%†–
FrontierCodeCognition14.0%–
Arena CodingArena (LMArena)1494–
Arena WebDevArena (LMArena)1414–
LiveBench 2.0 CodingLiveBench48.7%†–
Show all 134 benchmarks
MetricPublisherInklingMistral Large 4.0 OSS (high)
Coding
LiveBench 1.0 CodingLiveBench71.0%†–
LiveCodeBenchVals AI85.5%–
IOIVals AI14.9%–
SWE-bench (Vals)Vals AI77.6%–
Code MigrationVals AI11.8%–
Code Migration v1.1Vals AI8.8%–
ProgramBenchVals AI0.0%–
Vibe Code Bench 1-100Vals AI7.3%–
Vibe Code Bench v1.1Vals AI19.2%–
SWE-Bench Pro V2Scale AI SEAL89.9%†–
SWE-Bench Pro V2 HARDScale AI SEAL56.9%†–
ALE-BenchEpoch AI Benchmarking Hub946–
FrontierSWEEpoch AI Benchmarking Hub4.1%†–
WeirdML v3WeirdML3.9%†–
Terminal-Bench 4.0 (AA)Artificial Analysis1.0%†–
Terminal-Bench 2.1 (AA)Artificial Analysis55.1%†–
GameBench 2 OverallDuelLab GameBench 225.6–
GameBench 2 by reasoning settingDuelLab GameBench 226.7†–
Design Arena WebsiteDesign Arena1215–
FrontierCode 1.1 (AA)Artificial Analysis15.8%†–
FrontierCode 2.0 (AA)Artificial Analysis3.9%†–
Agents & tools
Terminal-BenchTerminal-Bench0.0%†–
APEX-AgentsMercor33.8%–
Arena AgentArena (LMArena)-17.3–
LiveBench Long AgenticLiveBench9.8%†–
LiveBench BrowserLiveBench12.0%†–
LiveBench Agentic CodingLiveBench49.4%†–
Terminal-Bench 2.1 (Vals)Vals AI47.6%–
MCP AtlasScale AI SEAL76.0%†–
τ³-bench Bankingτ²-bench25.0%†–
GDPval-AA v2.1Artificial Analysis1080†–
τ³-Banking (AA)Artificial Analysis29.1%†–
Analyst Agent (AA)Artificial Analysis23.8%†–
CyberBenchVals AI66.8%–
Finance Agent v2Vals AI46.6%–
Finance Agent v2.1Vals AI49.9%–
Harvey's Legal Agent Benchmark v1.1Vals AI3.8%–
Harvey's Legal Agent Benchmark v1Vals AI2.1%–
Legal Research BenchVals AI28.4%–
SkillsBenchVals AI26.1%–
SREBenchVals AI0.0%–
Tax Agent BenchVals AI15.3%–
Terminal-Bench 4.0 (Vals)Vals AI0.5%–
Arena Agent Task CompletionArena (LMArena)-26.8–
AutomationBenchArtificial Analysis5.0%†–
GDP.pdf (AA)Artificial Analysis12.8%†–
Harvey LAB-AA v1.1Harvey0.0%†–
EnterpriseOps-GymArtificial Analysis38.0%†–
AA-Briefcase v1.1Artificial Analysis833†–
GDPxGDPx by SemiAnalysis2.3%†–
Design Arena AgenticDesign Arena1173–
Terminal-Bench-Science 0.1 (AA)Artificial Analysis0.0%†–
Maths
FrontierMath Tiers 1–3Epoch AI Benchmarking Hub33.3%†–
FrontierMath Tier 4Epoch AI Benchmarking Hub4.9%†–
OTIS Mock AIMEEpoch AI Benchmarking Hub88.9%†99.4%
ProofBenchVals AI0.0%–
LiveBench MathematicsLiveBench88.4%†–
Arena MathsArena (LMArena)1479–
Knowledge
SimpleQA VerifiedEpoch AI Benchmarking Hub40.3%†22.4%
LiveBench 2.0 Data AnalysisLiveBench72.8%†–
LiveBench ResearchLiveBench60.3%†–
LiveBench 1.0 Data AnalysisLiveBench72.8%†–
AA-Omniscience v1.1Artificial Analysis-1.5†–
MMLU-ProVals AI86.3%–
LegalBenchVals AI83.0%–
CorpFinVals AI68.6%–
TaxEvalVals AI75.3%–
Excel Modeling BenchmarkVals AI38.4%–
Excel Modeling Benchmark v1.1Vals AI41.0%–
MedCodeVals AI41.2%–
MedScribeVals AI85.4%–
Public Benefits Bench v1.1Vals AI58.5%–
EBR-benchEpoch AI Benchmarking Hub–18.1%
AA-Omniscience v1.1: accuracyArtificial Analysis39.3%†–
AA-Omniscience v1.1: non-hallucinationArtificial Analysis32.8%†–
Instruction following
LiveBench LanguageLiveBench73.5%†–
LiveBench Instruction FollowingLiveBench70.1%†–
Arena Instruction FollowingArena (LMArena)1427–
Human preference
Arena TextArena (LMArena)1443–
EQ-Bench 4EQ-Bench1212–
EQ-Bench Creative Writing v3EQ-Bench1609–
Arena Creative WritingArena (LMArena)1389–
Arena Multi-turnArena (LMArena)1446–
Arena Longer QueriesArena (LMArena)1442–
Multimodal
LiveBench DesignLiveBench55.2%†–
MMMU-ProArtificial Analysis73.5%†–
MMMU-Pro (Vals)Vals AI78.5%–
MortgageTaxVals AI64.0%–
AudioMCScale AI SEAL56.6%†–
AudioMC (text output)Scale AI SEAL56.6%†–
Furniture AssemblyEpoch AI Benchmarking Hub–30.8%
Code2Video-AAArtificial Analysis467†–
AA-3DArtificial Analysis591†–
Long context
AA-LCR v1.1Artificial Analysis77.3%†–
MLCRArtificial Analysis6.1%†–
Composite
Epoch Capabilities IndexEpoch AI Benchmarking Hub148.4–
LiveBench 2.0LiveBench44.3%†–
LiveBench 1.0LiveBench71.9%†–
AA Intelligence Index v5.0.1Artificial Analysis12.5†–
AA Intelligence Index v4.3.2Artificial Analysis25.0†–
AA Progress Index v1Artificial Analysis281.4†–
Vals IndexVals AI29.0–
Vals Finance IndexVals AI38.3%–
Vals Multimodal IndexVals AI49.4%–
Vals Router IndexVals AI29.0%–
Vals Legal IndexVals AI54.2%–
Safety & honesty
FORTRESSScale AI SEAL25.0%†–
DistressBenchScale AI SEAL78.5%–
Metadata
AA Openness IndexArtificial Analysis38.9†–

Data as of 2026-11-16. Best configuration of each model; every score links to its source on the model pages.

DuelLab GameBench 2, release gb2-20261111-7b598bb13de4 (https://benchmarks.duellab.org/releases/gb2-20261111-7b598bb13de4/), CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Scores mapped to BenchLeader model names; not endorsed by DuelLab.

What changed

  • Inkling: BenchLeader Index 47.8 → 50.4.
  • Inkling: 1 score revision.
  • Inkling: 5 score revisions.
  • Inkling: 1 score revision.
  • Mistral Large 4.0 OSS (high): first results.
  • Inkling: 1 score revision.

Rankings: Best LLM overall · Best LLM for agents · Best cheap LLMs

Inkling vs Mistral Large 4.0 OSS: questions

When was Mistral Large 4.0 OSS released?
Mistral Large 4.0 OSS was released on 29 Oct 2026.