BenchLeader

DeepSeek V4.1 Flash vs Qwen3 8

Verdict
  • Qwen3 8 (max) leads on quality: 66.5 vs 61.9.
  • DeepSeek V4.1 Flash (max) is stronger in coding, composite, long context.
  • Qwen3 8 (max) is stronger in agents & tools, knowledge, multimodal, reasoning, human preference, maths.
  • DeepSeek V4.1 Flash (max) is 10× cheaper ($0.262 vs $2.67 per 1M blended).
  • DeepSeek V4.1 Flash (max) streams 5.6× faster (215 vs 39 tokens per second).
MetricDeepSeek V4.1 Flash (max)Qwen3 8 (max)
BenchLeader Index61.966.5
Agents & tools score59.668.3
Coding score68.966.5
Composite score74.574.3
Knowledge score61.763.5
Long context score68.566.6
Multimodal score61.467.4
Reasoning score69.576.3
Human preference score68.2
Maths score67.0
Blended price $/M$0.262$2.67
Output speed215 tok/s39 tok/s
Time to first answer10.5 s55.1 s
Context window1M1M
SciCode52.9%
ProofBench58.0%
Epoch Capabilities Index156.6
LMArena Text1481
LMArena Hard Prompts1503
LMArena Coding1522
LMArena WebDev16141671
LMArena Vision1315
LMArena Agent4.93.3
LiveBench81.1%78.5%
LiveBench Reasoning86.7%88.2%
LiveBench Coding80.0%72.9%
LiveBench Agentic Coding77.3%64.7%
LiveBench Mathematics93.3%91.3%
LiveBench Data Analysis79.3%78.4%
LiveBench Language81.2%79.7%
LiveBench Instruction Following70.0%74.1%
AA Intelligence Index39.545.4
AA-LCR84.0%80.3%
MMMU-Pro77.0%82.8%
AA-Omniscience-5.312.0
GPQA Diamond (AA)92.8%
Humanity's Last Exam (AA)39.3%43.1%
SciCode (AA)51.9%53.2%
LiveCodeBench87.8%
MMLU-Pro88.6%
IOI68.9%
LegalBench83.6%
CorpFin65.8%
TaxEval75.5%
Terminal-Bench 2.1 (Vals)67.4%
SWE-bench (Vals)85.6%
GPQA Diamond (Vals)93.7%
Vals Index51.8
CritPt14.3%20.0%
GDPval (AA)56.6%58.2%
τ²-Bench Banking (AA)51.3%
Code Migration24.0%
Excel Modeling Benchmark60.1%
Finance Agent v250.6%
Harvey's Legal Agent Benchmark10.4%
Legal Research Bench47.6%
MedCode40.7%
MedScribe85.0%
MMMU-Pro (Vals)88.0%
MortgageTax64.0%
MysteryMechanism23.9%
ProgramBench0.0%
Public Benefits Bench67.1%
SAGE51.3%
SkillsBench42.0%
Tax Agent Bench66.0%
Terminal-Bench 4.0 (Vals)24.8%
Terminal-Bench Science1.4%
Vals Multimodal Index65.4%
Vibe Code Bench 1-10012.8%
Vibe Code Bench v1.164.7%
LMArena Maths1498
LMArena Creative Writing1472
LMArena Instruction Following1477
LMArena Multi-turn1495
LMArena Longer Queries1492

Data as of 2026-09-19. Best configuration of each model; every score links to its source on the model pages.

DeepSeek V4.1 Flash vs Qwen3 8: questions

Is DeepSeek V4.1 Flash better than Qwen3 8?
Qwen3 8 (max) leads on quality: 66.5 vs 61.9. The BenchLeader Index combines every independent quality benchmark; Qwen3 8 (max) is ahead overall as of 2026-09-19, but check the category scores for your use.
Is DeepSeek V4.1 Flash better than Qwen3 8 for coding?
DeepSeek V4.1 Flash scores higher in coding (69 vs 67 on the category index, where 50 is average).
Is DeepSeek V4.1 Flash better than Qwen3 8 for agentic tasks?
Qwen3 8 scores higher in agentic tasks (68 vs 60 on the category index, where 50 is average).
Which is cheaper, DeepSeek V4.1 Flash or Qwen3 8?
DeepSeek V4.1 Flash is cheaper: $0.262 against $2.67 per million tokens, blended at three input tokens per output token.
Which is faster, DeepSeek V4.1 Flash or Qwen3 8?
DeepSeek V4.1 Flash streams faster: 215 against 39 output tokens per second.
Which has the larger context window?
Both accept 1M tokens of context.