BenchLeader

Cost per task: summarise a 30-page report

12,000 tokens of document in, a 600-token summary out. Cost = input tokens × input price + output tokens × output price. “With caching” assumes three-quarters of the input is served from the prompt cache at the provider's cache-read price.

259 models · data as of 9 Sept 2026

259 of 259
#
1GPT-5.4 ProOpenAI$0.46864.2
2GPT-4OpenAI$0.39641.8
3o3-proOpenAI$0.28854.4
4GPT-5 ProOpenAI$0.25260.7
5Claude Opus 4.1Anthropic$0.225$0.10358.1
6Claude Opus 4Anthropic$0.225$0.10354.4
7Claude 3 OpusAnthropic$0.22538.9
8o1OpenAI$0.216$0.14853.2
9GPT-6 AstraOpenAI$0.165$0.07670.6
10Claude Fable 5Anthropic$0.150$0.06970.4
11Claude Fable 5.1Anthropic$0.150$0.06270.3
12GPT-4 TurboOpenAI$0.13841.0
13GPT-5.5OpenAI$0.078$0.03766.6
14GPT-5.5 InstantOpenAI$0.07860.4
15Claude Opus 5Anthropic$0.075$0.03570.0
16Claude Opus 4.7Anthropic$0.075$0.03565.5
17Claude Opus 4.8Anthropic$0.075$0.03564.7
18Claude Opus 4.6Anthropic$0.075$0.03563.1
19Claude Opus 4.5Anthropic$0.075$0.03560.6
20GLM-5V-TurboZhipu AI$0.073$0.03957.2
21GPT-5.6 SolOpenAI$0.060$0.02868.0
22Kimi K3Moonshot AIopen$0.045$0.02166.5
23Claude Sonnet 4.6Anthropic$0.045$0.02160.3
24Claude Sonnet 4.5Anthropic$0.045$0.02157.8
25Claude Sonnet 4Anthropic$0.045$0.02154.0
26Claude 3.7 SonnetAnthropic$0.04552.1
27Claude 3.5 SonnetAnthropic$0.04545.1
28GPT-5.4OpenAI$0.039$0.01963.4
29Nova PremierAmazon$0.03745.3
30Command A 03Cohereopen$0.03643.5
31GPT-4oOpenAI$0.036$0.02542.3
32Command ACohereopen$0.03642.1
33Qwen3 7Alibaba$0.035$0.01758.9
34GPT-5.6 TerraOpenAI$0.031$0.01564.2
35Gemini 3.1 ProGoogle$0.031$0.01563.9
36Gemini 3 ProGoogle$0.03161.6
37Claude Sonnet 5Anthropic$0.030$0.01461.2
38GPT-5.3 CodexOpenAI$0.029$0.01562.4
39GPT-5.2OpenAI$0.029$0.01561.5
40GPT-5.2 CodexOpenAI$0.029$0.01560.7
41o3OpenAI$0.029$0.01560.3
42GPT-4.1OpenAI$0.029$0.01547.3
43Jamba 1.5 LargeAI21 Labs$0.02942.7
44Jamba Large 1.6AI21 Labs$0.02925.2
45Grok 4.6xAI$0.028$0.01563.8
46Grok 4.5xAI$0.028$0.01263.4
47Mimo v2 ProXiaomi$0.028$0.01360.5
48Pixtral Large (latest)Mistral AIopen$0.02842.2
49Mixtral 8x22BMistral AIopen$0.02839.0
50Magistral MediumMistral AIopen$0.02744.1
51Qwen3 8Alibaba$0.025$0.01163.9
52Gemini 3.5 FlashGoogle$0.023$0.01163.9
53Mistral Medium 3.5Mistral AI$0.02250.8
54Mistral Medium (latest)Mistral AI$0.02245.8
55Mistral Medium 3Mistral AI$0.02244.7
56DeepSeek V3.1DeepSeekopen$0.021$0.007854.8
57GPT-5OpenAI$0.021$0.01159.5
58GPT-5.1OpenAI$0.021$0.01159.4
59GPT-5-CodexOpenAI$0.021$0.01158.1
60GPT-5.1-CodexOpenAI$0.021$0.01157.1