Text Arena💻Coding

View overall rankings across various AI models in text-to-text tasks across math, coding, creative writing, and other open-ended domains.

Mar 31, 2026
1,015,744 votes
332 models
Rank Spread
1
12
Anthropic
claude-opus-4-6
Anthropic · Proprietary
1541±10
3,503$5 / $251M
2
12
Anthropic
claude-opus-4-6-thinking
Anthropic · Proprietary
1541±11
3,017$5 / $251M
3
315
gpt-5.4-high
OpenAI · Proprietary
1505±15
1,596$2.50 / $151.1M
4
312
Anthropic
claude-opus-4-5-20251101-thinking-32k
Anthropic · Proprietary
1504±8
7,677$5 / $25200K
5
316
Anthropic
claude-sonnet-4-6
Anthropic · Proprietary
1500±12
2,554$3 / $151M
6
316
gemini-3.1-pro-preview
Google · Proprietary
1499±10
4,057$2 / $121M
7
317
Anthropic
claude-opus-4-5-20251101
Anthropic · Proprietary
1494±7
9,572$5 / $25200K
8
327
Bytedance
dola-seed-2.0-pro
Bytedance · Proprietary
1490±22
746N/AN/A
9
420
Anthropic
claude-sonnet-4-5-20250929-thinking-32k
Anthropic · Proprietary
1487±6
12,392$3 / $15200K
10
325
kimi-k2.5-instant
Moonshot · Modified MIT
1485±14
1,817$0.38 / $1.91262.1K
11
332
amazon-nova-experimental-chat-26-02-10
Amazon · Proprietary
1485±20
854N/AN/A
12
423
kimi-k2.5-thinking
Moonshot · Modified MIT
1483±9
4,014$0.60 / $3N/A
13
333
longcat-flash-chat-2602-exp
Meituan · Proprietary
1483±19
945N/AN/A
14
523
gemini-3-pro
Google · Proprietary
1483±7
8,628$2 / $121M
15
331
qwen3.5-max-preview
Alibaba · Proprietary
1482±15
1,404N/AN/A
16
723
Anthropic
claude-opus-4-1-20250805-thinking-16k
Anthropic · Proprietary
1481±7
9,892$15 / $75200K
17
823
Anthropic
claude-sonnet-4-5-20250929
Anthropic · Proprietary
1480±6
11,961$3 / $15200K
18
436
mimo-v2-pro
Xiaomi · Proprietary
1475±15
1,500$1 / $31M
19
927
Anthropic
claude-opus-4-1-20250805
Anthropic · Proprietary
1474±6
15,619$15 / $75200K
20
842
gpt-5.4
OpenAI · Proprietary
1471±15
1,684$2.50 / $151.1M
21
842
longcat-flash-chat
Meituan · MIT
1468±13
2,241$0.20 / $0.80131.1K
22
954
grok-4.20-beta-0309-reasoning
xAI · Proprietary
1465±14
1,698$2 / $62M
23
1342
gemini-3-flash
Google · Proprietary
1464±8
6,423$0.50 / $31M
24
1350
qwen3.5-397b-a17b
Alibaba · Apache 2.0
1463±11
3,055$0.39 / $2.34262.1K
25
961
grok-4.20-beta1
xAI · Proprietary
1461±15
1,479N/AN/A
26
1657
ernie-5.0-0110
Baidu · Proprietary
1458±9
4,554N/AN/A
27
1758
qwen3-max-preview
Alibaba · Proprietary
1458±8
5,406$0.78 / $3.90262.1K
28
1462
glm-4.7
Z.ai · MIT
1457±12
2,420$0.39 / $1.75202.8K
29
1954
gemini-2.5-pro
Google · Proprietary
1456±5
20,886$1.25 / $101M
30
1668
grok-4.20-multi-agent-beta-0309
xAI · Proprietary
1454±13
1,882$2 / $62M
31
2061
kimi-k2-thinking-turbo
Moonshot · Modified MIT
1453±7
9,402$1.15 / $8262.1K
32
2062
gpt-5.1-high
OpenAI · Proprietary
1453±7
8,270$1.25 / $10400K
33
1968
glm-5
Z.ai · MIT
1452±11
2,729$1 / $3.20202.8K
34
1968
gpt-5.2-chat-latest-20260210
OpenAI · Proprietary
1451±11
3,010$1.75 / $14128K
35
2065
deepseek-v3.2-thinking
DeepSeek · MIT
1451±8
6,481$0.26 / $0.38163.8K
36
2065
grok-4.1-thinking
xAI · Proprietary
1451±7
9,216N/AN/A
37
1475
gpt-5.4-mini-high
OpenAI · Proprietary
1450±18
1,031$0.75 / $4.50400K
38
2065
glm-4.6
Z.ai · MIT
1450±7
7,539$0.39 / $1.90204.8K
39
1675
gemma-4-26b-a4b
Google · Apache 2.0
1450±18
1,044N/AN/A
40
1675
gemma-4-31b
Google · Apache 2.0
1450±18
1,055N/AN/A
41
2066
gemini-3-flash (thinking-minimal)
Google · Proprietary
1450±8
6,535$0.50 / $31M
42
2367
Anthropic
claude-haiku-4-5-20251001
Anthropic · Proprietary
1447±6
12,263$1 / $5200K
43
2368
grok-4.1
xAI · Proprietary
1447±7
10,188N/AN/A
44
2369
gpt-5.2-high
OpenAI · Proprietary
1447±8
6,035$1.75 / $14400K
45
2369
deepseek-v3.2
DeepSeek · MIT
1446±7
8,155$0.26 / $0.38163.8K
46
2373
gpt-5.2
OpenAI · Proprietary
1445±8
5,350$1.75 / $14400K
47
2473
mistral-large-3
Mistral · Apache 2.0
1445±7
7,691$0.50 / $1.50N/A
48
2770
qwen3-235b-a22b-instruct-2507
Alibaba · Apache 2.0
1444±5
16,127$0.26 / $1.06N/A
49
1891
amazon-nova-experimental-chat-26-01-10
Amazon · Proprietary
1443±21
745N/AN/A
50
2673
Anthropic
claude-opus-4-20250514-thinking-16k
Anthropic · Proprietary
1443±8
6,717$15 / $75200K
51
2673
mimo-v2-flash (non-thinking)
Xiaomi · MIT
1442±8
6,206$0.09 / $0.29262.1K
52
2384
qwen3-vl-235b-a22b-instruct
Alibaba · Apache 2.0
1441±13
2,347$0.20 / $0.88262.1K
53
2877
qwen3-next-80b-a3b-instruct
Alibaba · Apache 2.0
1440±9
4,841$0.09 / $1.10262.1K
54
2386
qwen3-max-2025-09-23
Alibaba · Proprietary
1440±13
2,056$0.78 / $3.90262.1K
55
2488
deepseek-v3.2-exp-thinking
DeepSeek · MIT
1439±13
1,938$0.27 / $0.41163.8K
56
3280
gpt-5.1
OpenAI · Proprietary
1437±7
9,183$1.25 / $10400K
57
2886
Stepfun
step-3.5-flash
StepFun · Apache 2.0
1437±10
3,544$0.10 / $0.30262.1K
58
3284
gpt-5-high
OpenAI · Proprietary
1436±8
6,417$1.25 / $10400K
59
2889
deepseek-v3.2-exp
DeepSeek · MIT
1435±12
2,514$0.27 / $0.41163.8K
60
2495
minimax-m2.7
MiniMax · Proprietary
1434±17
1,188$0.30 / $1.20204.8K
61
3589
glm-4.5
Z.ai · MIT
1434±9
4,800$0.60 / $2.20131.1K
62
3689
amazon-nova-experimental-chat-11-10
Amazon · Proprietary
1433±8
5,365N/AN/A
63
4484
mistral-medium-2508
Mistral · Proprietary
1433±5
15,574$2.70 / $8.1032K
64
3789
grok-3-preview-02-24
xAI · Proprietary
1433±8
5,415$3 / $15131.1K
65
23101
amazon-nova-experimental-chat-12-10
Amazon · Proprietary
1433±22
702N/AN/A
66
3297
qwen3-vl-235b-a22b-thinking
Alibaba · Apache 2.0
1430±14
1,640$0.26 / $2.60131.1K
67
3099
grok-4-fast-chat
xAI · Proprietary
1430±16
1,254$3 / $15256K
68
24110
deepseek-v3.1-terminus-thinking
DeepSeek · MIT
1428±24
639$0.21 / $0.79163.8K
69
4496
deepseek-r1-0528
DeepSeek · MIT
1427±11
2,738$0.45 / $2.15163.8K
70
4199
ernie-5.0-preview-1203
Baidu · Proprietary
1427±13
1,972N/AN/A
71
4499
qwen3.5-122b-a10b
Alibaba · Apache 2.0
1426±12
2,256$0.26 / $2.08262.1K
72
5293
gemini-2.5-flash
Google · Proprietary
1425±5
20,257$0.30 / $2.501M
73
43102
qwen3-235b-a22b-thinking-2507
Alibaba · Apache 2.0
1424±15
1,618$0.15 / $1.50131.1K
74
4898
minimax-m2.1-preview
MiniMax · MIT
1424±10
3,436$0.27 / $0.95196.6K
75
4899
minimax-m2.5
MiniMax · Modified MIT
1424±10
3,290$0.12 / $1196.6K
76
26115
Tencent
hunyuan-vision-1.5-thinking
Tencent · Proprietary
1422±28
437N/AN/A
77
53102
grok-4-fast-reasoning
xAI · Proprietary
1420±9
3,995$0.20 / $0.502M
78
52107
qwen3.5-flash
Alibaba · Proprietary
1419±12
2,525N/AN/A
79
51109
deepseek-v3.1-thinking
DeepSeek · MIT
1418±13
1,912$1.23 / $4.94N/A
80
53108
mimo-v2-flash (thinking)
Xiaomi · MIT
1418±12
2,448$0.09 / $0.29262.1K
81
53108
qwen3.5-35b-a3b
Alibaba · Apache 2.0
1418±12
2,338$0.16 / $1.30262.1K
82
58104
qwen3-30b-a3b-instruct-2507
Alibaba · Apache 2.0
1418±9
4,699$0.09 / $0.30262.1K
83
56110
gpt-5.3-chat-latest
OpenAI · Proprietary
1415±12
2,644$1.75 / $14128K
84
58110
deepseek-v3.1
DeepSeek · MIT
1415±12
2,637$1.23 / $4.94N/A
85
65104
chatgpt-4o-latest-20250326
OpenAI · Proprietary
1414±5
15,956$5 / $15128K
86
63108
Anthropic
claude-sonnet-4-20250514-thinking-32k
Anthropic · Proprietary
1414±8
6,460$3 / $151M
87
64108
grok-4-1-fast-reasoning
xAI · Proprietary
1414±7
8,591$0.20 / $0.502M
88
51115
ernie-5.0-preview-1022
Baidu · Proprietary
1413±19
927N/AN/A
89
59111
amazon-nova-experimental-chat-10-20
Amazon · Proprietary
1413±12
2,307N/AN/A
90
64110
qwen3-coder-480b-a35b-instruct
Alibaba · Apache 2.0
1413±9
4,888$0.40 / $1.60262.1K
91
52116
gpt-5.4-nano-high
OpenAI · Proprietary
1411±20
881$0.20 / $1.25400K
92
63112
qwen3.5-27b
Alibaba · Apache 2.0
1410±12
2,246$0.20 / $1.56262.1K
93
66110
grok-4-0709
xAI · Proprietary
1410±7
8,221$3 / $15256K
94
53120
nvidia-nemotron-3-super-120b-a12b
Nvidia · NVIDIA Open Model
1409±20
865N/AN/A
95
68111
o3-2025-04-16
OpenAI · Proprietary
1408±6
11,824$2 / $8200K
96
67112
gpt-5-mini-high
OpenAI · Proprietary
1407±8
5,539$0.25 / $2400K
97
56125
deepseek-v3.1-terminus
DeepSeek · MIT
1407±21
782$0.21 / $0.79163.8K
98
69116
gemini-3.1-flash-lite-preview
Google · Proprietary
1403±11
3,075$0.25 / $1.501M
99
76115
Anthropic
claude-opus-4-20250514
Anthropic · Proprietary
1402±7
7,953$15 / $75200K
100
76115
gemini-2.5-flash-preview-09-2025
Google · Proprietary
1402±8
6,889$0.30 / $2.501M
101
73120
kimi-k2-0905-preview
Moonshot · Modified MIT
1400±12
2,257$0.60 / $2.50262.1K
102
78116
gpt-5-chat
OpenAI · Proprietary
1400±8
6,032$1.25 / $10128K
103
79116
qwen3-235b-a22b-no-thinking
Alibaba · Apache 2.0
1399±8
7,003$0.46 / $1.82131.1K
104
74126
gpt-4.5-preview-2025-02-27
OpenAI · Proprietary
1397±13
1,939$75 / $150128K
105
78125
mai-1-preview
Microsoft AI · Proprietary
1397±11
2,793N/AN/A
106
84120
glm-4.5-air
Z.ai · MIT
1397±8
6,164$0.13 / $0.85131.1K
107
65144
glm-4.6v
Z.ai · MIT
1395±25
537$0.30 / $0.90131.1K
108
73142
mercury-2
Inception AI · Proprietary
1392±21
770$0.25 / $0.75128K
109
89131
qwen3-next-80b-a3b-thinking
Alibaba · Apache 2.0
1391±11
2,710$0.10 / $0.78131.1K
110
83136
ling-flash-2.0
Ant Group · MIT
1391±15
1,544N/AN/A
111
93127
gpt-4.1-2025-04-14
OpenAI · Proprietary
1390±7
9,382$2 / $81M
112
91135
nova-2-lite
Amazon · Proprietary
1388±12
2,527$0.30 / $2.501M
113
78147
Tencent
hunyuan-t1-20250711
Tencent · Proprietary
1388±20
811N/AN/A
114
93133
qwen3-235b-a22b
Alibaba · Apache 2.0
1386±9
4,364$0.46 / $1.82131.1K
115
97133
mistral-medium-2505
Mistral · Proprietary
1386±8
5,924$0.40 / $2131.1K
116
93142
glm-4.7-flash
Z.ai · MIT
1384±11
2,710$0.06 / $0.40202.8K
117
101143
nvidia-nemotron-3-nano-30b-a3b-bf16
Nvidia · NVIDIA Open Model
1380±10
3,297$0.06 / $0.24262.1K
118
104142
Anthropic
claude-sonnet-4-20250514
Anthropic · Proprietary
1380±7
7,450$3 / $151M
119
104142
gpt-oss-120b
OpenAI · Apache 2.0
1380±8
6,543$0.04 / $0.19131.1K
120
101147
o3-mini-high
OpenAI · Proprietary
1379±12
2,596$1.10 / $4.40200K
121
104144
kimi-k2-0711-preview
Moonshot · Modified MIT
1378±8
5,279$0.60 / $2.50131.1K
122
104149
grok-3-mini-high
xAI · Proprietary
1376±10
3,313$0.30 / $0.50131.1K
123
101150
minimax-m2
MiniMax · Apache 2.0
1375±15
1,561$0.26 / $1196.6K
124
108149
gemini-2.5-flash-lite-preview-06-17-thinking
Google · Proprietary
1374±8
6,039$0.10 / $0.401M
125
106150
trinity-large
Arcee AI · Apache 2.0
1372±12
2,378N/AN/A
126
107150
deepseek-r1
DeepSeek · MIT
1372±12
2,317$0.70 / $2.5064K
127
109149
gemini-2.5-flash-lite-preview-09-2025-no-thinking
Google · Proprietary
1372±7
9,750$0.10 / $0.401M
128
113149
o4-mini-2025-04-16
OpenAI · Proprietary
1369±7
8,761$1.10 / $4.40200K
129
104154
intellect-3
Prime Intellect · MIT
1369±19
976$0.20 / $1.10131.1K
130
113149
deepseek-v3-0324
DeepSeek · MIT
1368±7
8,424$3 / $4.5032.8K
131
113150
gpt-4.1-mini-2025-04-14
OpenAI · Proprietary
1368±7
6,950$0.40 / $1.601M
132
111151
o1-2024-12-17
OpenAI · Proprietary
1368±10
3,973$15 / $60200K
133
108153
ring-flash-2.0
Ant Group · MIT
1367±15
1,554N/AN/A
134
111151
o1-preview
OpenAI · Proprietary
1367±9
5,123$15 / $60N/A
135
113151
grok-3-mini-beta
xAI · Proprietary
1367±9
4,267$0.30 / $0.50131.1K
136
101160
amazon-nova-experimental-chat-10-09
Amazon · Proprietary
1366±24
555N/AN/A
137
108154
Stepfun
step-3
StepFun · Apache 2.0
1365±17
1,239$0.57 / $1.4265.5K
138
113153
mistral-small-2506
Mistral · Apache 2.0
1364±10
3,380$0.10 / $0.3032K
139
117151
o1-mini
OpenAI · Proprietary
1363±7
8,478$1.10 / $4.40N/A
140
120151
o3-mini
OpenAI · Proprietary
1363±6
9,490$1.10 / $4.40200K
141
112154
Tencent
hunyuan-turbos-20250416
Tencent · Proprietary
1362±14
1,784N/AN/A
142
118153
Anthropic
claude-3-7-sonnet-20250219-thinking-32k
Anthropic · Proprietary
1362±8
6,211$3 / $15200K
143
120153
qwen2.5-max
Alibaba · Proprietary
1360±8
5,115N/AN/A
144
122153
minimax-m1
MiniMax · Apache 2.0
1359±8
6,537$0.40 / $2.201M
145
108164
qwen3-32b
Alibaba · Apache 2.0
1358±25
513$0.08 / $0.2441K
146
109164
nvidia-llama-3.3-nemotron-super-49b-v1.5
Nvidia · Nvidia Open
1358±22
662$0.10 / $0.40131.1K
147
122161
gpt-5-nano-high
OpenAI · Proprietary
1352±15
1,692$0.05 / $0.40400K
148
131158
gemini-2.0-flash-001
Google · Proprietary
1352±7
7,020$0.10 / $0.401M
149
127161
olmo-3.1-32b-instruct
Ai2 · Apache 2.0
1350±12
2,530$0.20 / $0.6065.5K
150
120167
glm-4.5v
Z.ai · MIT
1349±19
993$0.60 / $1.8065.5K
151
113178
Tencent
hunyuan-turbos-20250226
Tencent · Proprietary
1343±32
275N/AN/A
152
144161
Anthropic
claude-3-5-sonnet-20241022
Anthropic · Proprietary
1343±5
14,981$6 / $30200K
153
136173
Stepfun
step-1o-turbo-202506
StepFun · Proprietary
1340±15
1,520N/AN/A
154
144165
Anthropic
claude-3-7-sonnet-20250219
Anthropic · Proprietary
1340±7
7,168$3 / $15200K
155
144168
qwen3-30b-a3b
Alibaba · Apache 2.0
1338±9
4,551$0.08 / $0.2841K
156
145172
qwq-32b
Alibaba · Apache 2.0
1335±9
4,059$0.15 / $0.58131.1K
157
149173
Cohere
command-a-03-2025
Cohere · CC-BY-NC-4.0
1331±6
10,294$2.50 / $10256K
158
144180
qwen-plus-0125
Alibaba · Proprietary
1329±18
893$0.40 / $1.20131.1K
159
149177
deepseek-v3
DeepSeek · DeepSeek
1326±10
3,280$1.14 / $4.56N/A
160
136190
mercury
Inception AI · Proprietary
1326±29
399$0.25 / $0.75128K
161
151178
gemini-2.0-flash-lite-preview-02-05
Google · Proprietary
1323±10
3,474$0.07 / $0.301M
162
153177
gemma-3-27b-it
Google · Gemma
1323±7
8,126$0.08 / $0.16131.1K
163
146184
olmo-3-32b-think
Ai2 · Apache 2.0
1322±18
1,061$0.15 / $0.5065.5K
164
141197
Tencent
hunyuan-turbo-0110
Tencent · Proprietary
1320±30
299N/AN/A
165
152180
magistral-medium-2506
Mistral · Proprietary
1319±12
2,263$2 / $540K
166
149189
Stepfun
step-2-16k-exp-202412
StepFun · Proprietary
1317±20
737N/AN/A
167
154185
qwen2.5-plus-1127
Alibaba · Proprietary
1315±14
1,553N/AN/A
168
157184
01.AI
yi-lightning
01 AI · Proprietary
1313±10
4,316N/AN/A
169
157184
athene-v2-chat
NexusFlow · NexusFlow
1313±9
4,019N/AN/A
170
145200
llama-3.1-nemotron-ultra-253b-v1
Nvidia · Nvidia Open Model
1313±30
367$0.60 / $1.80131.1K
171
157184
mistral-small-3.1-24b-instruct-2503
Mistral · Apache 2.0
1310±8
6,176$0.10 / $0.3032K
172
154194
deepseek-v2.5-1210
DeepSeek · DeepSeek
1310±17
1,079N/AN/A
173
157190
gpt-oss-20b
OpenAI · Apache 2.0
1309±13
2,173$0.03 / $0.11131.1K
174
154197
Tencent
hunyuan-large-vision
Tencent · Proprietary
1308±19
969N/AN/A
175
152200
Tencent
hunyuan-large-2025-02-10
Tencent · Proprietary
1307±25
519N/AN/A
176
159187
Anthropic
claude-3-5-sonnet-20240620
Anthropic · Proprietary
1307±7
13,607$6 / $30200K
177
155198
gpt-4.1-nano-2025-04-14
OpenAI · Proprietary
1306±19
807$0.10 / $0.401M
178
161190
Meta
llama-4-maverick-17b-128e-instruct
Meta · Llama 4
1303±7
7,024$0.63 / $1.80131.1K
179
161195
deepseek-v2.5
DeepSeek · DeepSeek
1302±9
4,252N/AN/A
180
163197
gpt-4o-2024-05-13
OpenAI · Proprietary
1298±7
19,526$5 / $15128K
181
154211
llama-3.3-nemotron-49b-super-v1
Nvidia · Nvidia
1296±32
286N/AN/A
182
167197
gemini-1.5-pro-002
Google · Proprietary
1295±7
9,175$3.50 / $10.502.1M
183
168198
qwen2.5-72b-instruct
Alibaba · Qwen
1293±8
6,688$1.20 / $1.20N/A
184
169200
Meta
llama-3.1-405b-instruct-bf16
Meta · Llama 3.1 Community
1292±7
6,249$4 / $432.8K
185
168200
glm-4-plus
Zhipu AI · Proprietary
1291±9
4,449$0.44 / $1.76204.8K
186
170200
gpt-4o-mini-2024-07-18
OpenAI · Proprietary
1290±7
10,929$0.15 / $0.60128K
187
163207
olmo-3.1-32b-think
Ai2 · Apache 2.0
1289±15
1,575$0.15 / $0.5065.5K
188
169203
qwen-max-0919
Alibaba · Qwen
1289±11
2,756$1.60 / $6.4032.8K
189
173200
grok-2-2024-08-13
xAI · Proprietary
1288±7
10,368$2 / $10131.1K
190
163209
glm-4-plus-0111
Zhipu · Proprietary
1287±18
894N/AN/A
191
174200
Anthropic
claude-3-5-haiku-20241022
Anthropic · Proprietary
1287±6
11,269$0.80 / $4200K
192
173203
Meta
llama-4-scout-17b-16e-instruct
Meta · Llama
1287±9
5,284$0.40 / $0.708.2K
193
175203
Meta
llama-3.1-405b-instruct-fp8
Meta · Llama 3.1 Community
1284±7
9,714$4 / $432.8K
194
175205
gpt-4o-2024-08-06
OpenAI · Proprietary
1284±8
7,318$2.50 / $10128K
195
163216
gemma-3-12b-it
Google · Gemma
1282±23
543$0.04 / $0.13131.1K
196
181209
mistral-large-2407
Mistral · Mistral Research
1277±8
7,589$2 / $6131.1K
197
173216
qwen2.5-coder-32b-instruct
Alibaba · Apache 2.0
1276±18
873$0.87 / $0.8732K
198
181210
mistral-large-2411
Mistral · MRL
1276±9
4,212$2 / $6131.1K
199
179217
llama-3.1-nemotron-70b-instruct
Nvidia · Llama 3.1
1272±15
1,312$1.20 / $1.20131.1K
200
188214
amazon-nova-pro-v1.0
Amazon · Proprietary
1271±9
3,853$0.80 / $3.20300K
201
173220
Tencent
hunyuan-standard-2025-02-10
Tencent · Proprietary
1270±24
549N/AN/A
202
188215
gemma-3n-e4b-it
Google · Gemma
1270±10
3,542$0.02 / $0.0432.8K
203
191214
grok-2-mini-2024-08-13
xAI · Proprietary
1269±7
8,652$2 / $10131.1K
204
192213
Meta
llama-3.3-70b-instruct
Meta · Llama-3.3
1269±6
8,765$0.10 / $0.32131.1K
205
191214
gpt-4-turbo-2024-04-09
OpenAI · Proprietary
1269±7
17,104$10 / $30128K
206
188217
athene-70b-0725
NexusFlow · CC-BY-NC-4.0
1268±11
3,122N/AN/A
207
192215
gemini-1.5-pro-001
Google · Proprietary
1267±8
12,747$3.50 / $10.502.1M
208
193216
Anthropic
claude-3-opus-20240229
Anthropic · Proprietary
1265±6
33,748$15 / $75200K
209
193219
gemini-1.5-flash-002
Google · Proprietary
1262±8
5,892$0.07 / $0.301M
210
195219
Meta
llama-3.1-70b-instruct
Meta · Llama 3.1 Community
1260±7
9,389$0.40 / $0.40131.1K
211
197220
gemini-advanced-0514
Google · Proprietary
1255±9
8,138N/AN/A
212
198220
gpt-4-1106-preview
OpenAI · Proprietary
1255±8
15,605$10 / $30128K
213
197226
deepseek-coder-v2
DeepSeek · DeepSeek License
1252±12
2,671$0.14 / $0.28128K
214
206225
gpt-4-0125-preview
OpenAI · Proprietary
1250±8
15,289$10 / $30128K
215
196227
ibm-granite-h-small
IBM · Apache 2.0
1249±17
1,278N/AN/A
216
203227
mistral-small-24b-instruct-2501
Mistral · Apache 2.0
1246±12
2,083$0.05 / $0.0832.8K
217
210228
amazon-nova-lite-v1.0
Amazon · Proprietary
1240±10
3,060$0.06 / $0.24300K
218
213229
gemini-1.5-flash-001
Google · Proprietary
1236±8
10,680$0.07 / $0.301M
219
201236
llama-3.1-tulu-3-70b
Ai2 · Llama 3.1
1236±24
450N/AN/A
220
214230
phi-4
Microsoft · MIT
1232±10
3,305$0.07 / $0.1416.4K
221
208238
Tencent
hunyuan-standard-256k
Tencent · Proprietary
1231±25
497N/AN/A
222
208237
gemma-3-4b-it
Google · Gemma
1231±24
605$0.04 / $0.08131.1K
223
213234
reka-core-20240904
Reka AI · Proprietary
1231±16
1,216N/AN/A
224
213234
glm-4-0520
Zhipu AI · Proprietary
1228±14
1,718N/AN/A
225
213235
jamba-1.5-large
AI21 Labs · Jamba Open
1228±15
1,440$2 / $8256K
226
213243
llama-3.1-nemotron-51b-instruct
Nvidia · Llama 3.1
1224±22
665N/AN/A
227
217234
Anthropic
claude-3-sonnet-20240229
Anthropic · Proprietary
1223±8
18,888$3 / $15200K
228
218237
amazon-nova-micro-v1.0
Amazon · Proprietary
1218±10
2,981$0.04 / $0.14128K
229
219236
gemini-1.5-flash-8b-001
Google · Proprietary
1218±8
6,069$0.07 / $0.301M
230
220242
gemma-2-27b-it
Google · Gemma license
1212±6
12,088$0.65 / $0.658.2K
231
215249
olmo-2-0325-32b-instruct
Ai2 · Apache-2.0
1211±28
427$0.05 / $0.20128K
232
220244
nemotron-4-340b-instruct
Nvidia · NVIDIA Open Model
1210±11
3,254N/AN/A
233
220244
gpt-4-0314
OpenAI · Proprietary
1209±10
8,306$30 / $608.2K
234
223244
Meta
llama-3-70b-instruct
Meta · Llama 3 Community
1207±7
28,126$0.51 / $0.748.2K
235
220248
ministral-8b-2410
Mistral · MRL
1203±19
838$0.10 / $0.10131.1K
236
228247
Anthropic
claude-3-haiku-20240307
Anthropic · Proprietary
1200±7
20,898$0.25 / $1.25200K
237
229248
Cohere
c4ai-aya-expanse-32b
Cohere · CC-BY-NC-4.0
1197±9
4,685N/AN/A
238
229248
qwen2-72b-instruct
Alibaba · Qianwen LICENSE
1197±9
6,249$0.90 / $0.9032.8K
239
230248
Meta
llama-3.1-8b-instruct
Meta · Llama 3.1 Community
1195±8
8,582$0.02 / $0.0516.4K
240
229254
gemma-2-9b-it-simpo
Princeton · MIT
1192±15
1,471$0.03 / $0.098.2K
241
229256
reka-flash-20240904
Reka AI · Proprietary
1191±15
1,207N/AN/A
242
234253
gpt-4-0613
OpenAI · Proprietary
1188±8
13,719$30 / $608.2K
243
231259
Cohere
command-r-plus-08-2024
Cohere · CC-BY-NC-4.0
1188±14
1,675$2.50 / $10128K
244
224262
granite-3.1-8b-instruct
IBM · Apache 2.0
1187±26
478N/AN/A
245
234258
qwen1.5-110b-chat
Alibaba · Qianwen LICENSE
1185±10
4,763N/AN/A
246
226263
llama-3.1-tulu-3-8b
Ai2 · Llama 3.1
1184±25
476N/AN/A
247
235257
mistral-large-2402
Mistral · Proprietary
1184±9
10,418$4 / $1232K
248
234262
jamba-1.5-mini
AI21 Labs · Jamba Open
1179±15
1,352$0.20 / $0.40256K
249
240260
gemma-2-9b-it
Google · Gemma license
1174±7
8,921$0.03 / $0.098.2K
250
240262
Cohere
command-r-plus
Cohere · CC-BY-NC-4.0
1172±8
13,937$2.50 / $10128K
251
239263
Cohere
command-r-08-2024
Cohere · CC-BY-NC-4.0
1170±13
1,783$0.15 / $0.60128K
252
240263
01.AI
yi-1.5-34b-chat
01 AI · Apache-2.0
1170±11
3,841N/AN/A
253
243263
mixtral-8x22b-instruct-v0.1
Mistral · Apache 2.0
1166±9
8,780$0.90 / $0.9065.5K
254
242263
qwen1.5-72b-chat
Alibaba · Qianwen LICENSE
1166±10
6,370N/AN/A
255
241264
reka-flash-21b-20240226-online
Reka AI · Proprietary
1165±13
2,879N/AN/A
256
246264
mistral-medium
Mistral · Proprietary
1163±11
5,149$2.70 / $8.1032K
257
242266
Cohere
c4ai-aya-expanse-8b
Cohere · CC-BY-NC-4.0
1161±15
1,567N/AN/A
258
245266
internlm2_5-20b-chat
InternLM · Other
1160±14
1,684$0 / $032.8K
259
240274
qwq-32b-preview
Alibaba · Apache 2.0
1156±24
566$0.15 / $0.58131.1K
260
247267
qwen1.5-32b-chat
Alibaba · Qianwen LICENSE
1155±11
3,930N/AN/A
261
247268
reka-flash-21b-20240226
Reka AI · Proprietary
1154±11
4,748N/AN/A
262
250267
Meta
llama-3-8b-instruct
Meta · Llama 3 Community
1152±8
18,374$0.03 / $0.048.2K
263
244278
granite-3.1-2b-instruct
IBM · Apache 2.0
1150±25
508N/AN/A
264
255275
starling-lm-7b-beta
Nexusflow · Apache-2.0
1143±13
2,948N/AN/A
265
257278
qwen1.5-14b-chat
Alibaba · Qianwen LICENSE
1138±13
3,208$0.30 / $0.30N/A
266
259275
gpt-3.5-turbo-0125
OpenAI · Proprietary
1137±8
11,130$0.50 / $1.5016.4K
267
261278
dbrx-instruct-preview
Databricks · DBRX LICENSE
1132±11
5,502$0.60 / $0.6032.8K
268
262279
phi-3-medium-4k-instruct
Microsoft · MIT
1131±10
3,973$0.17 / $0.68N/A
269
257284
zephyr-orpo-141b-A35b-v0.1
HuggingFace · Apache 2.0
1130±21
831N/AN/A
270
262280
Cohere
command-r
Cohere · CC-BY-NC-4.0
1128±9
9,645$0.15 / $0.60128K
271
262280
mixtral-8x7b-instruct-v0.1
Mistral · Apache 2.0
1127±8
11,784$0.63 / $0.6332K
272
262291
tulu-2-dpo-70b
AllenAI/UW · AI2 ImpACT Low-risk
1117±21
805N/AN/A
273
262290
gpt-3.5-turbo-1106
OpenAI · Proprietary
1116±16
2,121$1 / $216.4K
274
265290
openchat-3.5-0106
OpenChat · Apache-2.0
1114±14
2,005N/AN/A
275
263291
granite-3.0-8b-instruct
IBM · Apache 2.0
1113±18
1,108N/AN/A
276
268287
gemma-2-2b-it
Google · Gemma license
1113±8
7,298N/AN/A
277
265290
01.AI
yi-34b-chat
01 AI · Yi License
1112±13
2,345$0.90 / $0.904.1K
278
262300
gemini-pro
Google · Proprietary
1109±24
678$0.35 / $1.0532.8K
279
265299
qwen1.5-7b-chat
Alibaba · Qianwen LICENSE
1108±21
772$0.20 / $0.20N/A
280
271297
gemini-pro-dev-api
Google · Proprietary
1105±14
2,681$0.35 / $1.0532.8K
281
271297
phi-3-small-8k-instruct
Microsoft · MIT
1102±12
3,219$0.15 / $0.60N/A
282
271300
Meta
llama-3.2-3b-instruct
Meta · Llama 3.2
1098±16
1,351$0.05 / $0.3480K
283
271301
starling-lm-7b-alpha
UC Berkeley · CC-BY-NC-4.0
1098±17
1,397N/AN/A
284
269303
deepseek-llm-67b-chat
DeepSeek · DeepSeek License
1096±24
649N/AN/A
285
272301
phi-3-mini-4k-instruct-june-2024
Microsoft · MIT
1094±14
1,841$0.13 / $0.524.1K
286
272301
phi-3-mini-4k-instruct
Microsoft · MIT
1093±12
3,449$0.13 / $0.52N/A
287
272303
granite-3.0-2b-instruct
IBM · Apache 2.0
1091±17
1,134N/AN/A
288
273301
snowflake-arctic-instruct
Snowflake · Apache 2.0
1090±11
5,734N/AN/A
289
278303
gemma-1.1-7b-it
Google · Gemma license
1084±11
4,332$0.03 / $0.098.2K
290
278303
mistral-7b-instruct-v0.2
Mistral · Apache-2.0
1082±12
3,114$0.20 / $0.2032.8K
291
273306
wizardlm-70b
Microsoft · Llama 2 Community
1082±20
988N/AN/A
292
273307
nous-hermes-2-mixtral-8x7b-dpo
NousResearch · Apache-2.0
1080±24
575$0.90 / $0.90N/A
293
280303
Meta
llama-2-70b-chat
Meta · Llama 2 Community
1079±10
5,717$0.70 / $2.804.1K
294
278304
vicuna-33b
LMSYS · Non-commercial
1079±13
2,866$0 / $02K
295
278308
openchat-3.5
OpenChat · Apache-2.0
1075±20
971$0.20 / $0.20N/A
296
276311
qwen-14b-chat
Alibaba · Qianwen LICENSE
1072±24
599N/AN/A
297
281308
Meta
llama-3.2-1b-instruct
Meta · Llama 3.2
1071±16
1,346$0.03 / $0.2060K
298
278311
solar-10.7b-instruct-v1.0
Upstage AI · CC-BY-NC-4.0
1067±27
482$0.30 / $0.30N/A
299
280311
openhermes-2.5-mistral-7b
NousResearch · Apache-2.0
1065±24
589$0.17 / $0.17N/A
300
287310
Meta
llama-2-13b-chat
Meta · Llama 2 Community
1063±13
2,626$0.25 / $0.254.1K
301
278320
zephyr-7b-alpha
HuggingFace · MIT
1053±41
201N/AN/A
302
293316
gemma-7b-it
Google · Gemma license
1049±17
1,381$0.05 / $0.088.2K
303
283320
smollm2-1.7b-instruct
HuggingFace · Apache 2.0
1049±33
352N/AN/A
304
292316
Meta
codellama-34b-instruct
Meta · Llama 2 Community
1046±21
853$0.35 / $1.4016.4K
305
293316
zephyr-7b-beta
HuggingFace · MIT
1045±19
1,250$0.15 / $0.1516.4K
306
295316
vicuna-13b
LMSYS · Llama 2 Community
1041±14
2,389$0.30 / $0.30N/A
307
297316
phi-3-mini-128k-instruct
Microsoft · MIT
1040±13
3,886$0.13 / $0.52N/A
308
287320
mpt-30b-chat
MosaicML · CC-BY-NC-SA-4.0
1040±36
258N/AN/A
309
294320
wizardlm-13b
Microsoft · Llama 2 Community
1036±22
735$0.30 / $0.30N/A
310
298317
gemma-1.1-2b-it
Google · Gemma license
1035±14
1,963N/AN/A
311
297320
llama2-70b-steerlm-chat
Nvidia · Llama 2 Community
1025±29
467N/AN/A
312
301320
mistral-7b-instruct
Mistral · Apache 2.0
1019±20
1,032$0.07 / $0.284.1K
313
301320
olmo-7b-instruct
Ai2 · Apache-2.0
1016±22
772$0.20 / $0.20N/A
314
301321
vicuna-7b
LMSYS · Llama 2 Community
1011±23
726$0.20 / $0.20N/A
315
301321
gemma-2b-it
Google · Gemma license
1010±22
742$0.10 / $0.10N/A
316
307321
Meta
llama-2-7b-chat
Meta · Llama 2 Community
1003±14
1,956$0.15 / $0.154.1K
317
306321
stripedhyena-nous-7b
Together AI · Apache 2.0
1002±23
704$0.20 / $0.20N/A
318
307321
qwen1.5-4b-chat
Alibaba · Qianwen LICENSE
999±18
1,283$0.10 / $0.10N/A
319
301322
guanaco-33b
UW · Non-commercial
996±36
263N/AN/A
320
307321
palm-2
Google · Proprietary
995±21
917$0.50 / $0.5025.8K
321
314326
chatglm3-6b
Tsinghua · Apache-2.0
965±27
535N/AN/A
322
320327
koala-13b
UC Berkeley · Non-commercial
946±25
747N/AN/A
323
321328
RWKV-4-Raven-14B
RWKV · Apache 2.0
929±28
505N/AN/A
324
321328
chatglm-6b
Tsinghua · Non-commercial
920±27
551N/AN/A
325
321328
mpt-7b-chat
MosaicML · CC-BY-NC-SA-4.0
914±32
397N/AN/A
326
321328
chatglm2-6b
Tsinghua · Apache-2.0
903±36
293N/AN/A
327
322328
oasst-pythia-12b
OpenAssistant · Apache 2.0
901±26
714N/AN/A
328
323328
Stability
stablelm-tuned-alpha-7b
Stability AI · CC-BY-NC-SA-4.0
887±34
363N/AN/A
329
329331
alpaca-13b
Stanford · Non-commercial
799±28
626N/AN/A
330
329331
dolly-v2-12b
Databricks · MIT
777±34
396N/AN/A
331
329331
fastchat-t5-3b
LMSYS · Apache 2.0
765±31
428N/AN/A
332
332332
Meta
llama-13b
Meta · Non-commercial
684±41
304$0.23 / $0.23N/A

Remove Style Control Leaderboard Plots

Battle Count for Each Combination of Models (without Ties)

Confidence Intervals on Model Strength (via Bootstrapping)

Fraction of Model A Wins for All Non-tied A vs. B Battles

Average Win Rate Against All Other Models (Uniform Sampling and No Ties)