Text Arena💻Coding

View overall rankings across various AI models in text-to-text tasks across math, coding, creative writing, and other open-ended domains.

May 14, 2026
1,153,094 votes
352 models
Rank Spread
1
13
Anthropic
claude-opus-4-6
Anthropic · Proprietary
1541±8
6,738$5 / $251M
2
14
Anthropic
claude-opus-4-6-thinking
Anthropic · Proprietary
1537±8
5,893$5 / $251M
3
14
Anthropic
claude-opus-4-7-thinking
Anthropic · Proprietary
1529±11
2,866$5 / $251M
4
28
Anthropic
claude-opus-4-7
Anthropic · Proprietary
1520±11
3,149$5 / $251M
5
416
Anthropic
claude-opus-4-5-20251101-thinking-32k
Anthropic · Proprietary
1503±7
7,620$5 / $25200K
6
416
gpt-5.4-high
OpenAI · Proprietary
1502±9
4,554$2.50 / $151.1M
7
420
glm-5.1
Z.ai · MIT
1502±11
2,925$1.40 / $4.40202.8K
8
519
Anthropic
claude-sonnet-4-6
Anthropic · Proprietary
1501±9
4,648$3 / $151M
9
426
mimo-v2.5-pro
Xiaomi · MIT
1498±13
2,030$1 / $31M
10
520
Anthropic
claude-opus-4-5-20251101
Anthropic · Proprietary
1497±6
12,813$5 / $25200K
11
530
gpt-5.5-high
OpenAI · Proprietary
1493±13
2,179$5 / $301.1M
12
531
ernie-5.1
Baidu · Proprietary
1492±14
1,826N/AN/A
13
530
kimi-k2.6
Moonshot · Modified MIT
1491±12
2,196$0.95 / $4262.1K
14
527
gemini-3.1-pro-preview
Google · Proprietary
1490±7
7,632$2 / $121M
15
728
Anthropic
claude-sonnet-4-5-20250929-thinking-32k
Anthropic · Proprietary
1487±5
15,142$3 / $15200K
16
542
amazon-nova-experimental-chat-26-02-10
Amazon · Proprietary
1486±20
842N/AN/A
17
537
kimi-k2.5-instant
Moonshot · Modified MIT
1485±14
1,804$0.40 / $1.90262.1K
18
1031
Anthropic
claude-sonnet-4-5-20250929
Anthropic · Proprietary
1484±6
14,844$3 / $15200K
19
733
gpt-5.4
OpenAI · Proprietary
1483±9
4,975$2.50 / $151.1M
20
1032
gemini-3-pro
Google · Proprietary
1483±7
8,568$2 / $121M
21
835
qwen3.5-max-preview
Alibaba · Proprietary
1482±9
4,089N/AN/A
22
739
Meta
muse-spark
Meta · Proprietary
1481±11
2,702N/AN/A
23
1034
Anthropic
claude-opus-4-1-20250805-thinking-16k
Anthropic · Proprietary
1481±7
9,843$15 / $75200K
24
1035
kimi-k2.5-thinking
Moonshot · Modified MIT
1479±7
7,017$0.60 / $3N/A
25
1042
gpt-5.5
OpenAI · Proprietary
1478±12
2,311$5 / $301.1M
26
1039
mimo-v2-pro
Xiaomi · Proprietary
1478±9
4,404$1 / $31M
27
1242
Bytedance
dola-seed-2.0-pro
Bytedance · Proprietary
1475±7
7,193N/AN/A
28
1145
longcat-flash-chat-2602-exp
Meituan · Proprietary
1474±9
3,943N/AN/A
29
1541
Anthropic
claude-opus-4-1-20250805
Anthropic · Proprietary
1473±5
15,530$15 / $75200K
30
1351
qwen3.6-plus
Alibaba · Proprietary
1470±11
2,829$0.33 / $1.951M
31
1357
longcat-flash-chat
Meituan · MIT
1468±13
2,233$0.20 / $0.80131.1K
32
1765
deepseek-v4-pro-thinking
DeepSeek · MIT
1464±13
2,206$0.43 / $0.871M
33
2255
gemini-3-flash
Google · Proprietary
1464±8
6,385$0.50 / $31M
34
1865
deepseek-v4-pro
DeepSeek · MIT
1464±12
2,532$0.43 / $0.871M
35
2356
qwen3.5-397b-a17b
Alibaba · Apache 2.0
1464±8
6,078$0.39 / $2.34262.1K
36
2257
grok-4.20-multi-agent-beta-0309
xAI · Proprietary
1463±8
4,971$2 / $62M
37
1971
mimo-v2.5
Xiaomi · MIT
1462±12
2,262$0.40 / $21M
38
2559
ernie-5.0-0110
Baidu · Proprietary
1461±7
6,979N/AN/A
39
2668
grok-4.20-beta-0309-reasoning
xAI · Proprietary
1459±9
4,884$2 / $62M
40
2974
qwen3-max-preview
Alibaba · Proprietary
1457±8
5,362$0.78 / $3.90262.1K
41
2580
glm-4.7
Z.ai · MIT
1457±12
2,411$0.40 / $1.75202.8K
42
2976
glm-5
Z.ai · MIT
1456±8
4,874$1 / $3.20202.8K
43
2089
qwen3.6-max-preview
Alibaba · Proprietary
1456±17
1,106$1.04 / $6.24262.1K
44
2389
gemma-4-31b
Google · Apache 2.0
1455±15
1,349$0.14 / $0.40262.1K
45
3075
kimi-k2-thinking-turbo
Moonshot · Modified MIT
1454±6
12,424$1.15 / $8262.1K
46
3174
gemini-2.5-pro
Google · Proprietary
1453±4
23,896$1.25 / $101M
47
3078
deepseek-v3.2-thinking
DeepSeek · MIT
1453±7
7,874$0.25 / $0.38131.1K
48
3079
gpt-5.1-high
OpenAI · Proprietary
1452±7
8,214$1.25 / $10400K
49
3092
deepseek-v4-flash
DeepSeek · MIT
1451±12
2,224$0.11 / $0.221M
50
3182
glm-4.6
Z.ai · MIT
1450±7
7,485$0.43 / $1.74202.8K
51
3380
Anthropic
claude-haiku-4-5-20251001
Anthropic · Proprietary
1450±5
15,437$1 / $5200K
52
3186
grok-4.20-beta1
xAI · Proprietary
1449±8
4,997N/AN/A
53
3186
gpt-5.2-chat-latest-20260210
OpenAI · Proprietary
1449±8
6,190$1.75 / $14128K
54
3584
grok-4.1-thinking
xAI · Proprietary
1448±6
12,259N/AN/A
55
3092
deepseek-v4-flash-thinking
DeepSeek · MIT
1448±12
2,218$0.11 / $0.221M
56
3586
gpt-5.2-high
OpenAI · Proprietary
1448±7
9,195$1.75 / $14400K
57
3688
deepseek-v3.2
DeepSeek · MIT
1447±7
9,734$0.25 / $0.38131.1K
58
3292
gpt-5.4-mini-high
OpenAI · Proprietary
1446±9
4,133$0.75 / $4.50400K
59
3689
mistral-large-3
Mistral · Apache 2.0
1446±7
9,180$0.50 / $1.50N/A
60
3889
gemini-3-flash (thinking-minimal)
Google · Proprietary
1445±6
9,892$0.50 / $31M
61
3096
gemma-4-26b-a4b
Google · Apache 2.0
1444±15
1,357N/AN/A
62
3992
grok-4.1
xAI · Proprietary
1444±6
13,313N/AN/A
63
4289
qwen3-235b-a22b-instruct-2507
Alibaba · Apache 2.0
1444±5
18,970$0.26 / $1.06N/A
64
29103
amazon-nova-experimental-chat-26-01-10
Amazon · Proprietary
1444±21
734N/AN/A
65
3693
minimax-m2.7
MiniMax · Modified MIT
1443±9
4,154$0.28 / $1.20204.8K
66
3992
Anthropic
claude-opus-4-20250514-thinking-16k
Anthropic · Proprietary
1442±8
6,674$15 / $75200K
67
4492
mimo-v2-flash (non-thinking)
Xiaomi · MIT
1441±6
9,299$0.10 / $0.30262.1K
68
4094
qwen3-next-80b-a3b-instruct
Alibaba · Apache 2.0
1440±9
4,794$0.09 / $1.10262.1K
69
3698
qwen3-vl-235b-a22b-instruct
Alibaba · Apache 2.0
1440±13
2,316$0.20 / $0.88262.1K
70
3699
qwen3-max-2025-09-23
Alibaba · Proprietary
1440±13
2,041$0.78 / $3.90262.1K
71
4694
gpt-5.2
OpenAI · Proprietary
1439±7
8,474$1.75 / $14400K
72
38103
deepseek-v3.2-exp-thinking
DeepSeek · MIT
1438±13
1,918$0.27 / $0.41163.8K
73
4896
gpt-5.1
OpenAI · Proprietary
1437±7
9,126$1.25 / $10400K
74
40103
grok-4.3
xAI · Proprietary
1436±13
1,969$1.25 / $2.501M
75
4896
Stepfun
step-3.5-flash
StepFun · Apache 2.0
1436±8
6,192$0.10 / $0.30262.1K
76
39105
gpt-5.5-instant
OpenAI · Proprietary
1435±15
1,563$5 / $301.1M
77
4999
gpt-5-high
OpenAI · Proprietary
1435±8
6,361$1.25 / $10400K
78
49101
qwen3.5-122b-a10b
Alibaba · Apache 2.0
1434±8
5,293$0.26 / $2.08262.1K
79
45103
deepseek-v3.2-exp
DeepSeek · MIT
1434±12
2,499$0.27 / $0.41163.8K
80
40110
Tencent
hunyuan-hy3-preview
Tencent · tencent-hunyuan-community
1434±15
1,336$0.29 / $1.17262.1K
81
5996
mistral-medium-2508
Mistral · Proprietary
1434±5
18,571$2.70 / $8.1032K
82
50103
glm-4.5
Z.ai · MIT
1433±9
4,769$0.60 / $2.20131.1K
83
53103
amazon-nova-experimental-chat-11-10
Amazon · Proprietary
1432±8
5,321N/AN/A
84
53103
grok-3-preview-02-24
xAI · Proprietary
1432±8
5,399$3 / $15131.1K
85
38121
amazon-nova-experimental-chat-12-10
Amazon · Proprietary
1431±21
704N/AN/A
86
44115
grok-4-fast-chat
xAI · Proprietary
1430±16
1,249$3 / $15256K
87
36126
deepseek-v3.1-terminus-thinking
DeepSeek · MIT
1429±23
636$0.27 / $0.95163.8K
88
50115
qwen3-vl-235b-a22b-thinking
Alibaba · Apache 2.0
1428±14
1,625$0.26 / $2.60131.1K
89
59112
deepseek-r1-0528
DeepSeek · MIT
1427±11
2,727$0.50 / $2.15163.8K
90
54115
ernie-5.0-preview-1203
Baidu · Proprietary
1426±13
1,963N/AN/A
91
65115
minimax-m2.1-preview
MiniMax · MIT
1424±10
3,430$0.29 / $0.95204.8K
92
59122
qwen3-235b-a22b-thinking-2507
Alibaba · Apache 2.0
1424±15
1,612$0.15 / $1.50262.1K
93
72110
gemini-2.5-flash
Google · Proprietary
1423±4
23,254$0.30 / $2.501M
94
43135
Tencent
hunyuan-vision-1.5-thinking
Tencent · Proprietary
1421±27
437N/AN/A
95
68125
mimo-v2-flash (thinking)
Xiaomi · MIT
1419±12
2,444$0.10 / $0.30262.1K
96
72121
grok-4-fast-reasoning
xAI · Proprietary
1419±9
3,955$0.20 / $0.502M
97
66127
deepseek-v3.1-thinking
DeepSeek · MIT
1418±13
1,904$1.23 / $4.94N/A
98
75119
qwen3.5-27b
Alibaba · Apache 2.0
1418±8
5,186$0.20 / $1.56262.1K
99
75121
qwen3-30b-a3b-instruct-2507
Alibaba · Apache 2.0
1418±9
4,665$0.09 / $0.30262.1K
100
84120
chatgpt-4o-latest-20250326
OpenAI · Proprietary
1415±5
15,859$5 / $15128K
101
76129
deepseek-v3.1
DeepSeek · MIT
1414±11
2,625$1.23 / $4.94N/A
102
76129
amazon-nova-experimental-chat-10-20
Amazon · Proprietary
1413±12
2,291N/AN/A
103
83127
Anthropic
claude-sonnet-4-20250514-thinking-32k
Anthropic · Proprietary
1413±8
6,415$3 / $151M
104
84125
grok-4-1-fast-reasoning
xAI · Proprietary
1413±6
11,728$0.20 / $0.502M
105
68135
ernie-5.0-preview-1022
Baidu · Proprietary
1413±19
917N/AN/A
106
83128
qwen3-coder-480b-a35b-instruct
Alibaba · Apache 2.0
1412±9
4,852$0.40 / $1.60262.1K
107
84129
qwen3.5-35b-a3b
Alibaba · Apache 2.0
1411±8
5,388$0.14 / $1262.1K
108
84129
gpt-5.4-nano-high
OpenAI · Proprietary
1410±9
4,114$0.20 / $1.25400K
109
86129
grok-4-0709
xAI · Proprietary
1409±7
8,155$3 / $15256K
110
87129
o3-2025-04-16
OpenAI · Proprietary
1408±6
11,749$2 / $8200K
111
87131
gpt-5-mini-high
OpenAI · Proprietary
1407±8
5,503$0.25 / $2400K
112
73143
deepseek-v3.1-terminus
DeepSeek · MIT
1407±21
778$0.27 / $0.95163.8K
113
87131
qwen3.5-flash
Alibaba · Proprietary
1406±8
5,572N/AN/A
114
86135
nvidia-nemotron-3-super-120b-a12b
Nvidia · NVIDIA Open Model
1405±14
1,722N/AN/A
115
91132
gemini-3.1-flash-lite-preview
Google · Proprietary
1404±8
6,263$0.25 / $1.501M
116
91132
gpt-5.3-chat-latest
OpenAI · Proprietary
1403±8
5,939$1.75 / $14128K
117
93135
gemini-2.5-flash-preview-09-2025
Google · Proprietary
1402±7
6,838$0.30 / $2.501M
118
96134
Anthropic
claude-opus-4-20250514
Anthropic · Proprietary
1402±7
7,901$15 / $75200K
119
97135
gpt-5-chat
OpenAI · Proprietary
1400±8
5,988$1.25 / $10128K
120
91141
kimi-k2-0905-preview
Moonshot · Modified MIT
1400±12
2,243$0.60 / $2.50262.1K
121
99135
qwen3-235b-a22b-no-thinking
Alibaba · Apache 2.0
1399±7
6,978$0.46 / $1.82131.1K
122
92144
gpt-4.5-preview-2025-02-27
OpenAI · Proprietary
1397±13
1,939$75 / $150128K
123
102138
glm-4.5-air
Z.ai · MIT
1397±8
6,111$0.13 / $0.85131.1K
124
97144
mai-1-preview
Microsoft AI · Proprietary
1396±11
2,781N/AN/A
125
84162
glm-4.6v
Z.ai · MIT
1395±25
536$0.30 / $0.90131.1K
126
90162
mercury-2
Inception AI · Proprietary
1392±21
767$0.25 / $0.75128K
127
103150
qwen3-next-80b-a3b-thinking
Alibaba · Apache 2.0
1392±11
2,677$0.10 / $0.78262.1K
128
109144
minimax-m2.5
MiniMax · Modified MIT
1391±8
6,438$0.15 / $1.15204.8K
129
100155
ling-flash-2.0
Ant Group · MIT
1391±15
1,528N/AN/A
130
111144
gpt-4.1-2025-04-14
OpenAI · Proprietary
1390±7
9,315$2 / $81M
131
109154
nova-2-lite
Amazon · Proprietary
1389±12
2,518$0.30 / $2.501M
132
97167
Tencent
hunyuan-t1-20250711
Tencent · Proprietary
1388±20
806N/AN/A
133
114152
mistral-medium-2505
Mistral · Proprietary
1386±8
5,900$0.40 / $2131.1K
134
113154
qwen3-235b-a22b
Alibaba · Apache 2.0
1386±9
4,340$0.46 / $1.82131.1K
135
113162
glm-4.7-flash
Z.ai · MIT
1384±11
2,691$0.06 / $0.40202.8K
136
121162
gpt-oss-120b
OpenAI · Apache 2.0
1380±8
6,494$0.04 / $0.18131.1K
137
120163
nvidia-nemotron-3-nano-30b-a3b-bf16
Nvidia · NVIDIA Open Model
1380±10
3,283$0.06 / $0.24262.1K
138
122162
Anthropic
claude-sonnet-4-20250514
Anthropic · Proprietary
1380±7
7,398$3 / $151M
139
120167
o3-mini-high
OpenAI · Proprietary
1379±12
2,596$1.10 / $4.40200K
140
122163
kimi-k2-0711-preview
Moonshot · Modified MIT
1378±8
5,243$0.60 / $2.50131.1K
141
123169
grok-3-mini-high
xAI · Proprietary
1376±10
3,298$0.25 / $1.27N/A
142
127169
gemini-2.5-flash-lite-preview-06-17-thinking
Google · Proprietary
1374±8
6,005$0.10 / $0.401M
143
121170
minimax-m2
MiniMax · Apache 2.0
1374±15
1,544$0.26 / $1204.8K
144
127169
trinity-large-preview
Arcee AI · Apache 2.0
1373±8
5,299$0.15 / $0.45131K
145
128169
gemini-2.5-flash-lite-preview-09-2025-no-thinking
Google · Proprietary
1372±6
9,684$0.10 / $0.401M
146
127170
deepseek-r1
DeepSeek · MIT
1372±12
2,317$0.70 / $2.50163.8K
147
128170
trinity-large-thinking
Arcee AI · Apache 2.0
1369±10
3,586$0.22 / $0.85262.1K
148
121173
intellect-3
Prime Intellect · MIT
1369±19
973$0.20 / $1.10131.1K
149
132169
deepseek-v3-0324
DeepSeek · MIT
1369±7
8,371$3 / $4.5032.8K
150
132169
o4-mini-2025-04-16
OpenAI · Proprietary
1369±7
8,721$1.10 / $4.40200K
151
132170
gpt-4.1-mini-2025-04-14
OpenAI · Proprietary
1367±7
6,918$0.40 / $1.601M
152
129171
o1-2024-12-17
OpenAI · Proprietary
1367±10
3,973$15 / $60200K
153
131171
o1-preview
OpenAI · Proprietary
1367±9
5,123$15 / $60N/A
154
132171
grok-3-mini-beta
xAI · Proprietary
1366±9
4,256$0.30 / $0.50131.1K
155
127173
ring-flash-2.0
Ant Group · MIT
1366±15
1,539N/AN/A
156
120180
amazon-nova-experimental-chat-10-09
Amazon · Proprietary
1366±24
553N/AN/A
157
127174
Stepfun
step-3
StepFun · Apache 2.0
1365±16
1,233$0.57 / $1.4265.5K
158
132173
mistral-small-2506
Mistral · Apache 2.0
1363±10
3,361$0.10 / $0.3032K
159
137172
o1-mini
OpenAI · Proprietary
1363±7
8,478$1.10 / $4.40N/A
160
139172
o3-mini
OpenAI · Proprietary
1362±6
9,461$1.10 / $4.40200K
161
139173
Anthropic
claude-3-7-sonnet-20250219-thinking-32k
Anthropic · Proprietary
1361±8
6,192$3 / $15200K
162
132175
Tencent
hunyuan-turbos-20250416
Tencent · Proprietary
1361±14
1,776N/AN/A
163
139173
qwen2.5-max
Alibaba · Proprietary
1360±8
5,101N/AN/A
164
141173
minimax-m1
MiniMax · Apache 2.0
1359±8
6,492$0.40 / $2.201M
165
127184
qwen3-32b
Alibaba · Apache 2.0
1358±24
513$0.08 / $0.28131.1K
166
128184
nvidia-llama-3.3-nemotron-super-49b-v1.5
Nvidia · Nvidia Open
1357±22
659$0.10 / $0.40131.1K
167
141182
gpt-5-nano-high
OpenAI · Proprietary
1352±15
1,684$0.05 / $0.40400K
168
151178
gemini-2.0-flash-001
Google · Proprietary
1352±7
6,995$0.10 / $0.401M
169
139187
glm-4.5v
Z.ai · MIT
1350±18
993$0.60 / $1.8065.5K
170
147181
olmo-3.1-32b-instruct
Ai2 · Apache 2.0
1350±12
2,512$0.20 / $0.6065.5K
171
132198
Tencent
hunyuan-turbos-20250226
Tencent · Proprietary
1343±31
275N/AN/A
172
163181
Anthropic
claude-3-5-sonnet-20241022
Anthropic · Proprietary
1343±5
14,965$3 / $15200K
173
156191
Stepfun
step-1o-turbo-202506
StepFun · Proprietary
1340±15
1,504N/AN/A
174
164187
Anthropic
claude-3-7-sonnet-20250219
Anthropic · Proprietary
1339±7
7,146$3 / $15200K
175
164188
qwen3-30b-a3b
Alibaba · Apache 2.0
1338±9
4,533$0.09 / $0.45131.1K
176
165193
qwq-32b
Alibaba · Apache 2.0
1334±9
4,046$0.50 / $116.4K
177
168193
Cohere
command-a-03-2025
Cohere · CC-BY-NC-4.0
1331±6
10,217$2.50 / $10256K
178
164200
qwen-plus-0125
Alibaba · Proprietary
1329±18
893$0.40 / $1.20131.1K
179
154209
mercury
Inception AI · Proprietary
1327±29
393$0.25 / $0.75128K
180
169197
deepseek-v3
DeepSeek · DeepSeek
1325±10
3,280$1.14 / $4.56N/A
181
171198
gemini-2.0-flash-lite-preview-02-05
Google · Proprietary
1322±10
3,474$0.07 / $0.301M
182
173197
gemma-3-27b-it
Google · Gemma
1322±7
8,075$0.08 / $0.16131.1K
183
166204
olmo-3-32b-think
Ai2 · Apache 2.0
1321±18
1,055$0.15 / $0.5065.5K
184
162217
Tencent
hunyuan-turbo-0110
Tencent · Proprietary
1320±30
299N/AN/A
185
171200
magistral-medium-2506
Mistral · Proprietary
1319±12
2,249$2 / $540K
186
169209
Stepfun
step-2-16k-exp-202412
StepFun · Proprietary
1317±20
737N/AN/A
187
174205
qwen2.5-plus-1127
Alibaba · Proprietary
1315±14
1,553N/AN/A
188
177204
01.AI
yi-lightning
01 AI · Proprietary
1313±10
4,316N/AN/A
189
177204
athene-v2-chat
NexusFlow · NexusFlow
1313±9
4,019N/AN/A
190
165220
llama-3.1-nemotron-ultra-253b-v1
Nvidia · Nvidia Open Model
1312±30
367$0.60 / $1.80131.1K
191
177204
mistral-small-3.1-24b-instruct-2503
Mistral · Apache 2.0
1310±8
6,135$0.10 / $0.3032K
192
174214
deepseek-v2.5-1210
DeepSeek · DeepSeek
1310±17
1,079N/AN/A
193
177210
gpt-oss-20b
OpenAI · Apache 2.0
1308±13
2,169$0.03 / $0.14131.1K
194
171220
Tencent
hunyuan-large-2025-02-10
Tencent · Proprietary
1307±24
519N/AN/A
195
179207
Anthropic
claude-3-5-sonnet-20240620
Anthropic · Proprietary
1307±7
13,607$3 / $15200K
196
174217
Tencent
hunyuan-large-vision
Tencent · Proprietary
1307±19
964N/AN/A
197
174218
gpt-4.1-nano-2025-04-14
OpenAI · Proprietary
1306±19
807$0.10 / $0.401M
198
181210
Meta
llama-4-maverick-17b-128e-instruct
Meta · Llama 4
1303±7
6,996$0.63 / $1.80131.1K
199
181215
deepseek-v2.5
DeepSeek · DeepSeek
1302±9
4,252N/AN/A
200
183216
gpt-4o-2024-05-13
OpenAI · Proprietary
1298±6
19,526$5 / $15128K
201
174231
llama-3.3-nemotron-49b-super-v1
Nvidia · Nvidia
1296±31
286N/AN/A
202
187217
gemini-1.5-pro-002
Google · Proprietary
1295±7
9,175$3.50 / $10.502.1M
203
188218
qwen2.5-72b-instruct
Alibaba · Qwen
1293±8
6,688$1.20 / $1.20N/A
204
189220
Meta
llama-3.1-405b-instruct-bf16
Meta · Llama 3.1 Community
1292±7
6,249$4 / $432.8K
205
188220
glm-4-plus
Z.ai · Proprietary
1291±9
4,449$0.44 / $1.76204.8K
206
191220
gpt-4o-mini-2024-07-18
OpenAI · Proprietary
1290±6
10,927$0.15 / $0.60128K
207
183227
olmo-3.1-32b-think
Ai2 · Apache 2.0
1289±15
1,570$0.15 / $0.5065.5K
208
189223
qwen-max-0919
Alibaba · Qwen
1289±11
2,756$1.60 / $6.4032.8K
209
193220
grok-2-2024-08-13
xAI · Proprietary
1288±7
10,368$2 / $10131.1K
210
183229
glm-4-plus-0111
Z.ai · Proprietary
1287±18
894N/AN/A
211
194220
Anthropic
claude-3-5-haiku-20241022
Anthropic · Proprietary
1287±6
11,245$0.80 / $4200K
212
193223
Meta
llama-4-scout-17b-16e-instruct
Meta · Llama
1286±9
5,259$0.40 / $0.708.2K
213
196223
Meta
llama-3.1-405b-instruct-fp8
Meta · Llama 3.1 Community
1284±7
9,714$4 / $432.8K
214
195224
gpt-4o-2024-08-06
OpenAI · Proprietary
1284±8
7,318$2.50 / $10128K
215
183235
gemma-3-12b-it
Google · Gemma
1282±23
543$0.04 / $0.13131.1K
216
201229
mistral-large-2407
Mistral · Mistral Research
1277±8
7,589$2 / $6131.1K
217
193236
qwen2.5-coder-32b-instruct
Alibaba · Apache 2.0
1276±18
873$0.87 / $0.8732K
218
201230
mistral-large-2411
Mistral · MRL
1276±9
4,212$2 / $6131.1K
219
199237
llama-3.1-nemotron-70b-instruct
Nvidia · Llama 3.1
1272±15
1,312$1.20 / $1.20131.1K
220
208234
amazon-nova-pro-v1.0
Amazon · Proprietary
1270±9
3,853$0.80 / $3.20300K
221
193240
Tencent
hunyuan-standard-2025-02-10
Tencent · Proprietary
1270±24
549N/AN/A
222
208235
gemma-3n-e4b-it
Google · Gemma
1270±10
3,532$0.06 / $0.1232.8K
223
211233
grok-2-mini-2024-08-13
xAI · Proprietary
1269±7
8,652$2 / $10131.1K
224
212233
Meta
llama-3.3-70b-instruct
Meta · Llama-3.3
1269±6
8,748$0.10 / $0.32131.1K
225
212234
gpt-4-turbo-2024-04-09
OpenAI · Proprietary
1269±7
17,104$10 / $30128K
226
208237
athene-70b-0725
NexusFlow · CC-BY-NC-4.0
1267±11
3,122N/AN/A
227
212235
gemini-1.5-pro-001
Google · Proprietary
1267±7
12,747$3.50 / $10.502.1M
228
213235
Anthropic
claude-3-opus-20240229
Anthropic · Proprietary
1265±6
33,748$15 / $75200K
229
213239
gemini-1.5-flash-002
Google · Proprietary
1262±8
5,892$0.07 / $0.301M
230
215239
Meta
llama-3.1-70b-instruct
Meta · Llama 3.1 Community
1260±7
9,389$0.40 / $0.40131.1K
231
217240
gemini-advanced-0514
Google · Proprietary
1255±9
8,138N/AN/A
232
219240
gpt-4-1106-preview
OpenAI · Proprietary
1254±7
15,605$10 / $30128K
233
217246
deepseek-coder-v2
DeepSeek · DeepSeek License
1251±12
2,671$0.14 / $0.28128K
234
226244
gpt-4-0125-preview
OpenAI · Proprietary
1250±8
15,289$10 / $30128K
235
216247
ibm-granite-h-small
IBM · Apache 2.0
1248±17
1,264N/AN/A
236
225247
mistral-small-24b-instruct-2501
Mistral · Apache 2.0
1246±12
2,083$0.05 / $0.0832.8K
237
230248
amazon-nova-lite-v1.0
Amazon · Proprietary
1239±10
3,060$0.06 / $0.24300K
238
233248
gemini-1.5-flash-001
Google · Proprietary
1236±8
10,680$0.07 / $0.301M
239
221256
llama-3.1-tulu-3-70b
Ai2 · Llama 3.1
1236±24
450N/AN/A
240
234250
phi-4
Microsoft · MIT
1232±10
3,305$0.07 / $0.1416.4K
241
228257
Tencent
hunyuan-standard-256k
Tencent · Proprietary
1231±24
497N/AN/A
242
228257
gemma-3-4b-it
Google · Gemma
1231±24
605$0.04 / $0.08131.1K
243
233254
reka-core-20240904
Reka AI · Proprietary
1230±15
1,216N/AN/A
244
233254
glm-4-0520
Z.ai · Proprietary
1228±14
1,718N/AN/A
245
233254
jamba-1.5-large
AI21 Labs · Jamba Open
1228±14
1,440$2 / $8256K
246
233263
llama-3.1-nemotron-51b-instruct
Nvidia · Llama 3.1
1223±21
665N/AN/A
247
237254
Anthropic
claude-3-sonnet-20240229
Anthropic · Proprietary
1223±7
18,888$3 / $15200K
248
239257
amazon-nova-micro-v1.0
Amazon · Proprietary
1218±10
2,981$0.04 / $0.14128K
249
239256
gemini-1.5-flash-8b-001
Google · Proprietary
1218±8
6,069$0.07 / $0.301M
250
240262
gemma-2-27b-it
Google · Gemma license
1211±6
12,088$0.65 / $0.658.2K
251
235269
olmo-2-0325-32b-instruct
Ai2 · Apache-2.0
1211±27
427$0.05 / $0.20128K
252
240264
nemotron-4-340b-instruct
Nvidia · NVIDIA Open Model
1210±11
3,254N/AN/A
253
240264
gpt-4-0314
OpenAI · Proprietary
1209±9
8,306$30 / $608.2K
254
244264
Meta
llama-3-70b-instruct
Meta · Llama 3 Community
1207±7
28,126$0.51 / $0.748.2K
255
240268
ministral-8b-2410
Mistral · MRL
1202±19
838$0.10 / $0.10131.1K
256
249267
Anthropic
claude-3-haiku-20240307
Anthropic · Proprietary
1199±7
20,898$0.25 / $1.25200K
257
249268
Cohere
c4ai-aya-expanse-32b
Cohere · CC-BY-NC-4.0
1197±9
4,685N/AN/A
258
249268
qwen2-72b-instruct
Alibaba · Qianwen LICENSE
1196±9
6,249$0.90 / $0.9032.8K
259
250268
Meta
llama-3.1-8b-instruct
Meta · Llama 3.1 Community
1195±7
8,582$0.02 / $0.05131.1K
260
249274
gemma-2-9b-it-simpo
Princeton · MIT
1191±15
1,471$0.03 / $0.098.2K
261
249276
reka-flash-20240904
Reka AI · Proprietary
1190±15
1,207N/AN/A
262
254272
gpt-4-0613
OpenAI · Proprietary
1188±8
13,719$30 / $608.2K
263
251278
Cohere
command-r-plus-08-2024
Cohere · CC-BY-NC-4.0
1188±14
1,675$2.50 / $10128K
264
244282
granite-3.1-8b-instruct
IBM · Apache 2.0
1187±26
478N/AN/A
265
254278
qwen1.5-110b-chat
Alibaba · Qianwen LICENSE
1184±10
4,763N/AN/A
266
246283
llama-3.1-tulu-3-8b
Ai2 · Llama 3.1
1184±24
476N/AN/A
267
255276
mistral-large-2402
Mistral · Proprietary
1183±8
10,418$4 / $1232K
268
254282
jamba-1.5-mini
AI21 Labs · Jamba Open
1179±15
1,352$0.20 / $0.40256K
269
260280
gemma-2-9b-it
Google · Gemma license
1174±7
8,921$0.03 / $0.098.2K
270
260282
Cohere
command-r-plus
Cohere · CC-BY-NC-4.0
1172±8
13,937$2.50 / $10128K
271
259283
Cohere
command-r-08-2024
Cohere · CC-BY-NC-4.0
1170±13
1,783$0.15 / $0.60128K
272
260283
01.AI
yi-1.5-34b-chat
01 AI · Apache-2.0
1170±10
3,841N/AN/A
273
264283
mixtral-8x22b-instruct-v0.1
Mistral · Apache 2.0
1166±9
8,780$0.90 / $0.9065.5K
274
262283
qwen1.5-72b-chat
Alibaba · Qianwen LICENSE
1166±10
6,370N/AN/A
275
261284
reka-flash-21b-20240226-online
Reka AI · Proprietary
1165±13
2,879N/AN/A
276
266284
mistral-medium
Mistral · Proprietary
1163±10
5,149$2.70 / $8.1032K
277
262286
Cohere
c4ai-aya-expanse-8b
Cohere · CC-BY-NC-4.0
1161±14
1,567N/AN/A
278
266286
internlm2_5-20b-chat
InternLM · Other
1159±14
1,684$0 / $032.8K
279
261293
qwq-32b-preview
Alibaba · Apache 2.0
1156±24
566$0.50 / $116.4K
280
267287
qwen1.5-32b-chat
Alibaba · Qianwen LICENSE
1155±11
3,930N/AN/A
281
267287
reka-flash-21b-20240226
Reka AI · Proprietary
1154±11
4,748N/AN/A
282
270287
Meta
llama-3-8b-instruct
Meta · Llama 3 Community
1152±8
18,374$0.04 / $0.048.2K
283
264298
granite-3.1-2b-instruct
IBM · Apache 2.0
1150±25
508N/AN/A
284
275295
starling-lm-7b-beta
Nexusflow · Apache-2.0
1143±13
2,948N/AN/A
285
277297
qwen1.5-14b-chat
Alibaba · Qianwen LICENSE
1138±13
3,208$0.30 / $0.30N/A
286
279295
gpt-3.5-turbo-0125
OpenAI · Proprietary
1137±8
11,130$0.50 / $1.5016.4K
287
282298
dbrx-instruct-preview
Databricks · DBRX LICENSE
1132±11
5,502$0.60 / $0.6032.8K
288
282299
phi-3-medium-4k-instruct
Microsoft · MIT
1131±10
3,973$0.17 / $0.68N/A
289
277304
zephyr-orpo-141b-A35b-v0.1
HuggingFace · Apache 2.0
1130±21
831N/AN/A
290
282300
Cohere
command-r
Cohere · CC-BY-NC-4.0
1128±9
9,645$0.15 / $0.60128K
291
282300
mixtral-8x7b-instruct-v0.1
Mistral · Apache 2.0
1127±8
11,784$0.63 / $0.6332K
292
282311
tulu-2-dpo-70b
AllenAI/UW · AI2 ImpACT Low-risk
1117±21
805N/AN/A
293
282310
gpt-3.5-turbo-1106
OpenAI · Proprietary
1116±16
2,121$1 / $216.4K
294
285310
openchat-3.5-0106
OpenChat · Apache-2.0
1113±14
2,005N/AN/A
295
283311
granite-3.0-8b-instruct
IBM · Apache 2.0
1113±18
1,108N/AN/A
296
288306
gemma-2-2b-it
Google · Gemma license
1113±8
7,298N/AN/A
297
286310
01.AI
yi-34b-chat
01 AI · Yi License
1112±13
2,345$0.90 / $0.904.1K
298
283320
gemini-pro
Google · Proprietary
1108±23
678$0.35 / $1.0532.8K
299
285319
qwen1.5-7b-chat
Alibaba · Qianwen LICENSE
1108±20
772$0.20 / $0.20N/A
300
291317
gemini-pro-dev-api
Google · Proprietary
1104±14
2,681$0.35 / $1.0532.8K
301
291317
phi-3-small-8k-instruct
Microsoft · MIT
1102±12
3,219$0.15 / $0.60N/A
302
291320
Meta
llama-3.2-3b-instruct
Meta · Llama 3.2
1098±16
1,351$0.05 / $0.34131.1K
303
291320
starling-lm-7b-alpha
UC Berkeley · CC-BY-NC-4.0
1098±16
1,397N/AN/A
304
289323
deepseek-llm-67b-chat
DeepSeek · DeepSeek License
1096±24
649N/AN/A
305
292321
phi-3-mini-4k-instruct-june-2024
Microsoft · MIT
1094±14
1,841$0.13 / $0.524.1K
306
293320
phi-3-mini-4k-instruct
Microsoft · MIT
1093±12
3,449$0.13 / $0.52N/A
307
292323
granite-3.0-2b-instruct
IBM · Apache 2.0
1091±17
1,134N/AN/A
308
293321
snowflake-arctic-instruct
Snowflake · Apache 2.0
1090±11
5,734N/AN/A
309
298323
gemma-1.1-7b-it
Google · Gemma license
1084±10
4,332$0.03 / $0.098.2K
310
298323
mistral-7b-instruct-v0.2
Mistral · Apache-2.0
1082±12
3,114$0.20 / $0.2032.8K
311
293326
wizardlm-70b
Microsoft · Llama 2 Community
1082±20
988N/AN/A
312
293327
nous-hermes-2-mixtral-8x7b-dpo
NousResearch · Apache-2.0
1080±23
575$0.90 / $0.90N/A
313
300323
Meta
llama-2-70b-chat
Meta · Llama 2 Community
1079±10
5,717$0.70 / $2.804.1K
314
298324
vicuna-33b
LMSYS · Non-commercial
1079±13
2,866$0 / $02K
315
298327
openchat-3.5
OpenChat · Apache-2.0
1075±19
971$0.20 / $0.20N/A
316
296331
qwen-14b-chat
Alibaba · Qianwen LICENSE
1072±24
599N/AN/A
317
301327
Meta
llama-3.2-1b-instruct
Meta · Llama 3.2
1071±16
1,346$0.03 / $0.20131.1K
318
298331
solar-10.7b-instruct-v1.0
Upstage AI · CC-BY-NC-4.0
1067±27
482$0.30 / $0.30N/A
319
300331
openhermes-2.5-mistral-7b
NousResearch · Apache-2.0
1065±23
589$0.17 / $0.17N/A
320
307330
Meta
llama-2-13b-chat
Meta · Llama 2 Community
1063±13
2,626$0.25 / $0.254.1K
321
298340
zephyr-7b-alpha
HuggingFace · MIT
1053±40
201N/AN/A
322
313334
gemma-7b-it
Google · Gemma license
1049±16
1,381$0.05 / $0.088.2K
323
305339
smollm2-1.7b-instruct
HuggingFace · Apache 2.0
1048±32
352N/AN/A
324
312336
Meta
codellama-34b-instruct
Meta · Llama 2 Community
1046±20
853$0.35 / $1.4016.4K
325
313336
zephyr-7b-beta
HuggingFace · MIT
1045±18
1,250$0.15 / $0.1516.4K
326
317336
vicuna-13b
LMSYS · Llama 2 Community
1041±14
2,389$0.30 / $0.30N/A
327
317336
phi-3-mini-128k-instruct
Microsoft · MIT
1040±13
3,886$0.13 / $0.52N/A
328
307340
mpt-30b-chat
MosaicML · CC-BY-NC-SA-4.0
1040±35
258N/AN/A
329
314340
wizardlm-13b
Microsoft · Llama 2 Community
1035±22
735$0.30 / $0.30N/A
330
318337
gemma-1.1-2b-it
Google · Gemma license
1035±14
1,963N/AN/A
331
317340
llama2-70b-steerlm-chat
Nvidia · Llama 2 Community
1025±28
467N/AN/A
332
321340
mistral-7b-instruct
Mistral · Apache 2.0
1019±20
1,032$0.07 / $0.284.1K
333
321340
olmo-7b-instruct
Ai2 · Apache-2.0
1016±22
772$0.20 / $0.20N/A
334
321341
vicuna-7b
LMSYS · Llama 2 Community
1010±23
726$0.20 / $0.20N/A
335
322341
gemma-2b-it
Google · Gemma license
1010±22
742$0.10 / $0.10N/A
336
327341
Meta
llama-2-7b-chat
Meta · Llama 2 Community
1002±14
1,956$0.15 / $0.154.1K
337
326341
stripedhyena-nous-7b
Together AI · Apache 2.0
1002±22
704$0.20 / $0.20N/A
338
327341
qwen1.5-4b-chat
Alibaba · Qianwen LICENSE
999±17
1,283$0.10 / $0.10N/A
339
322342
guanaco-33b
UW · Non-commercial
996±35
263N/AN/A
340
328341
palm-2
Google · Proprietary
995±21
917$0.50 / $0.5025.8K
341
334345
chatglm3-6b
Tsinghua · Apache-2.0
965±26
535N/AN/A
342
340347
koala-13b
UC Berkeley · Non-commercial
945±24
747N/AN/A
343
341348
RWKV-4-Raven-14B
RWKV · Apache 2.0
928±27
505N/AN/A
344
341348
chatglm-6b
Tsinghua · Non-commercial
920±26
551N/AN/A
345
341348
mpt-7b-chat
MosaicML · CC-BY-NC-SA-4.0
914±31
397N/AN/A
346
342348
chatglm2-6b
Tsinghua · Apache-2.0
902±35
293N/AN/A
347
342348
oasst-pythia-12b
OpenAssistant · Apache 2.0
901±25
714N/AN/A
348
343348
Stability
stablelm-tuned-alpha-7b
Stability AI · CC-BY-NC-SA-4.0
886±32
363N/AN/A
349
349351
alpaca-13b
Stanford · Non-commercial
799±27
626N/AN/A
350
349351
dolly-v2-12b
Databricks · MIT
777±33
396N/AN/A
351
349351
fastchat-t5-3b
LMSYS · Apache 2.0
764±30
428N/AN/A
352
352352
Meta
llama-13b
Meta · Non-commercial
683±39
304$0.23 / $0.23N/A

Remove Style Control Leaderboard Plots

Battle Count for Each Combination of Models (without Ties)

Fraction of Model A Wins for All Non-tied A vs. B Battles

Average Win Rate Against All Other Models (Uniform Sampling and No Ties)

Confidence Intervals on Model Strength (via Bootstrapping)