Text Arena💻Coding

View overall rankings across various AI models in text-to-text tasks across math, coding, creative writing, and other open-ended domains.

Mar 31, 2026
1,015,744 votes
332 models
Rank Spread
1
13
Anthropic
claude-opus-4-6-thinking
Anthropic · Proprietary
1556±11
3,017$5 / $251M
2
17
Anthropic
claude-opus-4-6
Anthropic · Proprietary
1550±10
3,503$5 / $251M
3
216
gemini-3.1-pro-preview
Google · Proprietary
1534±10
4,057$2 / $121M
4
123
gpt-5.4-high
OpenAI · Proprietary
1533±15
1,596$2.50 / $151.1M
5
317
Anthropic
claude-opus-4-5-20251101-thinking-32k
Anthropic · Proprietary
1531±7
7,677$5 / $25200K
6
228
grok-4.20-beta1
xAI · Proprietary
1526±15
1,479N/AN/A
7
227
grok-4.20-beta-0309-reasoning
xAI · Proprietary
1525±14
1,698$2 / $62M
8
329
Anthropic
claude-sonnet-4-6
Anthropic · Proprietary
1522±12
2,554$3 / $151M
9
329
gpt-5.2-chat-latest-20260210
OpenAI · Proprietary
1520±11
3,010$1.75 / $14128K
10
325
Anthropic
claude-sonnet-4-5-20250929-thinking-32k
Anthropic · Proprietary
1519±6
12,392$3 / $15200K
11
325
gemini-3-pro
Google · Proprietary
1519±7
8,628$2 / $121M
12
331
grok-4.20-multi-agent-beta-0309
xAI · Proprietary
1519±13
1,882$2 / $62M
13
241
Bytedance
dola-seed-2.0-pro
Bytedance · Proprietary
1518±22
746N/AN/A
14
428
Anthropic
claude-opus-4-5-20251101
Anthropic · Proprietary
1518±7
9,572$5 / $25200K
15
530
Anthropic
claude-opus-4-1-20250805-thinking-16k
Anthropic · Proprietary
1513±7
9,892$15 / $75200K
16
341
longcat-flash-chat-2602-exp
Meituan · Proprietary
1512±19
945N/AN/A
17
537
gpt-5.3-chat-latest
OpenAI · Proprietary
1511±12
2,644$1.75 / $14128K
18
535
kimi-k2.5-thinking
Moonshot · Modified MIT
1511±9
4,014$0.60 / $3N/A
19
342
gpt-5.4-mini-high
OpenAI · Proprietary
1510±18
1,031$0.75 / $4.50400K
20
341
qwen3.5-max-preview
Alibaba · Proprietary
1510±15
1,404N/AN/A
21
633
Anthropic
claude-sonnet-4-5-20250929
Anthropic · Proprietary
1510±6
11,961$3 / $15200K
22
635
gemini-3-flash
Google · Proprietary
1510±8
6,423$0.50 / $31M
23
542
kimi-k2.5-instant
Moonshot · Modified MIT
1506±14
1,817$0.38 / $1.72262.1K
24
837
Anthropic
claude-opus-4-1-20250805
Anthropic · Proprietary
1506±6
15,619$15 / $75200K
25
542
gpt-5.4
OpenAI · Proprietary
1505±14
1,684$2.50 / $151.1M
26
543
mimo-v2-pro
Xiaomi · Proprietary
1503±15
1,500$1 / $31M
27
941
gemini-3-flash (thinking-minimal)
Google · Proprietary
1503±8
6,535$0.50 / $31M
28
1141
grok-4.1-thinking
xAI · Proprietary
1503±7
9,216N/AN/A
29
1443
Anthropic
claude-opus-4-20250514-thinking-16k
Anthropic · Proprietary
1498±8
6,717$15 / $75200K
30
1543
gpt-5.2
OpenAI · Proprietary
1497±8
5,350$1.75 / $14400K
31
1647
gpt-5.2-high
OpenAI · Proprietary
1495±8
6,035$1.75 / $14400K
32
859
gemma-4-31b
Google · Apache 2.0
1494±18
1,055$0.14 / $0.40262.1K
33
1847
grok-4.1
xAI · Proprietary
1494±7
10,188N/AN/A
34
1849
ernie-5.0-0110
Baidu · Proprietary
1492±9
4,554N/AN/A
35
2049
gpt-5.1-high
OpenAI · Proprietary
1491±7
8,270$1.25 / $10400K
36
1654
glm-5
Z.ai · MIT
1491±11
2,729$1 / $3.20202.8K
37
2056
qwen3.5-397b-a17b
Alibaba · Apache 2.0
1488±10
3,055$0.39 / $2.34262.1K
38
1571
gemma-4-26b-a4b
Google · Apache 2.0
1488±18
1,044N/AN/A
39
1374
amazon-nova-experimental-chat-26-02-10
Amazon · Proprietary
1488±20
854N/AN/A
40
2064
glm-4.7
Z.ai · MIT
1487±12
2,420$0.39 / $1.75202.8K
41
2554
kimi-k2-thinking-turbo
Moonshot · Modified MIT
1487±7
9,402$1.15 / $8262.1K
42
2865
qwen3-max-preview
Alibaba · Proprietary
1482±8
5,406$0.78 / $3.90262.1K
43
2088
amazon-nova-experimental-chat-26-01-10
Amazon · Proprietary
1478±21
745N/AN/A
44
3571
Anthropic
claude-haiku-4-5-20251001
Anthropic · Proprietary
1476±6
12,263$1 / $5200K
45
3179
longcat-flash-chat
Meituan · MIT
1476±13
2,241$0.20 / $0.80131.1K
46
3180
qwen3-max-2025-09-23
Alibaba · Proprietary
1475±13
2,056$0.78 / $3.90262.1K
47
3181
deepseek-v3.2-exp-thinking
DeepSeek · MIT
1475±13
1,938$0.27 / $0.41163.8K
48
3574
gpt-5.1
OpenAI · Proprietary
1474±7
9,183$1.25 / $10400K
49
3576
deepseek-v3.2-thinking
DeepSeek · MIT
1474±8
6,481$0.26 / $0.38163.8K
50
3577
Anthropic
claude-sonnet-4-20250514-thinking-32k
Anthropic · Proprietary
1473±8
6,460$3 / $151M
51
3384
ernie-5.0-preview-1203
Baidu · Proprietary
1472±13
1,972N/AN/A
52
3876
qwen3-235b-a22b-instruct-2507
Alibaba · Apache 2.0
1472±5
16,127$0.26 / $1.06N/A
53
4179
chatgpt-4o-latest-20250326
OpenAI · Proprietary
1469±5
15,956$5 / $15128K
54
31100
gpt-5.4-nano-high
OpenAI · Proprietary
1469±20
881$0.20 / $1.25400K
55
3981
mistral-large-3
Mistral · Apache 2.0
1468±7
7,691$0.50 / $1.50N/A
56
3982
deepseek-v3.2
DeepSeek · MIT
1468±7
8,155$0.26 / $0.38163.8K
57
3983
gpt-5-high
OpenAI · Proprietary
1468±8
6,417$1.25 / $10400K
58
3591
kimi-k2-0905-preview
Moonshot · Modified MIT
1467±13
2,257$0.60 / $2.50262.1K
59
4180
gemini-2.5-pro
Google · Proprietary
1467±5
20,886$1.25 / $101M
60
3888
minimax-m2.5
MiniMax · Modified MIT
1466±10
3,290$0.12 / $0.99196.6K
61
3796
qwen3-vl-235b-a22b-instruct
Alibaba · Apache 2.0
1466±13
2,347$0.20 / $0.88262.1K
62
3795
deepseek-v3.2-exp
DeepSeek · MIT
1466±12
2,514$0.27 / $0.41163.8K
63
3995
gemini-3.1-flash-lite-preview
Google · Proprietary
1465±11
3,075$0.25 / $1.501M
64
3996
deepseek-r1-0528
DeepSeek · MIT
1464±11
2,738$0.45 / $2.15163.8K
65
4188
Anthropic
claude-opus-4-20250514
Anthropic · Proprietary
1463±7
7,953$15 / $75200K
66
4193
gpt-5-chat
OpenAI · Proprietary
1463±8
6,032$1.25 / $10128K
67
4389
grok-4-1-fast-reasoning
xAI · Proprietary
1463±7
8,591$0.20 / $0.502M
68
33112
deepseek-v3.1-terminus-thinking
DeepSeek · MIT
1462±24
639$0.21 / $0.79163.8K
69
38105
minimax-m2.7
MiniMax · Proprietary
1461±17
1,188$0.30 / $1.20204.8K
70
4396
glm-4.6
Z.ai · MIT
1460±7
7,539$0.39 / $1.90204.8K
71
41103
gpt-4.5-preview-2025-02-27
OpenAI · Proprietary
1459±13
1,939$75 / $150128K
72
4599
kimi-k2-0711-preview
Moonshot · Modified MIT
1459±8
5,279$0.60 / $2.50131.1K
73
40109
grok-4-fast-chat
xAI · Proprietary
1458±16
1,254$3 / $15256K
74
4898
o3-2025-04-16
OpenAI · Proprietary
1458±6
11,824$2 / $8200K
75
41107
qwen3-vl-235b-a22b-thinking
Alibaba · Apache 2.0
1457±14
1,640$0.26 / $2.60131.1K
76
47102
qwen3-coder-480b-a35b-instruct
Alibaba · Apache 2.0
1457±9
4,888$0.40 / $1.60262.1K
77
43106
deepseek-v3.1-thinking
DeepSeek · MIT
1456±13
1,912$1.23 / $4.94N/A
78
5099
gpt-4.1-2025-04-14
OpenAI · Proprietary
1456±7
9,382$2 / $81M
79
48102
glm-4.5
Z.ai · MIT
1455±9
4,800$0.60 / $2.20131.1K
80
5599
mistral-medium-2508
Mistral · Proprietary
1455±5
15,574$2.70 / $8.1032K
81
57107
Anthropic
claude-3-7-sonnet-20250219-thinking-32k
Anthropic · Proprietary
1450±8
6,211$3 / $15200K
82
52114
qwen3.5-122b-a10b
Alibaba · Apache 2.0
1449±12
2,256$0.26 / $2.08262.1K
83
57111
Stepfun
step-3.5-flash
StepFun · Apache 2.0
1449±10
3,544$0.10 / $0.30262.1K
84
61111
Anthropic
claude-sonnet-4-20250514
Anthropic · Proprietary
1448±7
7,450$3 / $151M
85
57117
deepseek-v3.1
DeepSeek · MIT
1447±12
2,637$1.23 / $4.94N/A
86
62111
mimo-v2-flash (non-thinking)
Xiaomi · MIT
1447±8
6,206$0.09 / $0.29262.1K
87
65111
qwen3-235b-a22b-no-thinking
Alibaba · Apache 2.0
1446±8
7,003$0.46 / $1.82131.1K
88
63114
qwen3-next-80b-a3b-instruct
Alibaba · Apache 2.0
1446±9
4,841$0.09 / $1.10262.1K
89
60121
deepseek-r1
DeepSeek · MIT
1444±12
2,317$0.70 / $2.5064K
90
68117
grok-3-preview-02-24
xAI · Proprietary
1444±8
5,415$3 / $15131.1K
91
61122
trinity-large
Arcee AI · Apache 2.0
1443±12
2,378N/AN/A
92
61122
qwen3.5-35b-a3b
Alibaba · Apache 2.0
1443±12
2,338$0.16 / $1.30262.1K
93
63122
qwen3.5-flash
Alibaba · Proprietary
1443±12
2,525N/AN/A
94
57127
qwen3-235b-a22b-thinking-2507
Alibaba · Apache 2.0
1442±15
1,618$0.15 / $1.50131.1K
95
69125
minimax-m2.1-preview
MiniMax · MIT
1440±10
3,436$0.27 / $0.95196.6K
96
45139
Tencent
hunyuan-vision-1.5-thinking
Tencent · Proprietary
1440±27
437N/AN/A
97
73122
qwen3-30b-a3b-instruct-2507
Alibaba · Apache 2.0
1440±9
4,699$0.09 / $0.30262.1K
98
54138
amazon-nova-experimental-chat-12-10
Amazon · Proprietary
1439±21
702N/AN/A
99
56138
deepseek-v3.1-terminus
DeepSeek · MIT
1439±21
782$0.21 / $0.79163.8K
100
73125
grok-4-fast-reasoning
xAI · Proprietary
1438±9
3,995$0.20 / $0.502M
101
72129
qwen3.5-27b
Alibaba · Apache 2.0
1437±12
2,246$0.20 / $1.56262.1K
102
77125
grok-4-0709
xAI · Proprietary
1436±7
8,221$3 / $15256K
103
76132
o3-mini-high
OpenAI · Proprietary
1434±12
2,596$1.10 / $4.40200K
104
78129
qwen3-235b-a22b
Alibaba · Apache 2.0
1434±9
4,364$0.46 / $1.82131.1K
105
68138
ernie-5.0-preview-1022
Baidu · Proprietary
1433±19
927N/AN/A
106
81128
gpt-4.1-mini-2025-04-14
OpenAI · Proprietary
1433±7
6,950$0.40 / $1.601M
107
85127
Anthropic
claude-3-5-sonnet-20241022
Anthropic · Proprietary
1433±5
14,981$6 / $30200K
108
81129
mistral-medium-2505
Mistral · Proprietary
1433±8
5,924$0.40 / $2131.1K
109
76136
mimo-v2-flash (thinking)
Xiaomi · MIT
1433±12
2,448$0.09 / $0.29262.1K
110
80132
o1-2024-12-17
OpenAI · Proprietary
1432±10
3,973$15 / $60200K
111
86130
o4-mini-2025-04-16
OpenAI · Proprietary
1431±7
8,761$1.10 / $4.40200K
112
80136
mai-1-preview
Microsoft AI · Proprietary
1431±11
2,793N/AN/A
113
86136
gpt-5-mini-high
OpenAI · Proprietary
1429±9
5,539$0.25 / $2400K
114
88135
Anthropic
claude-3-7-sonnet-20250219
Anthropic · Proprietary
1429±7
7,168$3 / $15200K
115
88136
gemini-2.5-flash-preview-09-2025
Google · Proprietary
1428±8
6,889$0.30 / $2.501M
116
90136
deepseek-v3-0324
DeepSeek · MIT
1428±7
8,424$3 / $4.5032.8K
117
90137
glm-4.5-air
Z.ai · MIT
1427±8
6,164$0.13 / $0.85131.1K
118
95136
gemini-2.5-flash
Google · Proprietary
1425±5
20,257$0.30 / $2.501M
119
88138
glm-4.7-flash
Z.ai · MIT
1425±11
2,710$0.06 / $0.40202.8K
120
95138
amazon-nova-experimental-chat-11-10
Amazon · Proprietary
1422±8
5,365N/AN/A
121
90140
qwen3-next-80b-a3b-thinking
Alibaba · Apache 2.0
1421±11
2,710$0.10 / $0.78131.1K
122
75158
glm-4.6v
Z.ai · MIT
1421±25
537$0.30 / $0.90131.1K
123
101142
o1-preview
OpenAI · Proprietary
1416±9
5,123$15 / $60N/A
124
105142
minimax-m1
MiniMax · Apache 2.0
1416±8
6,537$0.40 / $2.201M
125
107141
o3-mini
OpenAI · Proprietary
1416±6
9,490$1.10 / $4.40200K
126
107145
mistral-small-2506
Mistral · Apache 2.0
1413±10
3,380$0.10 / $0.3032K
127
100150
ling-flash-2.0
Ant Group · MIT
1412±15
1,544N/AN/A
128
104148
amazon-nova-experimental-chat-10-20
Amazon · Proprietary
1412±12
2,307N/AN/A
129
91162
nvidia-nemotron-3-super-120b-a12b
Nvidia · NVIDIA Open Model
1412±20
865N/AN/A
130
98166
intellect-3
Prime Intellect · MIT
1410±19
976$0.20 / $1.10131.1K
131
90168
qwen3-32b
Alibaba · Apache 2.0
1408±24
513$0.08 / $0.2441K
132
105166
Stepfun
step-3
StepFun · Apache 2.0
1408±17
1,239$0.57 / $1.4265.5K
133
98167
nvidia-llama-3.3-nemotron-super-49b-v1.5
Nvidia · Nvidia Open
1406±22
662$0.10 / $0.40131.1K
134
107167
glm-4.5v
Z.ai · MIT
1404±18
993$0.60 / $1.8065.5K
135
121159
qwen2.5-max
Alibaba · Proprietary
1403±8
5,115N/AN/A
136
114170
Tencent
hunyuan-t1-20250711
Tencent · Proprietary
1400±20
811N/AN/A
137
95182
Tencent
hunyuan-turbos-20250226
Tencent · Proprietary
1400±31
275N/AN/A
138
125165
gemini-2.5-flash-lite-preview-09-2025-no-thinking
Google · Proprietary
1398±7
9,750$0.10 / $0.401M
139
122167
nova-2-lite
Amazon · Proprietary
1397±12
2,527$0.30 / $2.501M
140
115174
mercury-2
Inception AI · Proprietary
1397±21
770$0.25 / $0.75128K
141
125167
Anthropic
claude-3-5-sonnet-20240620
Anthropic · Proprietary
1396±7
13,607$6 / $30200K
142
123170
Tencent
hunyuan-turbos-20250416
Tencent · Proprietary
1395±14
1,784N/AN/A
143
125174
ring-flash-2.0
Ant Group · MIT
1392±15
1,554N/AN/A
144
108190
llama-3.1-nemotron-ultra-253b-v1
Nvidia · Nvidia Open Model
1391±30
367$0.60 / $1.80131.1K
145
127168
gpt-oss-120b
OpenAI · Apache 2.0
1391±8
6,543$0.04 / $0.19131.1K
146
126170
grok-3-mini-high
xAI · Proprietary
1390±10
3,313$0.30 / $0.50131.1K
147
128168
Cohere
command-a-03-2025
Cohere · CC-BY-NC-4.0
1390±6
10,294$2.50 / $10256K
148
120186
amazon-nova-experimental-chat-10-09
Amazon · Proprietary
1389±24
555N/AN/A
149
129170
o1-mini
OpenAI · Proprietary
1388±7
8,478$1.10 / $4.40N/A
150
128174
deepseek-v3
DeepSeek · DeepSeek
1387±10
3,280$1.14 / $4.56N/A
151
128172
grok-3-mini-beta
xAI · Proprietary
1387±9
4,267$0.30 / $0.50131.1K
152
128172
qwen3-30b-a3b
Alibaba · Apache 2.0
1387±9
4,551$0.08 / $0.2841K
153
128178
magistral-medium-2506
Mistral · Proprietary
1385±12
2,263$2 / $540K
154
130174
qwq-32b
Alibaba · Apache 2.0
1385±9
4,059$0.15 / $0.58131.1K
155
126181
minimax-m2
MiniMax · Apache 2.0
1385±15
1,561$0.26 / $1196.6K
156
128178
olmo-3.1-32b-instruct
Ai2 · Apache 2.0
1385±12
2,530$0.20 / $0.6065.5K
157
131175
gemini-2.5-flash-lite-preview-06-17-thinking
Google · Proprietary
1384±8
6,039$0.10 / $0.401M
158
134173
Anthropic
claude-3-5-haiku-20241022
Anthropic · Proprietary
1383±6
11,269$0.80 / $4200K
159
128184
gpt-5-nano-high
OpenAI · Proprietary
1382±15
1,692$0.05 / $0.40400K
160
127189
qwen-plus-0125
Alibaba · Proprietary
1380±18
893$0.40 / $1.20131.1K
161
132194
deepseek-v2.5-1210
DeepSeek · DeepSeek
1374±17
1,079N/AN/A
162
141184
Meta
llama-3.1-405b-instruct-bf16
Meta · Llama 3.1 Community
1374±7
6,249$4 / $432.8K
163
130197
gpt-4.1-nano-2025-04-14
OpenAI · Proprietary
1374±19
807$0.10 / $0.401M
164
145186
Meta
llama-4-maverick-17b-128e-instruct
Meta · Llama 4
1373±7
7,024$0.63 / $1.80131.1K
165
126210
Tencent
hunyuan-turbo-0110
Tencent · Proprietary
1372±30
299N/AN/A
166
131202
Stepfun
step-2-16k-exp-202412
StepFun · Proprietary
1371±20
737N/AN/A
167
141194
gpt-oss-20b
OpenAI · Apache 2.0
1369±13
2,173$0.03 / $0.11131.1K
168
147193
athene-v2-chat
NexusFlow · NexusFlow
1369±9
4,019N/AN/A
169
145193
01.AI
yi-lightning
01 AI · Proprietary
1369±10
4,316N/AN/A
170
153189
gpt-4o-2024-05-13
OpenAI · Proprietary
1368±6
19,526$5 / $15128K
171
148193
deepseek-v2.5
DeepSeek · DeepSeek
1368±9
4,252N/AN/A
172
128212
mercury
Inception AI · Proprietary
1367±28
399$0.25 / $0.75128K
173
153193
Meta
llama-3.1-405b-instruct-fp8
Meta · Llama 3.1 Community
1367±7
9,714$4 / $432.8K
174
131210
Tencent
hunyuan-large-2025-02-10
Tencent · Proprietary
1367±25
519N/AN/A
175
138205
olmo-3-32b-think
Ai2 · Apache 2.0
1366±18
1,061$0.15 / $0.5065.5K
176
155194
gemini-2.0-flash-001
Google · Proprietary
1365±7
7,020$0.10 / $0.401M
177
153197
nvidia-nemotron-3-nano-30b-a3b-bf16
Nvidia · NVIDIA Open Model
1365±11
3,297$0.06 / $0.24262.1K
178
130215
llama-3.3-nemotron-49b-super-v1
Nvidia · Nvidia
1363±31
286N/AN/A
179
155200
Meta
llama-4-scout-17b-16e-instruct
Meta · Llama
1362±9
5,284$0.40 / $0.708.2K
180
156199
mistral-small-3.1-24b-instruct-2503
Mistral · Apache 2.0
1361±8
6,176$0.10 / $0.3032K
181
157202
gpt-4o-2024-08-06
OpenAI · Proprietary
1360±8
7,318$2.50 / $10128K
182
159202
grok-2-2024-08-13
xAI · Proprietary
1358±7
10,368$2 / $10131.1K
183
159202
gemma-3-27b-it
Google · Gemma
1358±7
8,126$0.08 / $0.16131.1K
184
152212
Tencent
hunyuan-large-vision
Tencent · Proprietary
1357±19
969N/AN/A
185
155209
qwen2.5-plus-1127
Alibaba · Proprietary
1357±14
1,553N/AN/A
186
161204
gemini-1.5-pro-002
Google · Proprietary
1356±7
9,175$3.50 / $10.502.1M
187
161205
qwen2.5-72b-instruct
Alibaba · Qwen
1355±8
6,688$1.20 / $1.20N/A
188
157212
Stepfun
step-1o-turbo-202506
StepFun · Proprietary
1353±15
1,520N/AN/A
189
164207
mistral-large-2407
Mistral · Mistral Research
1353±8
7,589$2 / $6131.1K
190
168205
Anthropic
claude-3-opus-20240229
Anthropic · Proprietary
1352±6
33,748$15 / $75200K
191
161210
qwen-max-0919
Alibaba · Qwen
1352±11
2,756$1.60 / $6.4032.8K
192
162209
glm-4-plus
Zhipu AI · Proprietary
1352±9
4,449$0.44 / $1.76204.8K
193
164212
athene-70b-0725
NexusFlow · CC-BY-NC-4.0
1350±11
3,122N/AN/A
194
171210
gpt-4o-mini-2024-07-18
OpenAI · Proprietary
1349±6
10,929$0.15 / $0.60128K
195
173212
gemini-1.5-pro-001
Google · Proprietary
1347±8
12,747$3.50 / $10.502.1M
196
174212
gpt-4-turbo-2024-04-09
OpenAI · Proprietary
1346±7
17,104$10 / $30128K
197
173213
mistral-large-2411
Mistral · MRL
1345±9
4,212$2 / $6131.1K
198
179212
Meta
llama-3.3-70b-instruct
Meta · Llama-3.3
1344±6
8,765$0.10 / $0.32131.1K
199
175214
gemini-2.0-flash-lite-preview-02-05
Google · Proprietary
1343±10
3,474$0.07 / $0.301M
200
179214
amazon-nova-pro-v1.0
Amazon · Proprietary
1342±9
3,853$0.80 / $3.20300K
201
164222
qwen2.5-coder-32b-instruct
Alibaba · Apache 2.0
1342±19
873$0.87 / $0.8732K
202
175217
deepseek-coder-v2
DeepSeek · DeepSeek License
1341±12
2,671$0.14 / $0.28128K
203
171219
olmo-3.1-32b-think
Ai2 · Apache 2.0
1340±15
1,575$0.15 / $0.5065.5K
204
183216
gpt-4-1106-preview
OpenAI · Proprietary
1338±7
15,605$10 / $30128K
205
183217
gemini-advanced-0514
Google · Proprietary
1337±9
8,138N/AN/A
206
186217
grok-2-mini-2024-08-13
xAI · Proprietary
1335±7
8,652$2 / $10131.1K
207
190218
Meta
llama-3.1-70b-instruct
Meta · Llama 3.1 Community
1332±7
9,389$0.40 / $0.40131.1K
208
171232
Tencent
hunyuan-standard-2025-02-10
Tencent · Proprietary
1332±24
549N/AN/A
209
180229
glm-4-plus-0111
Zhipu · Proprietary
1331±18
894N/AN/A
210
197222
gpt-4-0125-preview
OpenAI · Proprietary
1330±8
15,289$10 / $30128K
211
184229
llama-3.1-nemotron-70b-instruct
Nvidia · Llama 3.1
1329±15
1,312$1.20 / $1.20131.1K
212
184232
ibm-granite-h-small
IBM · Apache 2.0
1327±17
1,278N/AN/A
213
198226
gpt-4-0314
OpenAI · Proprietary
1327±9
8,306$30 / $608.2K
214
190240
gemma-3-12b-it
Google · Gemma
1317±23
543$0.04 / $0.13131.1K
215
207232
gemini-1.5-flash-002
Google · Proprietary
1316±8
5,892$0.07 / $0.301M
216
207232
Anthropic
claude-3-sonnet-20240229
Anthropic · Proprietary
1316±7
18,888$3 / $15200K
217
202238
reka-core-20240904
Reka AI · Proprietary
1314±15
1,216N/AN/A
218
207238
mistral-small-24b-instruct-2501
Mistral · Apache 2.0
1312±12
2,083$0.05 / $0.0832.8K
219
209236
gpt-4-0613
OpenAI · Proprietary
1311±8
13,719$30 / $608.2K
220
205240
jamba-1.5-large
AI21 Labs · Jamba Open
1311±15
1,440$2 / $8256K
221
200243
llama-3.1-nemotron-51b-instruct
Nvidia · Llama 3.1
1310±22
665N/AN/A
222
210236
gemini-1.5-flash-001
Google · Proprietary
1309±8
10,680$0.07 / $0.301M
223
209238
gemma-3n-e4b-it
Google · Gemma
1309±10
3,542$0.02 / $0.0432.8K
224
209240
glm-4-0520
Zhipu AI · Proprietary
1307±14
1,718N/AN/A
225
201247
llama-3.1-tulu-3-70b
Ai2 · Llama 3.1
1307±24
450N/AN/A
226
209240
nemotron-4-340b-instruct
Nvidia · NVIDIA Open Model
1306±11
3,254N/AN/A
227
210240
phi-4
Microsoft · MIT
1306±10
3,305$0.07 / $0.1416.4K
228
210240
amazon-nova-lite-v1.0
Amazon · Proprietary
1305±10
3,060$0.06 / $0.24300K
229
212239
gemma-2-27b-it
Google · Gemma license
1305±6
12,088$0.65 / $0.658.2K
230
212240
Meta
llama-3-70b-instruct
Meta · Llama 3 Community
1304±7
28,126$0.51 / $0.748.2K
231
206254
Tencent
hunyuan-standard-256k
Tencent · Proprietary
1300±25
497N/AN/A
232
216243
Anthropic
claude-3-haiku-20240307
Anthropic · Proprietary
1299±7
20,898$0.25 / $1.25200K
233
216246
qwen2-72b-instruct
Alibaba · Qianwen LICENSE
1295±9
6,249$0.90 / $0.9032.8K
234
218246
mistral-large-2402
Mistral · Proprietary
1293±9
10,418$4 / $1232K
235
218247
Cohere
c4ai-aya-expanse-32b
Cohere · CC-BY-NC-4.0
1291±9
4,685N/AN/A
236
216256
reka-flash-20240904
Reka AI · Proprietary
1289±15
1,207N/AN/A
237
222254
amazon-nova-micro-v1.0
Amazon · Proprietary
1287±10
2,981$0.04 / $0.14128K
238
212264
granite-3.1-8b-instruct
IBM · Apache 2.0
1286±26
478N/AN/A
239
229262
Cohere
command-r-08-2024
Cohere · CC-BY-NC-4.0
1279±13
1,783$0.15 / $0.60128K
240
216268
olmo-2-0325-32b-instruct
Ai2 · Apache-2.0
1279±27
427$0.05 / $0.20128K
241
229262
Cohere
command-r-plus-08-2024
Cohere · CC-BY-NC-4.0
1278±14
1,675$2.50 / $10128K
242
231261
qwen1.5-110b-chat
Alibaba · Qianwen LICENSE
1278±10
4,763N/AN/A
243
231263
reka-flash-21b-20240226-online
Reka AI · Proprietary
1275±13
2,879N/AN/A
244
221269
gemma-3-4b-it
Google · Gemma
1275±24
605$0.04 / $0.08131.1K
245
233262
mixtral-8x22b-instruct-v0.1
Mistral · Apache 2.0
1275±9
8,780$0.90 / $0.9065.5K
246
229268
ministral-8b-2410
Mistral · MRL
1274±19
838$0.10 / $0.10131.1K
247
235263
qwen1.5-72b-chat
Alibaba · Qianwen LICENSE
1273±10
6,370N/AN/A
248
235262
gemini-1.5-flash-8b-001
Google · Proprietary
1272±8
6,069$0.07 / $0.301M
249
235262
gpt-3.5-turbo-0125
OpenAI · Proprietary
1272±8
11,130$0.50 / $1.5016.4K
250
231267
gemma-2-9b-it-simpo
Princeton · MIT
1272±15
1,471$0.03 / $0.098.2K
251
235262
gemma-2-9b-it
Google · Gemma license
1270±7
8,921$0.03 / $0.098.2K
252
235263
Cohere
command-r-plus
Cohere · CC-BY-NC-4.0
1270±8
13,937$2.50 / $10128K
253
235271
jamba-1.5-mini
AI21 Labs · Jamba Open
1264±15
1,352$0.20 / $0.40256K
254
237268
reka-flash-21b-20240226
Reka AI · Proprietary
1264±11
4,748N/AN/A
255
238271
mistral-medium
Mistral · Proprietary
1260±10
5,149$2.70 / $8.1032K
256
238271
qwen1.5-32b-chat
Alibaba · Qianwen LICENSE
1259±11
3,930N/AN/A
257
237273
gpt-3.5-turbo-1106
OpenAI · Proprietary
1259±16
2,121$1 / $216.4K
258
239268
Meta
llama-3.1-8b-instruct
Meta · Llama 3.1 Community
1259±7
8,582$0.02 / $0.0516.4K
259
238274
Cohere
c4ai-aya-expanse-8b
Cohere · CC-BY-NC-4.0
1255±15
1,567N/AN/A
260
235279
llama-3.1-tulu-3-8b
Ai2 · Llama 3.1
1253±25
476N/AN/A
261
249273
Meta
llama-3-8b-instruct
Meta · Llama 3 Community
1251±8
18,374$0.03 / $0.048.2K
262
249276
dbrx-instruct-preview
Databricks · DBRX LICENSE
1248±11
5,502$0.60 / $0.6032.8K
263
238281
granite-3.1-2b-instruct
IBM · Apache 2.0
1247±25
508N/AN/A
264
248278
internlm2_5-20b-chat
InternLM · Other
1246±14
1,684$0 / $032.8K
265
249276
01.AI
yi-1.5-34b-chat
01 AI · Apache-2.0
1246±10
3,841N/AN/A
266
238281
gemini-pro
Google · Proprietary
1246±24
678$0.35 / $1.0532.8K
267
245281
zephyr-orpo-141b-A35b-v0.1
HuggingFace · Apache 2.0
1242±21
831N/AN/A
268
255278
Cohere
command-r
Cohere · CC-BY-NC-4.0
1241±9
9,645$0.15 / $0.60128K
269
250282
granite-3.0-8b-instruct
IBM · Apache 2.0
1238±18
1,108N/AN/A
270
254281
gemini-pro-dev-api
Google · Proprietary
1237±14
2,681$0.35 / $1.0532.8K
271
255281
qwen1.5-14b-chat
Alibaba · Qianwen LICENSE
1237±13
3,208$0.30 / $0.30N/A
272
258278
mixtral-8x7b-instruct-v0.1
Mistral · Apache 2.0
1237±8
11,784$0.63 / $0.6332K
273
258282
starling-lm-7b-beta
Nexusflow · Apache-2.0
1233±13
2,948N/AN/A
274
261283
phi-3-medium-4k-instruct
Microsoft · MIT
1229±10
3,973$0.17 / $0.68N/A
275
260286
openchat-3.5-0106
OpenChat · Apache-2.0
1227±14
2,005N/AN/A
276
263286
snowflake-arctic-instruct
Snowflake · Apache 2.0
1222±11
5,734N/AN/A
277
267290
gemma-1.1-7b-it
Google · Gemma license
1216±10
4,332$0.03 / $0.098.2K
278
261298
deepseek-llm-67b-chat
DeepSeek · DeepSeek License
1215±24
649N/AN/A
279
263299
tulu-2-dpo-70b
AllenAI/UW · AI2 ImpACT Low-risk
1212±21
805N/AN/A
280
266300
qwen1.5-7b-chat
Alibaba · Qianwen LICENSE
1207±21
772$0.20 / $0.20N/A
281
267300
granite-3.0-2b-instruct
IBM · Apache 2.0
1207±18
1,134N/AN/A
282
272300
starling-lm-7b-alpha
UC Berkeley · CC-BY-NC-4.0
1205±16
1,397N/AN/A
283
275300
01.AI
yi-34b-chat
01 AI · Yi License
1203±13
2,345$0.90 / $0.904.1K
284
275299
phi-3-small-8k-instruct
Microsoft · MIT
1202±12
3,219$0.15 / $0.60N/A
285
274303
openchat-3.5
OpenChat · Apache-2.0
1199±20
971$0.20 / $0.20N/A
286
275308
qwen-14b-chat
Alibaba · Qianwen LICENSE
1194±24
599N/AN/A
287
277303
phi-3-mini-4k-instruct-june-2024
Microsoft · MIT
1194±14
1,841$0.13 / $0.524.1K
288
278301
gemma-2-2b-it
Google · Gemma license
1193±8
7,298N/AN/A
289
278303
vicuna-33b
LMSYS · Non-commercial
1191±13
2,866$0 / $02K
290
277308
wizardlm-70b
Microsoft · Llama 2 Community
1190±20
988N/AN/A
291
278305
phi-3-mini-4k-instruct
Microsoft · MIT
1185±12
3,449$0.13 / $0.52N/A
292
277313
openhermes-2.5-mistral-7b
NousResearch · Apache-2.0
1184±23
589$0.17 / $0.17N/A
293
278306
mistral-7b-instruct-v0.2
Mistral · Apache-2.0
1183±12
3,114$0.20 / $0.2032.8K
294
277314
solar-10.7b-instruct-v1.0
Upstage AI · CC-BY-NC-4.0
1181±27
482$0.30 / $0.30N/A
295
285310
Meta
llama-2-70b-chat
Meta · Llama 2 Community
1176±10
5,717$0.70 / $2.804.1K
296
279313
Meta
llama-3.2-3b-instruct
Meta · Llama 3.2
1174±16
1,351$0.05 / $0.3480K
297
278315
nous-hermes-2-mixtral-8x7b-dpo
NousResearch · Apache-2.0
1173±24
575$0.90 / $0.90N/A
298
278315
qwq-32b-preview
Alibaba · Apache 2.0
1173±24
566$0.15 / $0.58131.1K
299
286314
gemma-1.1-2b-it
Google · Gemma license
1170±14
1,963N/AN/A
300
286315
gemma-7b-it
Google · Gemma license
1166±17
1,381$0.05 / $0.088.2K
301
278318
mpt-30b-chat
MosaicML · CC-BY-NC-SA-4.0
1165±35
258N/AN/A
302
278319
zephyr-7b-alpha
HuggingFace · MIT
1164±40
201N/AN/A
303
289317
vicuna-13b
LMSYS · Llama 2 Community
1160±14
2,389$0.30 / $0.30N/A
304
290316
Meta
llama-2-13b-chat
Meta · Llama 2 Community
1160±13
2,626$0.25 / $0.254.1K
305
281319
smollm2-1.7b-instruct
HuggingFace · Apache 2.0
1157±33
352N/AN/A
306
289318
Meta
codellama-34b-instruct
Meta · Llama 2 Community
1156±20
853$0.35 / $1.4016.4K
307
294318
phi-3-mini-128k-instruct
Microsoft · MIT
1152±13
3,886$0.13 / $0.52N/A
308
291318
palm-2
Google · Proprietary
1150±21
917$0.50 / $0.5025.8K
309
293318
zephyr-7b-beta
HuggingFace · MIT
1150±18
1,250$0.15 / $0.1516.4K
310
291318
wizardlm-13b
Microsoft · Llama 2 Community
1149±22
735$0.30 / $0.30N/A
311
294318
Meta
llama-3.2-1b-instruct
Meta · Llama 3.2
1147±16
1,346$0.03 / $0.2060K
312
293319
llama2-70b-steerlm-chat
Nvidia · Llama 2 Community
1143±28
467N/AN/A
313
294319
mistral-7b-instruct
Mistral · Apache 2.0
1141±20
1,032$0.07 / $0.284.1K
314
296321
gemma-2b-it
Google · Gemma license
1135±22
742$0.10 / $0.10N/A
315
298321
vicuna-7b
LMSYS · Llama 2 Community
1129±23
726$0.20 / $0.20N/A
316
303321
qwen1.5-4b-chat
Alibaba · Qianwen LICENSE
1128±17
1,283$0.10 / $0.10N/A
317
302321
stripedhyena-nous-7b
Together AI · Apache 2.0
1124±22
704$0.20 / $0.20N/A
318
301324
guanaco-33b
UW · Non-commercial
1111±36
263N/AN/A
319
310324
olmo-7b-instruct
Ai2 · Apache-2.0
1104±22
772$0.20 / $0.20N/A
320
314323
Meta
llama-2-7b-chat
Meta · Llama 2 Community
1100±14
1,956$0.15 / $0.154.1K
321
314326
chatglm3-6b
Tsinghua · Apache-2.0
1087±26
535N/AN/A
322
318327
koala-13b
UC Berkeley · Non-commercial
1063±24
747N/AN/A
323
318328
mpt-7b-chat
MosaicML · CC-BY-NC-SA-4.0
1063±32
397N/AN/A
324
319328
RWKV-4-Raven-14B
RWKV · Apache 2.0
1056±27
505N/AN/A
325
321329
oasst-pythia-12b
OpenAssistant · Apache 2.0
1047±25
714N/AN/A
326
322329
chatglm-6b
Tsinghua · Non-commercial
1033±27
551N/AN/A
327
321330
chatglm2-6b
Tsinghua · Apache-2.0
1028±35
293N/AN/A
328
323330
Stability
stablelm-tuned-alpha-7b
Stability AI · CC-BY-NC-SA-4.0
1002±33
363N/AN/A
329
325330
alpaca-13b
Stanford · Non-commercial
996±27
626N/AN/A
330
327331
dolly-v2-12b
Databricks · MIT
959±34
396N/AN/A
331
330332
fastchat-t5-3b
LMSYS · Apache 2.0
905±31
428N/AN/A
332
331332
Meta
llama-13b
Meta · Non-commercial
880±40
304$0.23 / $0.23N/A

Default Leaderboard Plots

Average Win Rate Against All Other Models (Uniform Sampling and No Ties)

Confidence Intervals on Model Strength (via Bootstrapping)

Battle Count for Each Combination of Models (without Ties)

Fraction of Model A Wins for All Non-tied A vs. B Battles