Text Arena💻Coding

View overall rankings across various AI models in text-to-text tasks across math, coding, creative writing, and other open-ended domains.

May 28, 2026
1,250,323 votes
355 models
Rank Spread
1
14
Anthropic
claude-opus-4-7-thinking
Anthropic · Proprietary
1555±9
5,578$5 / $251M
2
14
Anthropic
claude-opus-4-6-thinking
Anthropic · Proprietary
1551±7
8,335$5 / $251M
3
15
Anthropic
claude-opus-4-6
Anthropic · Proprietary
1546±7
9,596$5 / $251M
4
15
Anthropic
claude-opus-4-7
Anthropic · Proprietary
1546±9
5,903$5 / $251M
5
520
Anthropic
claude-opus-4-5-20251101-thinking-32k
Anthropic · Proprietary
1530±7
7,628$5 / $25200K
6
532
glm-5.1
Z.ai · MIT
1527±10
3,756$1.40 / $4.40202.8K
7
533
Meta
muse-spark
Meta · Proprietary
1526±11
3,260N/AN/A
8
340
qwen3.7-max-preview
Alibaba · Proprietary
1525±18
1,137$1.25 / $3.751M
9
529
gemini-3.1-pro-preview
Google · Proprietary
1525±7
11,296$2 / $121M
10
534
gpt-5.5-high
OpenAI · Proprietary
1522±10
4,494$5 / $301.1M
11
533
Anthropic
claude-sonnet-4-6
Anthropic · Proprietary
1522±8
7,216$3 / $151M
12
534
gpt-5.4-high
OpenAI · Proprietary
1521±8
7,181$2.50 / $151.1M
13
533
Anthropic
claude-opus-4-5-20251101
Anthropic · Proprietary
1521±6
15,711$5 / $25200K
14
533
Anthropic
claude-sonnet-4-5-20250929-thinking-32k
Anthropic · Proprietary
1520±5
17,763$3 / $15200K
15
538
mimo-v2.5-pro
Xiaomi · MIT
1520±10
4,275$0.43 / $0.871M
16
534
gemini-3-pro
Google · Proprietary
1519±7
8,575$2 / $121M
17
537
gpt-5.2-chat-latest-20260210
OpenAI · Proprietary
1518±7
8,304$1.75 / $14128K
18
542
ernie-5.1
Baidu · Proprietary
1515±10
3,943N/AN/A
19
639
Anthropic
claude-sonnet-4-5-20250929
Anthropic · Proprietary
1515±5
17,609$3 / $15200K
20
541
gpt-5.5-instant
OpenAI · Proprietary
1515±8
7,212$5 / $301.1M
21
640
grok-4.20-multi-agent-beta-0309
xAI · Proprietary
1515±7
7,631$2 / $62M
22
642
qwen3.5-max-preview
Alibaba · Proprietary
1514±8
5,491N/AN/A
23
543
kimi-k2.6
Moonshot · Modified MIT
1514±10
4,237$0.95 / $4262.1K
24
642
gpt-5.4
OpenAI · Proprietary
1513±8
7,884$2.50 / $151.1M
25
641
Anthropic
claude-opus-4-1-20250805-thinking-16k
Anthropic · Proprietary
1513±7
9,848$15 / $75200K
26
642
grok-4.20-beta-0309-reasoning
xAI · Proprietary
1512±8
7,705$2 / $62M
27
744
Bytedance
dola-seed-2.0-pro
Bytedance · Proprietary
1511±7
10,045N/AN/A
28
747
grok-4.20-beta1
xAI · Proprietary
1509±8
6,203N/AN/A
29
847
gemini-3-flash
Google · Proprietary
1509±8
6,383$0.50 / $31M
30
753
gpt-5.5
OpenAI · Proprietary
1508±9
4,672$5 / $301.1M
31
658
gemini-3.5-flash
Google · Proprietary
1506±12
2,592$1.50 / $91M
32
660
qwen3.6-max-preview
Alibaba · Proprietary
1506±16
1,327$1.04 / $6.24262.1K
33
659
kimi-k2.5-instant
Moonshot · Modified MIT
1505±14
1,803$0.40 / $1.90262.1K
34
1551
Anthropic
claude-opus-4-1-20250805
Anthropic · Proprietary
1505±5
15,538$15 / $75200K
35
1656
kimi-k2.5-thinking
Moonshot · Modified MIT
1503±7
9,469$0.60 / $3N/A
36
1558
mimo-v2-pro
Xiaomi · Proprietary
1503±8
6,196$1 / $31M
37
1558
longcat-flash-chat-2602-exp
Meituan · Proprietary
1503±8
6,475N/AN/A
38
1759
deepseek-v4-pro
DeepSeek · MIT
1500±9
4,940$0.43 / $0.871M
39
2658
grok-4.1-thinking
xAI · Proprietary
1499±6
14,270N/AN/A
40
2059
gpt-5.4-mini-high
OpenAI · Proprietary
1499±8
6,903$0.75 / $4.50400K
41
1271
gemma-4-31b
Google · Apache 2.0
1498±15
1,355$0.14 / $0.40262.1K
42
2259
Anthropic
claude-opus-4-20250514-thinking-16k
Anthropic · Proprietary
1498±8
6,674$15 / $75200K
43
2760
gpt-5.3-chat-latest
OpenAI · Proprietary
1497±8
7,910$1.75 / $14128K
44
3061
gemini-3-flash (thinking-minimal)
Google · Proprietary
1495±6
12,797$0.50 / $31M
45
2867
glm-5
Z.ai · MIT
1495±8
5,384$1 / $3.20202.8K
46
2870
deepseek-v4-pro-thinking
DeepSeek · MIT
1494±9
4,535$0.43 / $0.871M
47
3067
qwen3.5-397b-a17b
Alibaba · Apache 2.0
1493±7
8,580$0.39 / $2.34262.1K
48
2870
grok-4.3
xAI · Proprietary
1493±9
4,422$1.25 / $2.501M
49
3167
ernie-5.0-0110
Baidu · Proprietary
1492±7
8,166N/AN/A
50
3070
qwen3.6-plus
Alibaba · Proprietary
1492±9
5,403$0.33 / $1.951M
51
3268
gpt-5.2-high
OpenAI · Proprietary
1491±6
11,036$1.75 / $14400K
52
3369
grok-4.1
xAI · Proprietary
1490±6
14,818N/AN/A
53
3270
gpt-5.1-high
OpenAI · Proprietary
1490±7
8,210$1.25 / $10400K
54
3174
mimo-v2.5
Xiaomi · MIT
1490±9
4,584$0.14 / $0.281M
55
1894
amazon-nova-experimental-chat-26-02-10
Amazon · Proprietary
1488±20
841N/AN/A
56
3771
kimi-k2-thinking-turbo
Moonshot · Modified MIT
1487±6
14,116$1.15 / $8262.1K
57
3285
glm-4.7
Z.ai · MIT
1486±12
2,411$0.40 / $1.75202.8K
58
4379
gpt-5.2
OpenAI · Proprietary
1483±6
11,360$1.75 / $14400K
59
4185
qwen3-max-preview
Alibaba · Proprietary
1482±8
5,366$0.78 / $3.90262.1K
60
3399
gemma-4-26b-a4b
Google · Apache 2.0
1480±15
1,365N/AN/A
61
4984
Anthropic
claude-haiku-4-5-20251001
Anthropic · Proprietary
1479±5
18,302$1 / $5200K
62
30106
amazon-nova-experimental-chat-26-01-10
Amazon · Proprietary
1479±21
736N/AN/A
63
4490
deepseek-v4-flash
DeepSeek · MIT
1479±9
4,780$0.10 / $0.201M
64
4491
deepseek-v4-flash-thinking
DeepSeek · MIT
1478±9
4,709$0.10 / $0.201M
65
5394
minimax-m2.7
MiniMax · Modified MIT
1475±8
6,572$0.26 / $1.20204.8K
66
44102
qwen3-max-2025-09-23
Alibaba · Proprietary
1475±13
2,042$0.78 / $3.90262.1K
67
5594
deepseek-v3.2-thinking
DeepSeek · MIT
1475±7
8,193$0.25 / $0.38131.1K
68
44102
longcat-flash-chat
Meituan · MIT
1474±13
2,233$0.20 / $0.80131.1K
69
44102
deepseek-v3.2-exp-thinking
DeepSeek · MIT
1474±13
1,919$0.27 / $0.41163.8K
70
5594
gpt-5.1
OpenAI · Proprietary
1474±7
9,130$1.25 / $10400K
71
5598
Anthropic
claude-sonnet-4-20250514-thinking-32k
Anthropic · Proprietary
1473±8
6,414$3 / $151M
72
5694
qwen3-235b-a22b-instruct-2507
Alibaba · Apache 2.0
1472±5
20,628$0.26 / $1.06N/A
73
48106
ernie-5.0-preview-1203
Baidu · Proprietary
1472±13
1,960N/AN/A
74
5899
chatgpt-4o-latest-20250326
OpenAI · Proprietary
1469±5
15,865$5 / $15128K
75
57102
deepseek-v3.2
DeepSeek · MIT
1469±7
10,179$0.25 / $0.38131.1K
76
57102
mistral-large-3
Mistral · Apache 2.0
1468±7
9,554$0.50 / $1.50N/A
77
56112
kimi-k2-0905-preview
Moonshot · Modified MIT
1467±13
2,243$0.60 / $2.50262.1K
78
57105
gpt-5-high
OpenAI · Proprietary
1467±8
6,360$1.25 / $10400K
79
56113
deepseek-v3.2-exp
DeepSeek · MIT
1466±12
2,501$0.27 / $0.41163.8K
80
56114
qwen3-vl-235b-a22b-instruct
Alibaba · Apache 2.0
1466±13
2,315$0.20 / $0.88262.1K
81
61103
gemini-2.5-pro
Google · Proprietary
1465±4
25,765$1.25 / $101M
82
57114
deepseek-r1-0528
DeepSeek · MIT
1465±11
2,728$0.50 / $2.15163.8K
83
47126
mimo-v2-omni
Xiaomi · Proprietary
1464±21
848$0.40 / $2262.1K
84
60106
Anthropic
claude-opus-4-20250514
Anthropic · Proprietary
1464±7
7,903$15 / $75200K
85
60111
gpt-5-chat
OpenAI · Proprietary
1464±8
5,991$1.25 / $10128K
86
44131
deepseek-v3.1-terminus-thinking
DeepSeek · MIT
1463±24
636$0.27 / $0.95163.8K
87
62108
grok-4-1-fast-reasoning
xAI · Proprietary
1462±6
12,670$0.20 / $0.502M
88
56121
Tencent
hunyuan-hy3-preview
Tencent · tencent-hunyuan-community
1462±15
1,648$0.29 / $1.17262.1K
89
62114
gpt-5.4-nano-high
OpenAI · Proprietary
1460±8
6,894$0.20 / $1.25400K
90
62116
kimi-k2-0711-preview
Moonshot · Modified MIT
1460±8
5,244$0.60 / $2.50131.1K
91
67114
glm-4.6
Z.ai · MIT
1460±7
7,481$0.43 / $1.74202.8K
92
60123
gpt-4.5-preview-2025-02-27
OpenAI · Proprietary
1459±13
1,939$75 / $150128K
93
67115
gemini-3.1-flash-lite-preview
Google · Proprietary
1459±7
9,137$0.25 / $1.501M
94
57129
grok-4-fast-chat
xAI · Proprietary
1459±16
1,249$3 / $15256K
95
68114
o3-2025-04-16
OpenAI · Proprietary
1459±6
11,756$2 / $8200K
96
67121
qwen3-coder-480b-a35b-instruct
Alibaba · Apache 2.0
1457±9
4,849$0.40 / $1.60262.1K
97
60126
deepseek-v3.1-thinking
DeepSeek · MIT
1457±13
1,904$1.23 / $4.94N/A
98
70118
gpt-4.1-2025-04-14
OpenAI · Proprietary
1456±7
9,316$2 / $81M
99
75116
mistral-medium-2508
Mistral · Proprietary
1456±5
20,392$2.70 / $8.1032K
100
60130
qwen3-vl-235b-a22b-thinking
Alibaba · Apache 2.0
1455±14
1,625$0.26 / $2.60131.1K
101
70121
qwen3.5-122b-a10b
Alibaba · Apache 2.0
1455±8
7,029$0.26 / $2.08262.1K
102
70123
glm-4.5
Z.ai · MIT
1454±9
4,772$0.60 / $2.20131.1K
103
77126
Anthropic
claude-3-7-sonnet-20250219-thinking-32k
Anthropic · Proprietary
1451±8
6,191$3 / $15200K
104
81129
Anthropic
claude-sonnet-4-20250514
Anthropic · Proprietary
1449±7
7,396$3 / $151M
105
81130
qwen3.5-27b
Alibaba · Apache 2.0
1448±8
6,863$0.20 / $1.56262.1K
106
76137
deepseek-v3.1
DeepSeek · MIT
1448±12
2,624$1.23 / $4.94N/A
107
83131
Stepfun
step-3.5-flash
StepFun · Apache 2.0
1447±7
8,364$0.09 / $0.30262.1K
108
82135
qwen3-next-80b-a3b-instruct
Alibaba · Apache 2.0
1446±9
4,794$0.09 / $1.10262.1K
109
84134
qwen3-235b-a22b-no-thinking
Alibaba · Apache 2.0
1446±8
6,975$0.46 / $1.82131.1K
110
90133
mimo-v2-flash (non-thinking)
Xiaomi · MIT
1445±6
11,214$0.10 / $0.30262.1K
111
80140
deepseek-r1
DeepSeek · MIT
1444±12
2,317$0.70 / $2.50163.8K
112
92135
minimax-m2.5
MiniMax · Modified MIT
1444±7
9,266$0.15 / $1.15204.8K
113
92139
grok-3-preview-02-24
xAI · Proprietary
1443±8
5,400$3 / $15131.1K
114
80148
qwen3-235b-a22b-thinking-2507
Alibaba · Apache 2.0
1442±15
1,611$0.15 / $1.50262.1K
115
93140
trinity-large-preview
Arcee AI · Apache 2.0
1441±8
6,942$0.15 / $0.45131K
116
93142
qwen3-30b-a3b-instruct-2507
Alibaba · Apache 2.0
1440±9
4,660$0.09 / $0.30262.1K
117
93143
minimax-m2.1-preview
MiniMax · MIT
1439±10
3,426$0.29 / $0.95204.8K
118
76159
deepseek-v3.1-terminus
DeepSeek · MIT
1439±21
778$0.27 / $0.95163.8K
119
67161
Tencent
hunyuan-vision-1.5-thinking
Tencent · Proprietary
1438±27
437N/AN/A
120
96146
grok-4-fast-reasoning
xAI · Proprietary
1437±9
3,956$0.20 / $0.502M
121
98143
qwen3.5-35b-a3b
Alibaba · Apache 2.0
1437±8
7,198$0.14 / $1262.1K
122
101143
grok-4-0709
xAI · Proprietary
1436±7
8,155$3 / $15256K
123
80160
amazon-nova-experimental-chat-12-10
Amazon · Proprietary
1435±21
704N/AN/A
124
96153
o3-mini-high
OpenAI · Proprietary
1435±12
2,596$1.10 / $4.40200K
125
107143
Anthropic
claude-3-5-sonnet-20241022
Anthropic · Proprietary
1434±6
14,964$3 / $15200K
126
101150
qwen3-235b-a22b
Alibaba · Apache 2.0
1433±9
4,339$0.46 / $1.82131.1K
127
89160
ernie-5.0-preview-1022
Baidu · Proprietary
1433±19
916N/AN/A
128
105149
gpt-4.1-mini-2025-04-14
OpenAI · Proprietary
1433±7
6,918$0.40 / $1.601M
129
103149
mistral-medium-2505
Mistral · Proprietary
1433±8
5,900$0.40 / $2131.1K
130
101153
o1-2024-12-17
OpenAI · Proprietary
1433±10
3,973$15 / $60200K
131
107149
qwen3.5-flash
Alibaba · Proprietary
1432±7
8,187N/AN/A
132
108149
o4-mini-2025-04-16
OpenAI · Proprietary
1432±7
8,721$1.10 / $4.40200K
133
98158
mimo-v2-flash (thinking)
Xiaomi · MIT
1432±12
2,444$0.10 / $0.30262.1K
134
109157
gpt-5-mini-high
OpenAI · Proprietary
1430±8
5,502$0.25 / $2400K
135
111157
Anthropic
claude-3-7-sonnet-20250219
Anthropic · Proprietary
1429±7
7,146$3 / $15200K
136
112157
deepseek-v3-0324
DeepSeek · MIT
1429±7
8,372$3 / $4.5032.8K
137
111158
gemini-2.5-flash-preview-09-2025
Google · Proprietary
1429±8
6,846$0.30 / $2.501M
138
113159
glm-4.5-air
Z.ai · MIT
1427±8
6,104$0.13 / $0.85131.1K
139
120159
gemini-2.5-flash
Google · Proprietary
1424±4
25,169$0.30 / $2.501M
140
112161
glm-4.7-flash
Z.ai · MIT
1423±11
2,687$0.06 / $0.40202.8K
141
115162
qwen3-next-80b-a3b-thinking
Alibaba · Apache 2.0
1421±11
2,677$0.10 / $0.78262.1K
142
98181
glm-4.6v
Z.ai · MIT
1420±25
536$0.30 / $0.90131.1K
143
120161
amazon-nova-experimental-chat-11-10
Amazon · Proprietary
1420±8
5,322N/AN/A
144
122164
o1-preview
OpenAI · Proprietary
1417±9
5,123$15 / $60N/A
145
127164
trinity-large-thinking
Arcee AI · Apache 2.0
1416±8
6,447$0.22 / $0.85262.1K
146
127163
minimax-m1
MiniMax · Apache 2.0
1416±8
6,489$0.40 / $2.201M
147
129162
o3-mini
OpenAI · Proprietary
1416±6
9,460$1.10 / $4.40200K
148
129167
mistral-small-2506
Mistral · Apache 2.0
1413±10
3,360$0.10 / $0.3032K
149
121173
ling-flash-2.0
Ant Group · MIT
1412±15
1,528N/AN/A
150
127170
amazon-nova-experimental-chat-10-20
Amazon · Proprietary
1411±12
2,293N/AN/A
151
120188
intellect-3
Prime Intellect · MIT
1409±19
973$0.20 / $1.10131.1K
152
129181
nvidia-nemotron-3-super-120b-a12b
Nvidia · NVIDIA Open Model
1409±14
1,747N/AN/A
153
126188
Stepfun
step-3
StepFun · Apache 2.0
1408±17
1,233$0.57 / $1.4265.5K
154
115189
qwen3-32b
Alibaba · Apache 2.0
1408±24
513$0.08 / $0.28131.1K
155
121189
nvidia-llama-3.3-nemotron-super-49b-v1.5
Nvidia · Nvidia Open
1405±22
659$0.10 / $0.40131.1K
156
129189
glm-4.5v
Z.ai · MIT
1405±18
991$0.60 / $1.8065.5K
157
142181
qwen2.5-max
Alibaba · Proprietary
1403±8
5,101N/AN/A
158
134194
Tencent
hunyuan-t1-20250711
Tencent · Proprietary
1400±20
805N/AN/A
159
116205
Tencent
hunyuan-turbos-20250226
Tencent · Proprietary
1400±31
275N/AN/A
160
147188
Anthropic
claude-3-5-sonnet-20240620
Anthropic · Proprietary
1398±7
13,607$3 / $15200K
161
147188
gemini-2.5-flash-lite-preview-09-2025-no-thinking
Google · Proprietary
1397±7
9,678$0.10 / $0.401M
162
144189
nova-2-lite
Amazon · Proprietary
1397±12
2,519$0.30 / $2.501M
163
137197
mercury-2
Inception AI · Proprietary
1396±21
768$0.25 / $0.75128K
164
145194
Tencent
hunyuan-turbos-20250416
Tencent · Proprietary
1394±14
1,776N/AN/A
165
132213
llama-3.1-nemotron-ultra-253b-v1
Nvidia · Nvidia Open Model
1391±30
367$0.60 / $1.80131.1K
166
149189
gpt-oss-120b
OpenAI · Apache 2.0
1391±8
6,494$0.04 / $0.18131.1K
167
147197
ring-flash-2.0
Ant Group · MIT
1391±15
1,539N/AN/A
168
148194
grok-3-mini-high
xAI · Proprietary
1390±10
3,296$0.25 / $1.27N/A
169
150189
Cohere
command-a-03-2025
Cohere · CC-BY-NC-4.0
1390±6
10,219$2.50 / $10256K
170
139209
amazon-nova-experimental-chat-10-09
Amazon · Proprietary
1389±24
552N/AN/A
171
150194
o1-mini
OpenAI · Proprietary
1388±7
8,478$1.10 / $4.40N/A
172
150197
deepseek-v3
DeepSeek · DeepSeek
1388±10
3,280$1.14 / $4.56N/A
173
150196
qwen3-30b-a3b
Alibaba · Apache 2.0
1387±9
4,531$0.09 / $0.45131.1K
174
150197
grok-3-mini-beta
xAI · Proprietary
1387±9
4,255$0.30 / $0.50131.1K
175
149200
magistral-medium-2506
Mistral · Proprietary
1386±12
2,250$2 / $540K
176
153197
qwq-32b
Alibaba · Apache 2.0
1385±9
4,046$0.50 / $116.4K
177
157195
Anthropic
claude-3-5-haiku-20241022
Anthropic · Proprietary
1384±6
11,248$0.80 / $4200K
178
148205
minimax-m2
MiniMax · Apache 2.0
1384±15
1,547$0.26 / $1204.8K
179
153197
gemini-2.5-flash-lite-preview-06-17-thinking
Google · Proprietary
1384±8
6,001$0.10 / $0.401M
180
150202
olmo-3.1-32b-instruct
Ai2 · Apache 2.0
1384±12
2,513$0.20 / $0.6065.5K
181
150207
gpt-5-nano-high
OpenAI · Proprietary
1382±15
1,684$0.05 / $0.40400K
182
149213
qwen-plus-0125
Alibaba · Proprietary
1380±18
893$0.40 / $1.20131.1K
183
163207
Meta
llama-3.1-405b-instruct-bf16
Meta · Llama 3.1 Community
1375±7
6,249$4 / $432.8K
184
153217
deepseek-v2.5-1210
DeepSeek · DeepSeek
1375±17
1,079N/AN/A
185
153220
gpt-4.1-nano-2025-04-14
OpenAI · Proprietary
1374±19
807$0.10 / $0.401M
186
163208
Meta
llama-4-maverick-17b-128e-instruct
Meta · Llama 4
1373±7
6,997$0.63 / $1.80131.1K
187
148233
Tencent
hunyuan-turbo-0110
Tencent · Proprietary
1372±30
299N/AN/A
188
153226
Stepfun
step-2-16k-exp-202412
StepFun · Proprietary
1371±20
737N/AN/A
189
163217
gpt-oss-20b
OpenAI · Apache 2.0
1370±13
2,167$0.03 / $0.14131.1K
190
168216
athene-v2-chat
NexusFlow · NexusFlow
1369±9
4,019N/AN/A
191
167216
01.AI
yi-lightning
01 AI · Proprietary
1369±10
4,316N/AN/A
192
175212
gpt-4o-2024-05-13
OpenAI · Proprietary
1369±6
19,526$5 / $15128K
193
169217
deepseek-v2.5
DeepSeek · DeepSeek
1368±9
4,252N/AN/A
194
175215
Meta
llama-3.1-405b-instruct-fp8
Meta · Llama 3.1 Community
1368±7
9,714$4 / $432.8K
195
150235
mercury
Inception AI · Proprietary
1367±29
394$0.25 / $0.75128K
196
153233
Tencent
hunyuan-large-2025-02-10
Tencent · Proprietary
1367±25
519N/AN/A
197
176217
gemini-2.0-flash-001
Google · Proprietary
1365±7
6,996$0.10 / $0.401M
198
163230
olmo-3-32b-think
Ai2 · Apache 2.0
1364±18
1,055$0.15 / $0.5065.5K
199
153238
llama-3.3-nemotron-49b-super-v1
Nvidia · Nvidia
1363±31
286N/AN/A
200
176225
nvidia-nemotron-3-nano-30b-a3b-bf16
Nvidia · NVIDIA Open Model
1363±10
3,277$0.06 / $0.24262.1K
201
177224
Meta
llama-4-scout-17b-16e-instruct
Meta · Llama
1362±9
5,255$0.40 / $0.708.2K
202
177224
mistral-small-3.1-24b-instruct-2503
Mistral · Apache 2.0
1362±8
6,136$0.10 / $0.3032K
203
179225
gpt-4o-2024-08-06
OpenAI · Proprietary
1360±8
7,318$2.50 / $10128K
204
163235
granite-4.1-8b
IBM · Apache 2.0
1360±21
944$0.05 / $0.10131.1K
205
181225
grok-2-2024-08-13
xAI · Proprietary
1359±7
10,368$2 / $10131.1K
206
182227
gemma-3-27b-it
Google · Gemma
1358±7
8,077$0.08 / $0.16131.1K
207
177232
qwen2.5-plus-1127
Alibaba · Proprietary
1357±14
1,553N/AN/A
208
183227
gemini-1.5-pro-002
Google · Proprietary
1356±7
9,175$3.50 / $10.502.1M
209
175237
Tencent
hunyuan-large-vision
Tencent · Proprietary
1356±19
964N/AN/A
210
183228
qwen2.5-72b-instruct
Alibaba · Qwen
1355±8
6,688$1.20 / $1.20N/A
211
189228
Anthropic
claude-3-opus-20240229
Anthropic · Proprietary
1353±6
33,748$15 / $75200K
212
186231
mistral-large-2407
Mistral · Mistral Research
1353±8
7,589$2 / $6131.1K
213
179236
Stepfun
step-1o-turbo-202506
StepFun · Proprietary
1353±15
1,504N/AN/A
214
183233
qwen-max-0919
Alibaba · Qwen
1353±11
2,756$1.60 / $6.4032.8K
215
184232
glm-4-plus
Z.ai · Proprietary
1352±9
4,449$0.44 / $1.76204.8K
216
186235
athene-70b-0725
NexusFlow · CC-BY-NC-4.0
1350±11
3,122N/AN/A
217
193233
gpt-4o-mini-2024-07-18
OpenAI · Proprietary
1349±7
10,927$0.15 / $0.60128K
218
194235
gemini-1.5-pro-001
Google · Proprietary
1347±8
12,747$3.50 / $10.502.1M
219
194235
gpt-4-turbo-2024-04-09
OpenAI · Proprietary
1347±7
17,104$10 / $30128K
220
193237
mistral-large-2411
Mistral · MRL
1346±9
4,212$2 / $6131.1K
221
200236
Meta
llama-3.3-70b-instruct
Meta · Llama-3.3
1345±7
8,748$0.10 / $0.32131.1K
222
196237
gemini-2.0-flash-lite-preview-02-05
Google · Proprietary
1343±10
3,474$0.07 / $0.301M
223
199237
amazon-nova-pro-v1.0
Amazon · Proprietary
1343±9
3,853$0.80 / $3.20300K
224
186245
qwen2.5-coder-32b-instruct
Alibaba · Apache 2.0
1342±19
873$0.87 / $0.8732K
225
194240
deepseek-coder-v2
DeepSeek · DeepSeek License
1342±12
2,671$0.14 / $0.28128K
226
204238
gpt-4-1106-preview
OpenAI · Proprietary
1339±7
15,605$10 / $30128K
227
194245
olmo-3.1-32b-think
Ai2 · Apache 2.0
1338±15
1,569$0.15 / $0.5065.5K
228
204240
gemini-advanced-0514
Google · Proprietary
1338±9
8,138N/AN/A
229
208240
grok-2-mini-2024-08-13
xAI · Proprietary
1335±7
8,652$2 / $10131.1K
230
212241
Meta
llama-3.1-70b-instruct
Meta · Llama 3.1 Community
1333±7
9,389$0.40 / $0.40131.1K
231
193255
Tencent
hunyuan-standard-2025-02-10
Tencent · Proprietary
1332±24
549N/AN/A
232
217245
gpt-4-0125-preview
OpenAI · Proprietary
1331±8
15,289$10 / $30128K
233
202252
glm-4-plus-0111
Z.ai · Proprietary
1331±18
894N/AN/A
234
205254
ibm-granite-h-small
IBM · Apache 2.0
1329±17
1,264N/AN/A
235
206252
llama-3.1-nemotron-70b-instruct
Nvidia · Llama 3.1
1329±15
1,312$1.20 / $1.20131.1K
236
219248
gpt-4-0314
OpenAI · Proprietary
1328±9
8,306$30 / $608.2K
237
212263
gemma-3-12b-it
Google · Gemma
1317±23
543$0.04 / $0.13131.1K
238
229255
Anthropic
claude-3-sonnet-20240229
Anthropic · Proprietary
1317±7
18,888$3 / $15200K
239
229255
gemini-1.5-flash-002
Google · Proprietary
1316±8
5,892$0.07 / $0.301M
240
225261
reka-core-20240904
Reka AI · Proprietary
1315±15
1,216N/AN/A
241
232259
gpt-4-0613
OpenAI · Proprietary
1313±8
13,719$30 / $608.2K
242
229261
mistral-small-24b-instruct-2501
Mistral · Apache 2.0
1312±12
2,083$0.05 / $0.0832.8K
243
228263
jamba-1.5-large
AI21 Labs · Jamba Open
1312±15
1,440$2 / $8256K
244
223266
llama-3.1-nemotron-51b-instruct
Nvidia · Llama 3.1
1311±22
665N/AN/A
245
233260
gemini-1.5-flash-001
Google · Proprietary
1310±8
10,680$0.07 / $0.301M
246
232261
gemma-3n-e4b-it
Google · Gemma
1309±10
3,530$0.06 / $0.1232.8K
247
232263
glm-4-0520
Z.ai · Proprietary
1308±14
1,718N/AN/A
248
225270
llama-3.1-tulu-3-70b
Ai2 · Llama 3.1
1307±24
450N/AN/A
249
233263
nemotron-4-340b-instruct
Nvidia · NVIDIA Open Model
1307±11
3,254N/AN/A
250
233263
phi-4
Microsoft · MIT
1306±10
3,305$0.07 / $0.1416.4K
251
233263
amazon-nova-lite-v1.0
Amazon · Proprietary
1305±10
3,060$0.06 / $0.24300K
252
235263
Meta
llama-3-70b-instruct
Meta · Llama 3 Community
1305±7
28,126$0.51 / $0.748.2K
253
236261
gemma-2-27b-it
Google · Gemma license
1305±6
12,088$0.65 / $0.658.2K
254
229279
Tencent
hunyuan-standard-256k
Tencent · Proprietary
1300±25
497N/AN/A
255
239266
Anthropic
claude-3-haiku-20240307
Anthropic · Proprietary
1300±7
20,898$0.25 / $1.25200K
256
239268
qwen2-72b-instruct
Alibaba · Qianwen LICENSE
1296±9
6,249$0.90 / $0.9032.8K
257
240269
mistral-large-2402
Mistral · Proprietary
1294±9
10,418$4 / $1232K
258
241271
Cohere
c4ai-aya-expanse-32b
Cohere · CC-BY-NC-4.0
1292±9
4,685N/AN/A
259
239279
reka-flash-20240904
Reka AI · Proprietary
1290±15
1,207N/AN/A
260
245277
amazon-nova-micro-v1.0
Amazon · Proprietary
1288±10
2,981$0.04 / $0.14128K
261
235287
granite-3.1-8b-instruct
IBM · Apache 2.0
1287±26
478N/AN/A
262
252285
Cohere
command-r-08-2024
Cohere · CC-BY-NC-4.0
1280±13
1,783$0.15 / $0.60128K
263
239292
olmo-2-0325-32b-instruct
Ai2 · Apache-2.0
1279±27
427$0.05 / $0.20128K
264
252285
Cohere
command-r-plus-08-2024
Cohere · CC-BY-NC-4.0
1279±14
1,675$2.50 / $10128K
265
254284
qwen1.5-110b-chat
Alibaba · Qianwen LICENSE
1279±10
4,763N/AN/A
266
254286
reka-flash-21b-20240226-online
Reka AI · Proprietary
1276±13
2,879N/AN/A
267
256284
mixtral-8x22b-instruct-v0.1
Mistral · Apache 2.0
1276±9
8,780$0.90 / $0.9065.5K
268
245293
gemma-3-4b-it
Google · Gemma
1275±24
605$0.04 / $0.08131.1K
269
252291
ministral-8b-2410
Mistral · MRL
1274±19
838$0.10 / $0.10131.1K
270
257286
qwen1.5-72b-chat
Alibaba · Qianwen LICENSE
1274±10
6,370N/AN/A
271
258285
gpt-3.5-turbo-0125
OpenAI · Proprietary
1273±8
11,130$0.50 / $1.5016.4K
272
258286
gemini-1.5-flash-8b-001
Google · Proprietary
1272±8
6,069$0.07 / $0.301M
273
254290
gemma-2-9b-it-simpo
Princeton · MIT
1272±15
1,471$0.03 / $0.098.2K
274
258286
Cohere
command-r-plus
Cohere · CC-BY-NC-4.0
1271±8
13,937$2.50 / $10128K
275
258286
gemma-2-9b-it
Google · Gemma license
1271±7
8,921$0.03 / $0.098.2K
276
259291
reka-flash-21b-20240226
Reka AI · Proprietary
1266±11
4,748N/AN/A
277
258294
jamba-1.5-mini
AI21 Labs · Jamba Open
1265±15
1,352$0.20 / $0.40256K
278
261294
mistral-medium
Mistral · Proprietary
1261±10
5,149$2.70 / $8.1032K
279
259296
gpt-3.5-turbo-1106
OpenAI · Proprietary
1261±16
2,121$1 / $216.4K
280
261294
qwen1.5-32b-chat
Alibaba · Qianwen LICENSE
1261±11
3,930N/AN/A
281
263292
Meta
llama-3.1-8b-instruct
Meta · Llama 3.1 Community
1259±7
8,582$0.02 / $0.05131.1K
282
261297
Cohere
c4ai-aya-expanse-8b
Cohere · CC-BY-NC-4.0
1255±15
1,567N/AN/A
283
258302
llama-3.1-tulu-3-8b
Ai2 · Llama 3.1
1253±25
476N/AN/A
284
272296
Meta
llama-3-8b-instruct
Meta · Llama 3 Community
1252±8
18,374$0.04 / $0.048.2K
285
272299
dbrx-instruct-preview
Databricks · DBRX LICENSE
1250±11
5,502$0.60 / $0.6032.8K
286
261304
granite-3.1-2b-instruct
IBM · Apache 2.0
1248±25
508N/AN/A
287
261304
gemini-pro
Google · Proprietary
1248±24
678$0.35 / $1.0532.8K
288
271301
internlm2_5-20b-chat
InternLM · Other
1247±14
1,684$0 / $032.8K
289
272299
01.AI
yi-1.5-34b-chat
01 AI · Apache-2.0
1247±10
3,841N/AN/A
290
266304
zephyr-orpo-141b-A35b-v0.1
HuggingFace · Apache 2.0
1244±21
831N/AN/A
291
278301
Cohere
command-r
Cohere · CC-BY-NC-4.0
1242±9
9,645$0.15 / $0.60128K
292
273305
granite-3.0-8b-instruct
IBM · Apache 2.0
1239±18
1,108N/AN/A
293
275304
gemini-pro-dev-api
Google · Proprietary
1238±14
2,681$0.35 / $1.0532.8K
294
277304
qwen1.5-14b-chat
Alibaba · Qianwen LICENSE
1238±13
3,208$0.30 / $0.30N/A
295
281301
mixtral-8x7b-instruct-v0.1
Mistral · Apache 2.0
1238±8
11,784$0.63 / $0.6332K
296
281305
starling-lm-7b-beta
Nexusflow · Apache-2.0
1234±13
2,948N/AN/A
297
284307
phi-3-medium-4k-instruct
Microsoft · MIT
1230±10
3,973$0.17 / $0.68N/A
298
283309
openchat-3.5-0106
OpenChat · Apache-2.0
1228±14
2,005N/AN/A
299
286309
snowflake-arctic-instruct
Snowflake · Apache 2.0
1223±11
5,734N/AN/A
300
290313
gemma-1.1-7b-it
Google · Gemma license
1216±10
4,332$0.03 / $0.098.2K
301
284321
deepseek-llm-67b-chat
DeepSeek · DeepSeek License
1216±24
649N/AN/A
302
286321
tulu-2-dpo-70b
AllenAI/UW · AI2 ImpACT Low-risk
1213±21
805N/AN/A
303
289323
qwen1.5-7b-chat
Alibaba · Qianwen LICENSE
1208±21
772$0.20 / $0.20N/A
304
290323
granite-3.0-2b-instruct
IBM · Apache 2.0
1208±18
1,134N/AN/A
305
295323
starling-lm-7b-alpha
UC Berkeley · CC-BY-NC-4.0
1206±16
1,397N/AN/A
306
298323
01.AI
yi-34b-chat
01 AI · Yi License
1204±13
2,345$0.90 / $0.904.1K
307
298321
phi-3-small-8k-instruct
Microsoft · MIT
1203±12
3,219$0.15 / $0.60N/A
308
297326
openchat-3.5
OpenChat · Apache-2.0
1201±20
971$0.20 / $0.20N/A
309
297330
qwen-14b-chat
Alibaba · Qianwen LICENSE
1196±24
599N/AN/A
310
300326
phi-3-mini-4k-instruct-june-2024
Microsoft · MIT
1196±14
1,841$0.13 / $0.524.1K
311
301325
gemma-2-2b-it
Google · Gemma license
1193±8
7,298N/AN/A
312
301326
vicuna-33b
LMSYS · Non-commercial
1192±13
2,866$0 / $02K
313
300331
wizardlm-70b
Microsoft · Llama 2 Community
1192±20
988N/AN/A
314
301328
phi-3-mini-4k-instruct
Microsoft · MIT
1186±12
3,449$0.13 / $0.52N/A
315
300336
openhermes-2.5-mistral-7b
NousResearch · Apache-2.0
1185±23
589$0.17 / $0.17N/A
316
301330
mistral-7b-instruct-v0.2
Mistral · Apache-2.0
1184±12
3,114$0.20 / $0.2032.8K
317
300337
solar-10.7b-instruct-v1.0
Upstage AI · CC-BY-NC-4.0
1182±27
482$0.30 / $0.30N/A
318
308333
Meta
llama-2-70b-chat
Meta · Llama 2 Community
1177±10
5,717$0.70 / $2.804.1K
319
304336
Meta
llama-3.2-3b-instruct
Meta · Llama 3.2
1175±16
1,351$0.05 / $0.34131.1K
320
301338
nous-hermes-2-mixtral-8x7b-dpo
NousResearch · Apache-2.0
1174±24
575$0.90 / $0.90N/A
321
301338
qwq-32b-preview
Alibaba · Apache 2.0
1173±24
566$0.50 / $116.4K
322
308337
gemma-1.1-2b-it
Google · Gemma license
1171±14
1,963N/AN/A
323
309338
gemma-7b-it
Google · Gemma license
1167±17
1,381$0.05 / $0.088.2K
324
301341
mpt-30b-chat
MosaicML · CC-BY-NC-SA-4.0
1166±35
258N/AN/A
325
301342
zephyr-7b-alpha
HuggingFace · MIT
1165±40
201N/AN/A
326
312340
vicuna-13b
LMSYS · Llama 2 Community
1162±14
2,389$0.30 / $0.30N/A
327
313338
Meta
llama-2-13b-chat
Meta · Llama 2 Community
1161±13
2,626$0.25 / $0.254.1K
328
304342
smollm2-1.7b-instruct
HuggingFace · Apache 2.0
1159±33
352N/AN/A
329
312341
Meta
codellama-34b-instruct
Meta · Llama 2 Community
1158±20
853$0.35 / $1.4016.4K
330
317341
phi-3-mini-128k-instruct
Microsoft · MIT
1153±13
3,886$0.13 / $0.52N/A
331
313341
palm-2
Google · Proprietary
1152±21
917$0.50 / $0.5025.8K
332
316341
zephyr-7b-beta
HuggingFace · MIT
1151±18
1,250$0.15 / $0.1516.4K
333
315341
wizardlm-13b
Microsoft · Llama 2 Community
1150±22
735$0.30 / $0.30N/A
334
317341
Meta
llama-3.2-1b-instruct
Meta · Llama 3.2
1148±16
1,346$0.03 / $0.20131.1K
335
316342
llama2-70b-steerlm-chat
Nvidia · Llama 2 Community
1144±28
467N/AN/A
336
317342
mistral-7b-instruct
Mistral · Apache 2.0
1143±20
1,032$0.07 / $0.284.1K
337
319344
gemma-2b-it
Google · Gemma license
1136±22
742$0.10 / $0.10N/A
338
321344
vicuna-7b
LMSYS · Llama 2 Community
1130±23
726$0.20 / $0.20N/A
339
326344
qwen1.5-4b-chat
Alibaba · Qianwen LICENSE
1130±17
1,283$0.10 / $0.10N/A
340
325344
stripedhyena-nous-7b
Together AI · Apache 2.0
1126±22
704$0.20 / $0.20N/A
341
325347
guanaco-33b
UW · Non-commercial
1112±36
263N/AN/A
342
333347
olmo-7b-instruct
Ai2 · Apache-2.0
1106±22
772$0.20 / $0.20N/A
343
337346
Meta
llama-2-7b-chat
Meta · Llama 2 Community
1101±14
1,956$0.15 / $0.154.1K
344
337349
chatglm3-6b
Tsinghua · Apache-2.0
1089±26
535N/AN/A
345
341351
mpt-7b-chat
MosaicML · CC-BY-NC-SA-4.0
1064±31
397N/AN/A
346
341350
koala-13b
UC Berkeley · Non-commercial
1064±24
747N/AN/A
347
342351
RWKV-4-Raven-14B
RWKV · Apache 2.0
1058±27
505N/AN/A
348
344352
oasst-pythia-12b
OpenAssistant · Apache 2.0
1049±25
714N/AN/A
349
345352
chatglm-6b
Tsinghua · Non-commercial
1034±27
551N/AN/A
350
344353
chatglm2-6b
Tsinghua · Apache-2.0
1029±35
293N/AN/A
351
346353
Stability
stablelm-tuned-alpha-7b
Stability AI · CC-BY-NC-SA-4.0
1003±33
363N/AN/A
352
348353
alpaca-13b
Stanford · Non-commercial
998±27
626N/AN/A
353
350354
dolly-v2-12b
Databricks · MIT
961±34
396N/AN/A
354
353355
fastchat-t5-3b
LMSYS · Apache 2.0
906±30
428N/AN/A
355
354355
Meta
llama-13b
Meta · Non-commercial
881±39
304$0.23 / $0.23N/A

Default Leaderboard Plots

Battle Count for Each Combination of Models (without Ties)

Average Win Rate Against All Other Models (Uniform Sampling and No Ties)

Confidence Intervals on Model Strength (via Bootstrapping)

Fraction of Model A Wins for All Non-tied A vs. B Battles