Text Arena🤓Expert

View overall rankings across various AI models in text-to-text tasks across math, coding, creative writing, and other open-ended domains.

Apr 14, 2026
292,770 votes
288 models
Rank Spread
1
18
Anthropic
claude-opus-4-6
Anthropic · Proprietary
1544±17
1,382$5 / $251M
2
110
Anthropic
claude-opus-4-6-thinking
Anthropic · Proprietary
1543±18
1,113$5 / $251M
3
115
gpt-5.4-high
OpenAI · Proprietary
1532±22
769$2.50 / $151.1M
4
120
gemini-3.1-pro-preview
Google · Proprietary
1519±15
1,657$2 / $121M
5
131
grok-4.20-multi-agent-beta-0309
xAI · Proprietary
1509±19
851$2 / $62M
6
132
mimo-v2-pro
Xiaomi · Proprietary
1509±23
650$1 / $31M
7
134
qwen3.5-max-preview
Alibaba · Proprietary
1507±22
681N/AN/A
8
331
Anthropic
claude-opus-4-5-20251101-thinking-32k
Anthropic · Proprietary
1505±13
2,213$5 / $25200K
9
137
gpt-5.4-mini-high
OpenAI · Proprietary
1505±23
637$2.50 / $151.1M
10
331
Anthropic
claude-opus-4-5-20251101
Anthropic · Proprietary
1504±11
2,938$5 / $25200K
11
334
Anthropic
claude-sonnet-4-6
Anthropic · Proprietary
1503±21
816$3 / $151M
12
235
gpt-5.4
OpenAI · Proprietary
1503±21
791$2.50 / $151.1M
13
331
gemini-3-pro
Google · Proprietary
1502±12
2,554$2 / $121M
14
432
Anthropic
claude-sonnet-4-5-20250929-thinking-32k
Anthropic · Proprietary
1498±10
3,470$3 / $15200K
15
346
glm-5.1
Z.ai · MIT
1497±26
485$0.95 / $3.15202.8K
16
434
gemini-3-flash
Google · Proprietary
1496±13
1,941$0.50 / $31M
17
263
amazon-nova-experimental-chat-26-02-10
Amazon · Proprietary
1491±34
272N/AN/A
18
443
kimi-k2.5-thinking
Moonshot · Modified MIT
1489±15
1,434$0.60 / $3N/A
19
540
Anthropic
claude-sonnet-4-5-20250929
Anthropic · Proprietary
1487±10
3,531$3 / $15200K
20
464
gemma-4-31b
Google · Apache 2.0
1483±26
438$0.14 / $0.40262.1K
21
547
Anthropic
claude-opus-4-1-20250805-thinking-16k
Anthropic · Proprietary
1483±12
2,364$15 / $75200K
22
551
Bytedance
dola-seed-2.0-pro
Bytedance · Proprietary
1482±15
1,483N/AN/A
23
556
gpt-5.2-chat-latest-20260210
OpenAI · Proprietary
1482±17
1,246$1.75 / $14128K
24
560
grok-4.20-beta-0309-reasoning
xAI · Proprietary
1481±21
818$2 / $62M
25
557
glm-5
Z.ai · MIT
1480±18
1,045$1 / $3.20202.8K
26
551
gpt-5.1-high
OpenAI · Proprietary
1480±13
2,350$1.25 / $10400K
27
577
gemma-4-26b-a4b
Google · Apache 2.0
1476±27
406N/AN/A
28
481
Meta
muse-spark
Meta · Proprietary
1475±31
340N/AN/A
29
959
gpt-5.2-high
OpenAI · Proprietary
1475±13
2,098$1.75 / $14400K
30
1157
grok-4.1-thinking
xAI · Proprietary
1475±11
2,954N/AN/A
31
573
grok-4.20-beta1
xAI · Proprietary
1473±21
722N/AN/A
32
1664
gemini-3-flash (thinking-minimal)
Google · Proprietary
1469±12
2,369$0.50 / $31M
33
1171
qwen3-max-preview
Alibaba · Proprietary
1469±17
1,287$0.78 / $3.90262.1K
34
595
amazon-nova-experimental-chat-26-01-10
Amazon · Proprietary
1467±36
256N/AN/A
35
591
qwen3-235b-a22b-thinking-2507
Alibaba · Apache 2.0
1466±28
420$0.13 / $0.60262.1K
36
1863
gemini-2.5-pro
Google · Proprietary
1466±8
6,137$1.25 / $101M
37
1770
Anthropic
claude-opus-4-1-20250805
Anthropic · Proprietary
1464±10
3,943$15 / $75200K
38
1678
qwen3.5-397b-a17b
Alibaba · Apache 2.0
1464±17
1,230$0.39 / $2.34262.1K
39
1580
gpt-5.3-chat-latest
OpenAI · Proprietary
1464±18
1,092$1.75 / $14128K
40
1878
gpt-5.2
OpenAI · Proprietary
1460±13
2,010$1.75 / $14400K
41
1781
gpt-5-high
OpenAI · Proprietary
1460±16
1,617$1.25 / $10400K
42
1594
kimi-k2.5-instant
Moonshot · Modified MIT
1457±24
566$0.38 / $1.72262.1K
43
2081
gpt-5.1
OpenAI · Proprietary
1457±12
2,744$1.25 / $10400K
44
1496
longcat-flash-chat-2602-exp
Meituan · Proprietary
1456±26
496N/AN/A
45
2081
kimi-k2-thinking-turbo
Moonshot · Modified MIT
1456±11
2,865$1.15 / $8262.1K
46
2281
grok-4.1
xAI · Proprietary
1455±11
3,180N/AN/A
47
2086
ernie-5.0-0110
Baidu · Proprietary
1454±15
1,591N/AN/A
48
1799
gpt-5.4-nano-high
OpenAI · Proprietary
1451±25
548$2.50 / $151.1M
49
16104
deepseek-v3.2-exp-thinking
DeepSeek · MIT
1450±29
407$0.27 / $0.41163.8K
50
2786
qwen3-235b-a22b-instruct-2507
Alibaba · Apache 2.0
1449±9
4,590$0.26 / $1.06N/A
51
2591
deepseek-v3.2-thinking
DeepSeek · MIT
1449±13
2,179$0.26 / $0.38163.8K
52
1899
qwen3-vl-235b-a22b-instruct
Alibaba · Apache 2.0
1449±24
579$0.20 / $0.88262.1K
53
1999
ernie-5.0-preview-1203
Baidu · Proprietary
1449±22
675N/AN/A
54
2294
gemini-3.1-flash-lite-preview
Google · Proprietary
1449±17
1,257$0.25 / $1.501M
55
2295
minimax-m2.5
MiniMax · Modified MIT
1448±17
1,288$0.12 / $0.99196.6K
56
2296
qwen3.5-122b-a10b
Alibaba · Apache 2.0
1448±18
989$0.26 / $2.08262.1K
57
2594
Anthropic
claude-opus-4-20250514-thinking-16k
Anthropic · Proprietary
1448±14
1,745$15 / $75200K
58
2793
deepseek-v3.2
DeepSeek · MIT
1447±12
2,587$0.26 / $0.38163.8K
59
2696
gpt-5-chat
OpenAI · Proprietary
1446±16
1,482$1.25 / $10128K
60
3194
Anthropic
claude-haiku-4-5-20251001
Anthropic · Proprietary
1445±10
3,635$1 / $5200K
61
22101
glm-4.7
Z.ai · MIT
1445±22
716$0.39 / $1.75202.8K
62
3194
o3-2025-04-16
OpenAI · Proprietary
1444±11
2,987$2 / $8200K
63
3198
glm-4.6
Z.ai · MIT
1442±14
1,887$0.39 / $1.90204.8K
64
3199
gemini-2.5-flash-preview-09-2025
Google · Proprietary
1441±15
1,662$0.30 / $2.501M
65
29104
glm-4.5
Z.ai · MIT
1439±18
1,129$0.60 / $2.20131.1K
66
3498
grok-4-1-fast-reasoning
xAI · Proprietary
1439±12
2,724$0.20 / $0.502M
67
34105
Anthropic
claude-sonnet-4-20250514-thinking-32k
Anthropic · Proprietary
1435±14
1,692$3 / $151M
68
23118
qwen3-vl-235b-a22b-thinking
Alibaba · Apache 2.0
1435±29
398$0.26 / $2.60131.1K
69
37103
Anthropic
claude-opus-4-20250514
Anthropic · Proprietary
1434±12
2,262$15 / $75200K
70
20121
ernie-5.0-preview-1022
Baidu · Proprietary
1434±34
278N/AN/A
71
33112
qwen3.5-27b
Alibaba · Apache 2.0
1433±18
954$0.20 / $1.56262.1K
72
33112
minimax-m2.1-preview
MiniMax · MIT
1433±18
1,058$0.29 / $0.95196.6K
73
38106
grok-4-0709
xAI · Proprietary
1432±13
2,049$3 / $15256K
74
35112
Stepfun
step-3.5-flash
StepFun · Apache 2.0
1432±16
1,367$0.10 / $0.30262.1K
75
31118
minimax-m2.7
MiniMax · Modified MIT
1431±25
524$0.30 / $1.20196.6K
76
31118
deepseek-v3.1-thinking
DeepSeek · MIT
1430±25
536$1.23 / $4.94N/A
77
45105
chatgpt-4o-latest-20250326
OpenAI · Proprietary
1430±9
4,378$5 / $15128K
78
32118
gpt-4.5-preview-2025-02-27
OpenAI · Proprietary
1429±23
608$75 / $150128K
79
34118
deepseek-v3.1
DeepSeek · MIT
1428±22
730$1.23 / $4.94N/A
80
47106
gemini-2.5-flash
Google · Proprietary
1428±8
6,217$0.30 / $2.501M
81
34122
longcat-flash-chat
Meituan · MIT
1425±26
526$0.20 / $0.80131.1K
82
27132
grok-4-fast-chat
xAI · Proprietary
1424±34
299$3 / $15256K
83
43118
qwen3.5-35b-a3b
Alibaba · Apache 2.0
1423±18
1,009$0.16 / $1.30262.1K
84
37123
deepseek-v3.2-exp
DeepSeek · MIT
1423±23
613$0.27 / $0.41163.8K
85
45122
deepseek-r1-0528
DeepSeek · MIT
1419±20
891$0.50 / $2.15163.8K
86
43126
kimi-k2-0905-preview
Moonshot · Modified MIT
1419±25
560$0.60 / $2.50262.1K
87
45123
grok-4-fast-reasoning
xAI · Proprietary
1419±20
881$0.20 / $0.502M
88
55118
mistral-large-3
Mistral · Apache 2.0
1419±12
2,564$0.50 / $1.50N/A
89
47123
qwen3.5-flash
Alibaba · Proprietary
1417±18
966N/AN/A
90
45126
mimo-v2-flash (thinking)
Xiaomi · MIT
1417±22
707$0.09 / $0.29262.1K
91
43132
qwen3-max-2025-09-23
Alibaba · Proprietary
1417±26
467$0.78 / $3.90262.1K
92
58123
amazon-nova-experimental-chat-11-10
Amazon · Proprietary
1414±15
1,540N/AN/A
93
53125
trinity-large-preview
Arcee AI · Apache 2.0
1414±18
1,037N/AN/A
94
58124
kimi-k2-0711-preview
Moonshot · Modified MIT
1413±16
1,474$0.60 / $2.50131.1K
95
70120
mistral-medium-2508
Mistral · Proprietary
1411±9
4,473$2.70 / $8.1032K
96
64124
mimo-v2-flash (non-thinking)
Xiaomi · MIT
1410±13
2,102$0.09 / $0.29262.1K
97
65131
grok-3-preview-02-24
xAI · Proprietary
1407±15
1,548$3 / $15131.1K
98
68129
Anthropic
claude-3-7-sonnet-20250219-thinking-32k
Anthropic · Proprietary
1407±14
1,890$3 / $15200K
99
60137
mai-1-preview
Microsoft AI · Proprietary
1406±21
776N/AN/A
100
72130
o4-mini-2025-04-16
OpenAI · Proprietary
1405±12
2,289$1.10 / $4.40200K
101
72129
gpt-4.1-2025-04-14
OpenAI · Proprietary
1405±12
2,552$2 / $81M
102
66137
gpt-5-mini-high
OpenAI · Proprietary
1404±18
1,161$0.25 / $2400K
103
65137
grok-3-mini-high
xAI · Proprietary
1403±19
932$0.30 / $0.50131.1K
104
45146
amazon-nova-experimental-chat-12-10
Amazon · Proprietary
1403±36
241N/AN/A
105
43148
Tencent
hunyuan-t1-20250711
Tencent · Proprietary
1403±38
215N/AN/A
106
43151
glm-4.5v
Z.ai · MIT
1401±41
196$0.60 / $1.8065.5K
107
72138
o1-2024-12-17
OpenAI · Proprietary
1401±17
1,330$15 / $60200K
108
64145
nvidia-nemotron-3-super-120b-a12b
Nvidia · NVIDIA Open Model
1399±24
586N/AN/A
109
75137
Anthropic
claude-sonnet-4-20250514
Anthropic · Proprietary
1399±13
2,093$3 / $151M
110
72141
deepseek-r1
DeepSeek · MIT
1399±20
848$0.70 / $2.5064K
111
72139
qwen3-next-80b-a3b-instruct
Alibaba · Apache 2.0
1398±18
1,034$0.09 / $1.10262.1K
112
48151
qwen3-32b
Alibaba · Apache 2.0
1398±38
236$0.08 / $0.2441K
113
72143
o3-mini-high
OpenAI · Proprietary
1397±20
847$1.10 / $4.40200K
114
75138
deepseek-v3-0324
DeepSeek · MIT
1396±12
2,332$3 / $4.5032.8K
115
75138
qwen3-235b-a22b-no-thinking
Alibaba · Apache 2.0
1396±14
1,901$0.46 / $1.82131.1K
116
75142
qwen3-30b-a3b-instruct-2507
Alibaba · Apache 2.0
1395±17
1,159$0.09 / $0.30262.1K
117
82146
glm-4.5-air
Z.ai · MIT
1389±16
1,418$0.13 / $0.85131.1K
118
75146
glm-4.7-flash
Z.ai · MIT
1389±20
809$0.06 / $0.40202.8K
119
75148
qwen3-next-80b-a3b-thinking
Alibaba · Apache 2.0
1387±23
642$0.10 / $0.78131.1K
120
90146
gemini-2.5-flash-lite-preview-09-2025-no-thinking
Google · Proprietary
1386±12
2,595$0.10 / $0.401M
121
86146
Anthropic
claude-3-7-sonnet-20250219
Anthropic · Proprietary
1386±13
2,146$3 / $15200K
122
83146
qwen3-235b-a22b
Alibaba · Apache 2.0
1385±16
1,331$0.46 / $1.82131.1K
123
92146
gpt-4.1-mini-2025-04-14
OpenAI · Proprietary
1384±13
2,016$0.40 / $1.601M
124
95147
mistral-medium-2505
Mistral · Proprietary
1380±14
1,794$0.40 / $2131.1K
125
93149
qwen3-coder-480b-a35b-instruct
Alibaba · Apache 2.0
1379±16
1,340$0.40 / $1.60262.1K
126
95148
o1-preview
OpenAI · Proprietary
1379±14
1,982$15 / $60N/A
127
98151
grok-3-mini-beta
xAI · Proprietary
1375±17
1,186$0.30 / $0.50131.1K
128
84167
qwen-plus-0125
Alibaba · Proprietary
1370±30
358$0.40 / $1.20131.1K
129
105154
gemini-2.5-flash-lite-preview-06-17-thinking
Google · Proprietary
1369±15
1,609$0.10 / $0.401M
130
99161
amazon-nova-experimental-chat-10-20
Amazon · Proprietary
1369±23
662N/AN/A
131
108156
qwen2.5-max
Alibaba · Proprietary
1367±14
1,672N/AN/A
132
113152
Anthropic
claude-3-5-sonnet-20241022
Anthropic · Proprietary
1366±9
5,036$3 / $15200K
133
112156
o3-mini
OpenAI · Proprietary
1365±11
2,873$1.10 / $4.40200K
134
109157
minimax-m1
MiniMax · Apache 2.0
1365±15
1,630$0.40 / $2.201M
135
101167
nova-2-lite
Amazon · Proprietary
1365±22
718$0.30 / $2.501M
136
109161
qwq-32b
Alibaba · Apache 2.0
1363±17
1,206$0.15 / $0.58131.1K
137
110161
gpt-oss-120b
OpenAI · Apache 2.0
1362±16
1,345$0.04 / $0.19131.1K
138
82180
nvidia-llama-3.3-nemotron-super-49b-v1.5
Nvidia · Nvidia Open
1361±41
183$0.10 / $0.40131.1K
139
97172
ring-flash-2.0
Ant Group · MIT
1361±32
344N/AN/A
140
95175
Stepfun
step-3
StepFun · Apache 2.0
1359±35
259$0.57 / $1.4265.5K
141
101174
ling-flash-2.0
Ant Group · MIT
1356±30
346N/AN/A
142
101178
gpt-5-nano-high
OpenAI · Proprietary
1354±33
326$0.05 / $0.40400K
143
120167
gemini-2.0-flash-001
Google · Proprietary
1354±13
2,195$0.10 / $0.401M
144
112173
Tencent
hunyuan-turbos-20250416
Tencent · Proprietary
1352±24
588N/AN/A
145
101185
intellect-3
Prime Intellect · MIT
1352±34
314$0.20 / $1.10131.1K
146
125167
o1-mini
OpenAI · Proprietary
1350±12
3,191$1.10 / $4.40N/A
147
101191
mercury-2
Inception AI · Proprietary
1350±38
228$0.25 / $0.75128K
148
124172
deepseek-v3
DeepSeek · DeepSeek
1347±17
1,236$1.14 / $4.56N/A
149
125172
qwen3-30b-a3b
Alibaba · Apache 2.0
1346±16
1,333$0.08 / $0.2841K
150
121174
nvidia-nemotron-3-nano-30b-a3b-bf16
Nvidia · NVIDIA Open Model
1346±20
947$0.06 / $0.24262.1K
151
111195
minimax-m2
MiniMax · Apache 2.0
1342±35
260$0.26 / $1196.6K
152
132172
Cohere
command-a-03-2025
Cohere · CC-BY-NC-4.0
1340±11
2,824$2.50 / $10256K
153
133173
Anthropic
claude-3-5-sonnet-20240620
Anthropic · Proprietary
1338±11
4,314$3 / $15200K
154
133178
gemma-3-27b-it
Google · Gemma
1335±13
2,251$0.08 / $0.16131.1K
155
136175
gemini-1.5-pro-002
Google · Proprietary
1334±11
3,319$3.50 / $10.502.1M
156
130187
mistral-small-2506
Mistral · Apache 2.0
1334±20
855$0.10 / $0.3032K
157
129193
olmo-3.1-32b-instruct
Ai2 · Apache 2.0
1333±22
753$0.20 / $0.6065.5K
158
136187
01.AI
yi-lightning
01 AI · Proprietary
1330±15
1,533N/AN/A
159
136189
gemini-2.0-flash-lite-preview-02-05
Google · Proprietary
1329±16
1,237$0.07 / $0.301M
160
129205
Stepfun
step-2-16k-exp-202412
StepFun · Proprietary
1325±31
310N/AN/A
161
140193
Meta
llama-4-maverick-17b-128e-instruct
Meta · Llama 4
1324±13
2,009$0.63 / $1.80131.1K
162
128208
Tencent
hunyuan-large-2025-02-10
Tencent · Proprietary
1322±36
228N/AN/A
163
136200
qwen2.5-plus-1127
Alibaba · Proprietary
1322±21
664N/AN/A
164
140194
Meta
llama-3.1-405b-instruct-fp8
Meta · Llama 3.1 Community
1320±11
3,123$4 / $432.8K
165
133206
olmo-3.1-32b-think
Ai2 · Apache 2.0
1320±27
505$0.15 / $0.5065.5K
166
133206
gpt-oss-20b
OpenAI · Apache 2.0
1320±28
492$0.03 / $0.14131.1K
167
130214
olmo-3-32b-think
Ai2 · Apache 2.0
1317±38
279$0.15 / $0.5065.5K
168
146200
gemini-1.5-pro-001
Google · Proprietary
1314±12
3,896$3.50 / $10.502.1M
169
150200
Anthropic
claude-3-opus-20240229
Anthropic · Proprietary
1313±9
10,374$15 / $75200K
170
136212
gpt-4.1-nano-2025-04-14
OpenAI · Proprietary
1313±31
328$0.10 / $0.401M
171
150200
grok-2-2024-08-13
xAI · Proprietary
1312±11
3,541$2 / $10131.1K
172
136216
ibm-granite-h-small
IBM · Apache 2.0
1311±35
312N/AN/A
173
148203
athene-v2-chat
NexusFlow · NexusFlow
1310±15
1,469N/AN/A
174
152200
Anthropic
claude-3-5-haiku-20241022
Anthropic · Proprietary
1310±11
3,521$0.80 / $4200K
175
153200
gpt-4o-2024-05-13
OpenAI · Proprietary
1309±10
5,887$5 / $15128K
176
152203
gpt-4o-2024-08-06
OpenAI · Proprietary
1308±13
2,349$2.50 / $10128K
177
140214
glm-4-plus-0111
Zhipu · Proprietary
1308±29
354N/AN/A
178
153204
Meta
llama-3.1-405b-instruct-bf16
Meta · Llama 3.1 Community
1307±13
2,128$4 / $432.8K
179
150206
Meta
llama-4-scout-17b-16e-instruct
Meta · Llama
1307±16
1,516$0.40 / $0.708.2K
180
140213
deepseek-v2.5-1210
DeepSeek · DeepSeek
1306±26
441N/AN/A
181
153206
mistral-small-3.1-24b-instruct-2503
Mistral · Apache 2.0
1304±15
1,669$0.10 / $0.3032K
182
154208
glm-4-plus
Zhipu AI · Proprietary
1302±15
1,608$0.44 / $1.76204.8K
183
140223
Tencent
hunyuan-large-vision
Tencent · Proprietary
1301±34
288N/AN/A
184
158208
mistral-large-2407
Mistral · Mistral Research
1299±12
2,505$2 / $6131.1K
185
154213
qwen-max-0919
Alibaba · Qwen
1299±18
1,011$1.60 / $6.4032.8K
186
156216
athene-70b-0725
NexusFlow · CC-BY-NC-4.0
1295±19
867N/AN/A
187
160213
deepseek-v2.5
DeepSeek · DeepSeek
1295±15
1,523N/AN/A
188
162210
gpt-4-turbo-2024-04-09
OpenAI · Proprietary
1294±11
5,195$10 / $30128K
189
162210
Meta
llama-3.3-70b-instruct
Meta · Llama-3.3
1294±11
2,907$0.10 / $0.32131.1K
190
162212
qwen2.5-72b-instruct
Alibaba · Qwen
1294±12
2,397$1.20 / $1.20N/A
191
153224
Stepfun
step-1o-turbo-202506
StepFun · Proprietary
1292±27
479N/AN/A
192
153224
llama-3.1-nemotron-70b-instruct
Nvidia · Llama 3.1
1292±27
453$1.20 / $1.20131.1K
193
162213
grok-2-mini-2024-08-13
xAI · Proprietary
1292±12
2,759$2 / $10131.1K
194
162214
gemini-advanced-0514
Google · Proprietary
1292±14
2,449N/AN/A
195
144232
Tencent
hunyuan-standard-2025-02-10
Tencent · Proprietary
1290±39
207N/AN/A
196
156226
magistral-medium-2506
Mistral · Proprietary
1288±27
556$2 / $540K
197
157226
reka-core-20240904
Reka AI · Proprietary
1287±25
458N/AN/A
198
168219
gpt-4-1106-preview
OpenAI · Proprietary
1286±12
4,240$10 / $30128K
199
170221
gpt-4o-mini-2024-07-18
OpenAI · Proprietary
1284±11
3,549$0.15 / $0.60128K
200
158230
jamba-1.5-large
AI21 Labs · Jamba Open
1282±29
331$2 / $8256K
201
172223
gemini-1.5-flash-002
Google · Proprietary
1280±13
2,116$0.07 / $0.301M
202
168226
gemma-3n-e4b-it
Google · Gemma
1278±18
1,078$0.06 / $0.1232.8K
203
176224
gpt-4-0125-preview
OpenAI · Proprietary
1277±12
4,454$10 / $30128K
204
161238
qwen2.5-coder-32b-instruct
Alibaba · Apache 2.0
1275±33
267$0.87 / $0.8732K
205
176230
amazon-nova-pro-v1.0
Amazon · Proprietary
1271±16
1,387$0.80 / $3.20300K
206
171235
reka-flash-20240904
Reka AI · Proprietary
1271±23
493N/AN/A
207
181226
Meta
llama-3.1-70b-instruct
Meta · Llama 3.1 Community
1271±11
2,924$0.40 / $0.40131.1K
208
157248
gemma-3-12b-it
Google · Gemma
1271±42
186$0.04 / $0.13131.1K
209
179230
mistral-large-2411
Mistral · MRL
1268±15
1,510$2 / $6131.1K
210
187230
Anthropic
claude-3-sonnet-20240229
Anthropic · Proprietary
1267±12
5,614$3 / $15200K
211
181235
phi-4
Microsoft · MIT
1265±17
1,124$0.07 / $0.1416.4K
212
192230
gemini-1.5-flash-001
Google · Proprietary
1263±12
3,194$0.07 / $0.301M
213
179239
deepseek-coder-v2
DeepSeek · DeepSeek License
1262±21
769$0.14 / $0.28128K
214
192236
Cohere
c4ai-aya-expanse-32b
Cohere · CC-BY-NC-4.0
1261±14
1,764N/AN/A
215
190237
amazon-nova-lite-v1.0
Amazon · Proprietary
1260±17
1,138$0.06 / $0.24300K
216
193237
gpt-4-0314
OpenAI · Proprietary
1258±15
2,160$30 / $608.2K
217
190244
mistral-small-24b-instruct-2501
Mistral · Apache 2.0
1257±21
754$0.05 / $0.0832.8K
218
168253
gemma-3-4b-it
Google · Gemma
1256±41
208$0.04 / $0.08131.1K
219
194238
qwen2-72b-instruct
Alibaba · Qianwen LICENSE
1256±15
1,763$0.90 / $0.9032.8K
220
192244
nemotron-4-340b-instruct
Nvidia · NVIDIA Open Model
1255±19
1,027N/AN/A
221
199237
gemma-2-27b-it
Google · Gemma license
1254±10
4,025$0.65 / $0.658.2K
222
193250
glm-4-0520
Zhipu AI · Proprietary
1249±25
514N/AN/A
223
183253
llama-3.1-nemotron-51b-instruct
Nvidia · Llama 3.1
1248±33
265N/AN/A
224
203244
Anthropic
claude-3-haiku-20240307
Anthropic · Proprietary
1247±11
6,336$0.25 / $1.25200K
225
203247
gpt-4-0613
OpenAI · Proprietary
1246±13
3,617$30 / $608.2K
226
194251
Cohere
command-r-plus-08-2024
Cohere · CC-BY-NC-4.0
1246±25
524$2.50 / $10128K
227
203250
amazon-nova-micro-v1.0
Amazon · Proprietary
1242±17
1,094$0.04 / $0.14128K
228
209248
Meta
llama-3-70b-instruct
Meta · Llama 3 Community
1239±11
7,958$0.51 / $0.748.2K
229
208250
gemini-1.5-flash-8b-001
Google · Proprietary
1238±13
2,111$0.07 / $0.301M
230
209250
Cohere
command-r-plus
Cohere · CC-BY-NC-4.0
1237±12
4,031$2.50 / $10128K
231
199256
ministral-8b-2410
Mistral · MRL
1235±30
332$0.10 / $0.10131.1K
232
215251
gemma-2-9b-it
Google · Gemma license
1231±12
2,847$0.03 / $0.098.2K
233
196263
granite-3.1-8b-instruct
IBM · Apache 2.0
1230±35
237N/AN/A
234
212253
qwen1.5-72b-chat
Alibaba · Qianwen LICENSE
1230±15
1,846N/AN/A
235
203260
gemma-2-9b-it-simpo
Princeton · MIT
1229±30
369$0.03 / $0.098.2K
236
208257
Cohere
c4ai-aya-expanse-8b
Cohere · CC-BY-NC-4.0
1227±24
600N/AN/A
237
211257
Cohere
command-r-08-2024
Cohere · CC-BY-NC-4.0
1226±22
604$0.15 / $0.60128K
238
218254
qwen1.5-110b-chat
Alibaba · Qianwen LICENSE
1224±16
1,411N/AN/A
239
218253
mistral-large-2402
Mistral · Proprietary
1223±14
2,940$4 / $1232K
240
218257
mistral-medium
Mistral · Proprietary
1221±17
1,357$2.70 / $8.1032K
241
217261
reka-flash-21b-20240226-online
Reka AI · Proprietary
1220±21
830N/AN/A
242
221259
qwen1.5-32b-chat
Alibaba · Qianwen LICENSE
1218±18
1,176N/AN/A
243
221262
01.AI
yi-1.5-34b-chat
01 AI · Apache-2.0
1217±19
1,049N/AN/A
244
218263
internlm2_5-20b-chat
InternLM · Other
1216±22
604$0 / $032.8K
245
209270
granite-3.1-2b-instruct
IBM · Apache 2.0
1213±36
225N/AN/A
246
224261
mixtral-8x22b-instruct-v0.1
Mistral · Apache 2.0
1213±14
2,582$0.90 / $0.9065.5K
247
224263
reka-flash-21b-20240226
Reka AI · Proprietary
1210±17
1,325N/AN/A
248
228263
Cohere
command-r
Cohere · CC-BY-NC-4.0
1209±14
2,830$0.15 / $0.60128K
249
218270
jamba-1.5-mini
AI21 Labs · Jamba Open
1209±31
332$0.20 / $0.40256K
250
221269
gpt-3.5-turbo-1106
OpenAI · Proprietary
1207±28
437$1 / $216.4K
251
230263
Meta
llama-3-8b-instruct
Meta · Llama 3 Community
1205±12
5,360$0.03 / $0.048.2K
252
230266
phi-3-medium-4k-instruct
Microsoft · MIT
1200±18
1,091$0.17 / $0.68N/A
253
222273
granite-3.0-8b-instruct
IBM · Apache 2.0
1199±31
345N/AN/A
254
235266
Meta
llama-3.1-8b-instruct
Meta · Llama 3.1 Community
1195±12
2,589$0.02 / $0.0516.4K
255
236270
mixtral-8x7b-instruct-v0.1
Mistral · Apache 2.0
1191±13
3,240$0.63 / $0.6332K
256
239270
gpt-3.5-turbo-0125
OpenAI · Proprietary
1190±13
3,207$0.50 / $1.5016.4K
257
234273
qwen1.5-14b-chat
Alibaba · Qianwen LICENSE
1189±20
944$0.30 / $0.30N/A
258
239273
dbrx-instruct-preview
Databricks · DBRX LICENSE
1184±16
1,678$0.60 / $0.6032.8K
259
243280
Meta
llama-3.2-3b-instruct
Meta · Llama 3.2
1174±25
499$0.05 / $0.3480K
260
244280
gemini-pro-dev-api
Google · Proprietary
1172±24
694$0.35 / $1.0532.8K
261
240282
granite-3.0-2b-instruct
IBM · Apache 2.0
1171±29
407N/AN/A
262
249278
starling-lm-7b-beta
Nexusflow · Apache-2.0
1169±20
952N/AN/A
263
235285
zephyr-orpo-141b-A35b-v0.1
HuggingFace · Apache 2.0
1166±40
219N/AN/A
264
252278
gemma-2-2b-it
Google · Gemma license
1166±13
2,525N/AN/A
265
249280
gemma-1.1-7b-it
Google · Gemma license
1166±18
1,247$0.03 / $0.098.2K
266
251282
phi-3-small-8k-instruct
Microsoft · MIT
1161±19
895$0.15 / $0.60N/A
267
251283
openchat-3.5-0106
OpenChat · Apache-2.0
1158±23
611N/AN/A
268
256283
snowflake-arctic-instruct
Snowflake · Apache 2.0
1158±17
1,722N/AN/A
269
241286
openchat-3.5
OpenChat · Apache-2.0
1157±42
194$0.20 / $0.20N/A
270
249286
qwq-32b-preview
Alibaba · Apache 2.0
1153±36
232$0.15 / $0.58131.1K
271
256285
01.AI
yi-34b-chat
01 AI · Yi License
1151±25
559$0.90 / $0.904.1K
272
256285
phi-3-mini-4k-instruct-june-2024
Microsoft · MIT
1144±26
486$0.13 / $0.524.1K
273
251288
qwen1.5-7b-chat
Alibaba · Qianwen LICENSE
1143±37
231$0.20 / $0.20N/A
274
259286
vicuna-33b
LMSYS · Non-commercial
1140±27
484$0 / $02K
275
259286
phi-3-mini-4k-instruct
Microsoft · MIT
1136±20
936$0.13 / $0.52N/A
276
259286
mistral-7b-instruct-v0.2
Mistral · Apache-2.0
1135±21
798$0.20 / $0.2032.8K
277
259288
starling-lm-7b-alpha
UC Berkeley · CC-BY-NC-4.0
1133±31
318N/AN/A
278
261286
Meta
llama-2-70b-chat
Meta · Llama 2 Community
1132±17
1,356$0.70 / $2.804.1K
279
259288
Meta
llama-2-7b-chat
Meta · Llama 2 Community
1129±28
411$0.15 / $0.154.1K
280
261288
Meta
llama-2-13b-chat
Meta · Llama 2 Community
1124±25
539$0.25 / $0.254.1K
281
264288
gemma-7b-it
Google · Gemma license
1114±31
340$0.05 / $0.088.2K
282
266288
vicuna-13b
LMSYS · Llama 2 Community
1111±31
321$0.30 / $0.30N/A
283
268288
gemma-1.1-2b-it
Google · Gemma license
1108±26
578N/AN/A
284
264288
zephyr-7b-beta
HuggingFace · MIT
1108±38
201$0.15 / $0.1516.4K
285
268288
qwen1.5-4b-chat
Alibaba · Qianwen LICENSE
1101±31
356$0.10 / $0.10N/A
286
277288
phi-3-mini-128k-instruct
Microsoft · MIT
1092±20
1,095$0.13 / $0.52N/A
287
277288
Meta
llama-3.2-1b-instruct
Meta · Llama 3.2
1079±28
487$0.03 / $0.2060K
288
271288
mistral-7b-instruct
Mistral · Apache 2.0
1078±40
183$0.07 / $0.284.1K

Default Leaderboard Plots

Average Win Rate Against All Other Models (Uniform Sampling and No Ties)

Confidence Intervals on Model Strength (via Bootstrapping)

Battle Count for Each Combination of Models (without Ties)

Fraction of Model A Wins for All Non-tied A vs. B Battles