313 models not plottedThese models are on the leaderboard but do not appear on the Pareto chart because they have insufficient cost data. The numbers beside their names show their leaderboard ranks.
14 Gemini 3 Pro 26 Claude Opus 4.5 (High, 32K, 20251101) 29 Muse Spark 32 Claude Opus 4.5 (20251101) 36 Gemini 3 Flash 38 Claude Sonnet 4.5 (20250929) 47 Claude Sonnet 4.5 (High, 32K, 20250929) 53 GLM-5 57 Claude Opus 4.1 (Thinking 16K, 20250805) 61 Gemini 2.5 Pro 64 Claude Opus 4.1 (20250805) 69 Qwen3.6-Max-Preview 71 GPT-4.5 Preview (2025-02-27) 73 Claude Opus 4 (Thinking 16K, 20250514) 79 Grok 4.1 83 GPT-5.1 (High) 85 Grok 4.1 (Thinking) 91 ChatGPT-4o Latest (20250326) 92 ERNIE 5.0 (0110) 93 ERNIE-5.0-Preview (1203) 94 Gemma 4 31B 95 Claude Opus 4 (20250514) 96 Grok 4.1 Fast (Reasoning) 102 DeepSeek-V3.2-Exp 104 GPT-5.1 105 ERNIE-5.0-Preview (1022) 109 DeepSeek-V3.1-Terminus 110 GLM-4.7 112 GPT-4.1 (2025-04-14) 113 DeepSeek-V3.1 (Thinking) 115 GLM-4.6 116 DeepSeek-V3.2 117 Gemma 4 26B A4B 119 Grok 3 Preview (02-24) 120 Claude Sonnet 4 (Thinking 32K, 20250514) 122 Gemini 2.5 Flash 123 Grok 4 (0709) 125 Qwen3-Max-Preview 126 Claude 3.7 Sonnet (Thinking 32K, 20250219) 127 Qwen3-Max (2025-09-23) 128 Kimi K2.5 (Instant) 131 Kimi K2 Thinking Turbo 132 DeepSeek-V3.2 (Thinking) 134 DeepSeek-V3.2-Exp (Thinking) 135 DeepSeek-V3 (0324) 136 LongCat-Flash-Chat Exp (2602) 137 NVIDIA-Nemotron-3.5-Super-VL-120B-A12B (NVFP4) 138 DeepSeek-R1 (0528) 139 GPT-5 Chat 141 Claude Sonnet 4 (20250514) 142 DeepSeek-V3.1 143 Beam 1.0 501B A23B 145 GPT-5.2 (High) 146 DeepSeek-V3.1-Terminus (Thinking) 147 NVIDIA-Nemotron-3-Ultra-550B-A55B (NVFP4) 148 Grok 4 Fast (Reasoning) 149 o3 (2025-04-16) 150 Kimi K2 Preview (0905) 151 Grok 4 Fast (Non-Reasoning) 152 o1 (2024-12-17) 153 Gemini 2.5 Flash Preview (09-2025) 154 Qwen3-235B-A22B-Instruct (2507) 155 Mistral Medium 3.1 (2508) 156 Claude 3.7 Sonnet (20250219) 157 Hunyuan Vision 1.5 Thinking 158 Hunyuan T1 (20250711) 160 DeepSeek-R1 161 Gemini 2.5 Flash-Lite Preview (Thinking, 06-17) 162 GLM-4.5 163 GPT-5 (High) 164 Claude 3.5 Sonnet (20241022) 165 Kimi K2 Preview (0711) 166 Qwen3-235B-A22B-Thinking (2507) 167 Muse Glimmer 168 Qwen3-235B-A22B (Non-Thinking) 169 o1-preview 171 Mistral Medium 3 (2505) 173 Qwen3-Coder-480B-A35B-Instruct 174 Hunyuan TurboS (20250416) 176 Gemini 2.5 Flash-Lite Preview (Non-Thinking, 09-2025) 178 Gemini 1.5 Pro (002) 182 Qwen3-VL-235B-A22B-Instruct 184 Qwen2.5-Max 185 MiMo-V2-Flash (Non-Thinking) 187 GPT-4.1 mini (2025-04-14) 188 GLM-4.6V 189 DeepSeek-V3 190 amazon-nova-experimental-chat (26-01-10) 191 Gemma 3 27B IT 192 MiniMax-M2.1 Preview 193 Gemini Advanced (0514) 194 Gemini 2.0 Flash-Lite Preview (02-05) 196 Gemini 2.0 Flash (001) 198 amazon-nova-experimental-chat (26-02-10) 200 amazon-nova-experimental-chat (12-10) 201 Qwen3-VL-235B-A22B-Thinking 203 GPT-4o (2024-05-13) 204 o4-mini (2025-04-16) 206 Command A (03-2025) 207 Grok 3 Mini Beta 208 MiMo-V2-Flash (Thinking) 209 Step-2 16K Exp (202412) 211 Gemma 3 12B IT 212 Grok 3 Mini (High) 213 Llama 3.1 Nemotron Ultra 253B v1 214 LongCat-Flash-Chat 215 GLM-4.5-Air 216 GPT-4o (2024-08-06) 217 Qwen3-Next-80B-A3B-Thinking 218 Gemini 1.5 Pro (001) 219 GPT-4 Turbo (2024-04-09) 220 Mistral Small 3.2 (2506) 221 GPT-5 mini (High) 222 Qwen3-235B-A22B 224 MiniMax-M1 225 Qwen3-30B-A3B-Instruct (2507) 226 Grok 2 (2024-08-13) 227 Qwen-Plus (0125) 228 GLM-4-Plus (0111) 229 Qwen3-Next-80B-A3B-Instruct 231 o3-mini (High) 232 Step-3 233 GLM-4.5V 234 DeepSeek-V2.5 (1210) 235 INTELLECT-3 236 GPT-4.1 nano (2025-04-14) 237 Llama 4 Maverick 17B 128E Instruct 238 Claude 3.5 Haiku (20241022) 239 GLM-4.7-Flash 240 Llama 3.1 405B Instruct (FP8) 241 Claude 3.5 Sonnet (20240620) 242 Llama 3.3 Nemotron Super 49B v1.5 243 Qwen3-32B 244 Hunyuan Large (2025-02-10) 245 Hunyuan TurboS (20250226) 246 Hunyuan Turbo (0110) 247 NVIDIA-Nemotron-3-Super-120B-A12B 248 Llama 3.1 405B Instruct (BF16) 249 o3-mini 250 amazon-nova-experimental-chat (11-10) 251 Gemma 3n E4B IT 252 Gemini 1.5 Flash (002) 253 Llama 3.3 Nemotron Super 49B v1 254 Yi Lightning 255 GPT-4o mini (2024-07-18) 256 Olmo 3.1 32B Instruct 257 QwQ-32B 258 Gemma 2 27B IT 259 Step-1o Turbo (202506) 260 Mercury 2 261 GLM-4-Plus 262 Llama 4 Scout 17B 16E Instruct 263 Claude 3 Opus (20240229) 264 Mistral Large 2 (2407) 265 amazon-nova-experimental-chat (10-09) 266 GPT-4 Turbo Preview (1106) 267 Llama 3.3 70B Instruct 268 Qwen-Max (0919) 269 Gemma 2 9B IT SimPO 270 Qwen3-30B-A3B 271 NVIDIA-Nemotron-3.5-Lightning-30B-A3B (NVFP4) 272 MiniMax-M2 273 o1-mini 274 GPT-4 Turbo Preview (0125) 275 Magistral Medium (2506) 276 gpt-oss-120b 277 Hunyuan Large Vision 278 amazon-nova-experimental-chat (10-20) 279 Hunyuan Standard (2025-02-10) 280 Mistral Large (2411) 281 Llama 3.1 Nemotron 70B Instruct 282 Gemma 3 4B IT 283 Qwen2.5-Plus (1127) 284 Grok 2 mini (2024-08-13) 285 Athene 70B (0725) 286 Mistral Small 3.1 24B Instruct (2503) 287 Amazon Nova 2 Lite 288 Ling-flash-2.0 289 Reka Core (20240904) 290 GPT-4 (0613) 292 DeepSeek-V2.5 293 Granite 4.2 30B 294 Olmo 3 32B Think 295 Gemini 1.5 Flash (001) 296 Command R+ (08-2024) 297 Llama 3.1 Nemotron 51B Instruct 298 Jamba 1.5 Large 299 Gemma 2 9B IT 300 Llama 3.1 70B Instruct 301 Ring-flash-2.0 302 GPT-4 (0314) 303 Llama 3 70B Instruct 304 Qwen2.5-72B-Instruct 305 Athene V2 Chat 306 Olmo 3.1 32B Think 307 GPT-5 nano (High) 308 Llama 3.1 Tulu 3 70B 309 Claude 3 Sonnet (20240229) 310 Reka Flash (20240904) 311 Granite-4.0-H-Small 312 NVIDIA-Nemotron-3-Nano-30B-A3B (BF16) 313 GLM-4 (0520) 314 gpt-oss-20b 315 Nemotron-4 340B Instruct 316 Gemini 1.5 Flash-8B (001) 317 Amazon Nova Pro 1.0 318 Command R+ 319 Aya Expanse 32B 320 Mistral Small 24B Instruct (2501) 321 OLMo 2 32B Instruct (0325) 322 Qwen2-72B-Instruct 323 Ministral 8B (2410) 324 Amazon Nova Lite 1.0 325 Mercury 326 Claude 3 Haiku (20240307) 327 Jamba 1.5 Mini 328 Mistral Large (2402) 329 Phi-4 330 Command R (08-2024) 331 Qwen2.5-Coder-32B-Instruct 332 DeepSeek-Coder-V2 333 Gemini Pro (Dev API) 334 Granite 4.2 3B 335 Granite 4.2 8B 336 WizardLM 70B 337 Amazon Nova Micro 1.0 338 Llama 3 8B Instruct 339 Llama 3.1 Tulu 3 8B 340 Command R 341 Hunyuan Standard 256K 342 Qwen1.5-110B-Chat 343 Mistral Medium 344 GPT-3.5 Turbo (0125) 345 Mixtral 8x22B Instruct v0.1 346 Aya Expanse 8B 347 Qwen1.5-72B-Chat 348 Gemini Pro 349 OpenChat 3.5 350 Gemma 2 2B IT 351 Reka Flash 21B (Online, 20240226) 352 Llama 3.1 8B Instruct 353 Reka Flash 21B (20240226) 354 Vicuna 33B 355 Granite 3.1 8B Instruct 356 Zephyr ORPO 141B A35B v0.1 357 DBRX Instruct Preview 358 Mixtral 8x7B Instruct v0.1 359 Yi 1.5 34B Chat 360 OpenHermes 2.5 Mistral 7B 361 GPT-3.5 Turbo (1106) 362 Yi 34B Chat 363 Falcon 180B Chat 364 Gemma 1.1 7B IT 365 Phi-3 Medium 4K Instruct 366 OpenChat 3.5 (0106) 367 Granite 3.1 2B Instruct 368 Tulu 2 DPO 70B 369 Llama 3.2 3B Instruct 370 Snowflake Arctic Instruct 371 WizardLM 13B 372 SOLAR 10.7B Instruct v1.0 373 Qwen1.5-14B-Chat 374 Granite 3.0 8B Instruct 375 Starling LM 7B Alpha 376 DeepSeek LLM 67B Chat 377 Zephyr 7B Beta 378 Guanaco 33B 379 Dolphin 2.2.1 Mistral 7B 380 Nous Hermes 2 Mixtral 8x7B DPO 381 Phi-3 Small 8K Instruct 382 MPT 30B Chat 383 Qwen1.5-32B-Chat 384 InternLM2.5 20B Chat 385 Vicuna 13B 386 Llama 2 70B SteerLM Chat 387 Llama 2 70B Chat 388 Starling LM 7B Beta 389 Mistral 7B Instruct v0.2 390 QwQ-32B-Preview 391 Qwen-14B-Chat 392 Gemma 7B IT 393 Zephyr 7B Alpha 394 Granite 3.0 2B Instruct 395 Phi-3 Mini 4K Instruct (June 2024) 396 Gemma 1.1 2B IT 397 Alpaca 13B 398 Llama 2 13B Chat 399 Mistral 7B Instruct 400 Vicuna 7B 401 StripedHyena Nous 7B 402 PaLM 2 403 Code Llama 34B Instruct 404 Phi-3 Mini 128K Instruct 405 Llama 3.2 1B Instruct 406 Qwen1.5-7B-Chat 407 SmolLM2 1.7B Instruct 408 Gemma 2B IT 409 Phi-3 Mini 4K Instruct 410 Llama 2 7B Chat 411 GPT4All 13B Snoozy 412 MPT 7B Chat 413 Qwen1.5-4B-Chat 414 Koala 13B 415 ChatGLM3 6B 416 OpenAssistant Pythia 12B 417 RWKV-4 Raven 14B 418 ChatGLM2 6B 419 OLMo 7B Instruct 420 FastChat-T5 3B 421 Dolly 2.0 12B 422 ChatGLM 6B 423 LLaMA 13B 424 StableLM Tuned Alpha 7B