315 models not plottedThese models are on the leaderboard but do not appear on the Pareto chart because they have insufficient cost data. The numbers beside their names show their leaderboard ranks.
19 Muse Spark 24 Gemini 3 Pro 45 Claude Opus 4.5 (High, 32K, 20251101) 48 Gemini 3 Flash 52 Claude Opus 4.5 (20251101) 58 Grok 4.1 (Thinking) 64 Qwen3.6-Max-Preview 65 Grok 4.1 69 GLM-5 72 Claude Sonnet 4.5 (High, 32K, 20250929) 73 GPT-5.1 (High) 76 Claude Sonnet 4.5 (20250929) 80 Gemma 4 31B 82 Claude Opus 4.1 (Thinking 16K, 20250805) 84 ERNIE-5.0-Preview (1203) 87 Claude Opus 4.1 (20250805) 90 ERNIE 5.0 (0110) 91 Gemini 2.5 Pro 92 GPT-4.5 Preview (2025-02-27) 95 ChatGPT-4o Latest (20250326) 100 GLM-4.7 102 GPT-5.1 103 Gemma 4 26B A4B 104 GPT-5.2 (High) 105 LongCat-Flash-Chat Exp (2602) 108 GPT-5 (High) 110 Qwen3-Max-Preview 111 Beam 1.0 501B A23B 115 o3 (2025-04-16) 116 Kimi K2.5 (Instant) 117 Grok 4.1 Fast (Reasoning) 119 Kimi K2 Thinking Turbo 120 GPT-5 Chat 121 amazon-nova-experimental-chat (26-02-10) 122 NVIDIA-Nemotron-3-Ultra-550B-A55B (NVFP4) 124 Claude Opus 4 (Thinking 16K, 20250514) 125 DeepSeek-V3.2-Exp (Thinking) 126 Muse Glimmer 127 DeepSeek-V3.2 128 GLM-4.6 129 Qwen3-Max (2025-09-23) 130 DeepSeek-V3.2 (Thinking) 131 Qwen3-235B-A22B-Instruct (2507) 132 DeepSeek-V3.2-Exp 135 DeepSeek-R1 (0528) 136 Kimi K2 Preview (0905) 137 Grok 4 Fast (Non-Reasoning) 138 ERNIE-5.0-Preview (1022) 139 Kimi K2 Preview (0711) 140 DeepSeek-V3.1 142 DeepSeek-V3.1-Terminus (Thinking) 143 DeepSeek-V3.1 (Thinking) 144 NVIDIA-Nemotron-3.5-Super-VL-120B-A12B (NVFP4) 145 DeepSeek-V3.1-Terminus 148 GPT-4.1 (2025-04-14) 149 Claude Opus 4 (20250514) 151 Qwen3-VL-235B-A22B-Instruct 153 amazon-nova-experimental-chat (26-01-10) 154 Grok 3 Preview (02-24) 155 GLM-4.5 156 Grok 4 (0709) 157 Gemini 2.5 Flash 160 Mistral Medium 3.1 (2508) 161 Grok 4 Fast (Reasoning) 163 Gemini 2.5 Flash Preview (09-2025) 164 o1 (2024-12-17) 165 Qwen3-235B-A22B (Non-Thinking) 166 Claude Sonnet 4 (Thinking 32K, 20250514) 168 LongCat-Flash-Chat 169 Qwen3-235B-A22B-Thinking (2507) 170 Qwen3-Next-80B-A3B-Instruct 171 DeepSeek-R1 173 DeepSeek-V3 (0324) 174 Qwen3-VL-235B-A22B-Thinking 175 Hunyuan Vision 1.5 Thinking 178 amazon-nova-experimental-chat (12-10) 179 MiMo-V2-Flash (Non-Thinking) 180 o4-mini (2025-04-16) 182 Claude Sonnet 4 (20250514) 183 GPT-5 mini (High) 184 o1-preview 185 Claude 3.7 Sonnet (Thinking 32K, 20250219) 187 Qwen3-Coder-480B-A35B-Instruct 188 Mistral Medium 3 (2505) 189 Hunyuan T1 (20250711) 190 MiMo-V2-Flash (Thinking) 191 MiniMax-M2.1 Preview 192 Hunyuan TurboS (20250416) 193 GPT-4.1 mini (2025-04-14) 194 Qwen3-30B-A3B-Instruct (2507) 195 Gemini 2.5 Flash-Lite Preview (Non-Thinking, 09-2025) 197 GLM-4.6V 198 Gemini 2.5 Flash-Lite Preview (Thinking, 06-17) 199 Qwen3-235B-A22B 200 Claude 3.5 Sonnet (20241022) 201 Qwen2.5-Max 202 GLM-4.5-Air 203 Claude 3.7 Sonnet (20250219) 204 Qwen3-Next-80B-A3B-Thinking 206 Gemma 3 27B IT 207 GLM-4.7-Flash 208 MiniMax-M1 209 Grok 3 Mini (High) 210 o3-mini (High) 211 amazon-nova-experimental-chat (11-10) 212 Gemini 2.0 Flash (001) 213 NVIDIA-Nemotron-3-Super-120B-A12B 214 DeepSeek-V3 215 Grok 3 Mini Beta 216 Mistral Small 3.2 (2506) 217 INTELLECT-3 218 Command A (03-2025) 219 Gemini 2.0 Flash-Lite Preview (02-05) 220 GLM-4.5V 221 gpt-oss-120b 222 NVIDIA-Nemotron-3.5-Lightning-30B-A3B (NVFP4) 223 Gemini 1.5 Pro (002) 224 Hunyuan TurboS (20250226) 225 Step-3 226 o3-mini 227 amazon-nova-experimental-chat (10-20) 228 Llama 3.1 Nemotron Ultra 253B v1 229 Qwen3-32B 230 amazon-nova-experimental-chat (10-09) 231 GPT-4o (2024-05-13) 232 Qwen-Plus (0125) 233 MiniMax-M2 234 Claude 3.5 Sonnet (20240620) 235 Ling-flash-2.0 236 Llama 3.3 Nemotron Super 49B v1.5 237 Mercury 2 238 GLM-4-Plus (0111) 239 Gemma 3 12B IT 240 Hunyuan Turbo (0110) 241 Granite 4.2 30B 242 GPT-5 nano (High) 243 o1-mini 244 Gemini Advanced (0514) 245 Grok 2 (2024-08-13) 246 GPT-4o (2024-08-06) 247 Llama 3.1 405B Instruct (BF16) 248 QwQ-32B 249 Amazon Nova 2 Lite 250 Llama 3.1 405B Instruct (FP8) 251 Step-2 16K Exp (202412) 252 Olmo 3.1 32B Instruct 253 Yi Lightning 254 Llama 3.3 Nemotron Super 49B v1 255 Llama 4 Maverick 17B 128E Instruct 256 Qwen3-30B-A3B 257 Hunyuan Large (2025-02-10) 258 Claude 3.5 Haiku (20241022) 259 GPT-4 Turbo (2024-04-09) 260 Gemini 1.5 Pro (001) 261 DeepSeek-V2.5 (1210) 262 Ring-flash-2.0 263 Claude 3 Opus (20240229) 264 GPT-4.1 nano (2025-04-14) 265 Llama 4 Scout 17B 16E Instruct 266 Molmo 2 8B 267 Step-1o Turbo (202506) 268 GLM-4-Plus 269 Qwen-Max (0919) 270 Llama 3.3 70B Instruct 271 Gemma 3n E4B IT 272 GPT-4o mini (2024-07-18) 273 gpt-oss-20b 274 Qwen2.5-Plus (1127) 275 Mistral Large 2 (2407) 276 Athene V2 Chat 277 NVIDIA-Nemotron-3-Nano-30B-A3B (BF16) 278 GPT-4 Turbo Preview (0125) 279 GPT-4 Turbo Preview (1106) 280 Hunyuan Standard (2025-02-10) 281 Gemini 1.5 Flash (002) 282 Grok 2 mini (2024-08-13) 283 DeepSeek-V2.5 284 Athene 70B (0725) 285 Olmo 3 32B Think 286 Mistral Large (2411) 287 Mercury 288 Magistral Medium (2506) 290 Gemma 3 4B IT 291 Qwen2.5-72B-Instruct 292 Mistral Small 3.1 24B Instruct (2503) 293 Llama 3.1 Nemotron 70B Instruct 294 Hunyuan Large Vision 295 Llama 3.1 70B Instruct 296 Amazon Nova Pro 1.0 297 Granite 4.2 8B 298 Gemma 2 27B IT 299 Jamba 1.5 Large 300 Granite 4.2 3B 301 Reka Core (20240904) 302 GPT-4 (0314) 303 Granite-4.0-H-Small 304 Llama 3.1 Nemotron 51B Instruct 305 Gemini 1.5 Flash (001) 306 Llama 3.1 Tulu 3 70B 307 Olmo 3.1 32B Think 308 Claude 3 Sonnet (20240229) 309 Gemma 2 9B IT SimPO 310 Nemotron-4 340B Instruct 311 Llama 3 70B Instruct 312 Command R+ (08-2024) 313 GPT-4 (0613) 314 Mistral Small 24B Instruct (2501) 315 GLM-4 (0520) 316 Reka Flash (20240904) 317 Qwen2.5-Coder-32B-Instruct 318 Aya Expanse 32B 319 Gemma 2 9B IT 320 DeepSeek-Coder-V2 321 Qwen2-72B-Instruct 322 Command R+ 323 Claude 3 Haiku (20240307) 324 Amazon Nova Lite 1.0 325 Gemini 1.5 Flash-8B (001) 326 Phi-4 327 OLMo 2 32B Instruct (0325) 328 Command R (08-2024) 329 Mistral Large (2402) 330 Amazon Nova Micro 1.0 331 Jamba 1.5 Mini 332 Ministral 8B (2410) 333 Gemini Pro (Dev API) 334 Qwen1.5-110B-Chat 335 Reka Flash 21B (Online, 20240226) 336 Qwen1.5-72B-Chat 337 Hunyuan Standard 256K 338 Mixtral 8x22B Instruct v0.1 339 Command R 340 Reka Flash 21B (20240226) 341 GPT-3.5 Turbo (0125) 342 Gemini Pro 343 Llama 3 8B Instruct 344 Aya Expanse 8B 345 Mistral Medium 346 Llama 3.1 Tulu 3 8B 347 Zephyr ORPO 141B A35B v0.1 348 Yi 1.5 34B Chat 349 Llama 3.1 8B Instruct 350 Granite 3.1 8B Instruct 351 GPT-3.5 Turbo (1106) 352 Qwen1.5-32B-Chat 353 Gemma 2 2B IT 354 Phi-3 Medium 4K Instruct 355 Mixtral 8x7B Instruct v0.1 356 DBRX Instruct Preview 357 Qwen1.5-14B-Chat 358 InternLM2.5 20B Chat 359 DeepSeek LLM 67B Chat 360 WizardLM 70B 361 Yi 34B Chat 362 Granite 3.0 8B Instruct 363 OpenChat 3.5 364 OpenChat 3.5 (0106) 365 Gemma 1.1 7B IT 366 Snowflake Arctic Instruct 367 Granite 3.1 2B Instruct 368 Tulu 2 DPO 70B 369 OpenHermes 2.5 Mistral 7B 370 Vicuna 33B 371 Phi-3 Small 8K Instruct 372 Starling LM 7B Beta 373 Llama 2 70B Chat 374 Starling LM 7B Alpha 375 Llama 3.2 3B Instruct 376 Nous Hermes 2 Mixtral 8x7B DPO 377 Granite 3.0 2B Instruct 378 Llama 2 70B SteerLM Chat 379 QwQ-32B-Preview 380 SOLAR 10.7B Instruct v1.0 381 Dolphin 2.2.1 Mistral 7B 382 MPT 30B Chat 383 WizardLM 13B 384 Mistral 7B Instruct v0.2 385 Falcon 180B Chat 386 Qwen1.5-7B-Chat 387 Phi-3 Mini 4K Instruct (June 2024) 388 Vicuna 13B 389 Llama 2 13B Chat 390 Qwen-14B-Chat 391 PaLM 2 392 Gemma 7B IT 393 Code Llama 34B Instruct 394 Zephyr 7B Beta 395 Phi-3 Mini 128K Instruct 396 Phi-3 Mini 4K Instruct 397 Guanaco 33B 398 Zephyr 7B Alpha 399 StripedHyena Nous 7B 400 Code Llama 70B Instruct 401 Gemma 1.1 2B IT 402 Vicuna 7B 403 SmolLM2 1.7B Instruct 404 Llama 3.2 1B Instruct 405 Mistral 7B Instruct 406 Llama 2 7B Chat 407 Gemma 2B IT 408 Qwen1.5-4B-Chat 409 OLMo 7B Instruct 410 Koala 13B 411 Alpaca 13B 412 GPT4All 13B Snoozy 413 MPT 7B Chat 414 ChatGLM3 6B 415 RWKV-4 Raven 14B 416 ChatGLM2 6B 417 OpenAssistant Pythia 12B 418 ChatGLM 6B 419 FastChat-T5 3B 420 Dolly 2.0 12B 421 LLaMA 13B 422 StableLM Tuned Alpha 7B