310 models not plottedThese models are on the leaderboard but do not appear on the Pareto chart because they have insufficient cost data. The numbers beside their names show their leaderboard ranks.
24 Claude Opus 4.5 (High, 32K, 20251101) 26 Muse Spark 37 Claude Opus 4.5 (20251101) 44 Claude Sonnet 4.5 (High, 32K, 20250929) 48 Gemini 3 Pro 58 Claude Sonnet 4.5 (20250929) 62 Claude Opus 4.1 (Thinking 16K, 20250805) 64 Qwen3.6-Max-Preview 73 Gemini 3 Flash 74 Beam 1.0 501B A23B 75 Kimi K2.5 (Instant) 76 Claude Opus 4.1 (20250805) 83 Gemma 4 31B 87 LongCat-Flash-Chat Exp (2602) 89 Grok 4.1 (Thinking) 90 GLM-5 91 Claude Opus 4 (Thinking 16K, 20250514) 97 Grok 4.1 99 GPT-5.1 (High) 104 ERNIE 5.0 (0110) 105 GPT-5.2 (High) 110 Kimi K2 Thinking Turbo 111 amazon-nova-experimental-chat (26-02-10) 114 GLM-4.7 116 Gemma 4 26B A4B 119 amazon-nova-experimental-chat (26-01-10) 120 Muse Glimmer 121 Qwen3-Max-Preview 125 DeepSeek-V3.2 (Thinking) 126 GPT-5.1 127 DeepSeek-V3.2-Exp (Thinking) 128 Claude Sonnet 4 (Thinking 32K, 20250514) 129 NVIDIA-Nemotron-3-Ultra-550B-A55B (NVFP4) 130 Qwen3-Max (2025-09-23) 132 Qwen3-235B-A22B-Instruct (2507) 133 LongCat-Flash-Chat 134 GPT-5 (High) 136 ERNIE-5.0-Preview (1203) 137 DeepSeek-V3.2 138 Kimi K2 Preview (0905) 139 DeepSeek-V3.2-Exp 140 ChatGPT-4o Latest (20250326) 141 Claude Opus 4 (20250514) 142 Gemini 2.5 Pro 143 DeepSeek-R1 (0528) 144 Qwen3-VL-235B-A22B-Instruct 145 GPT-5 Chat 146 Grok 4.1 Fast (Reasoning) 148 o3 (2025-04-16) 149 NVIDIA-Nemotron-3.5-Super-VL-120B-A12B (NVFP4) 150 DeepSeek-V3.1-Terminus (Thinking) 152 Kimi K2 Preview (0711) 154 GLM-4.6 155 GPT-4.5 Preview (2025-02-27) 157 Grok 4 Fast (Non-Reasoning) 158 Qwen3-Coder-480B-A35B-Instruct 159 GPT-4.1 (2025-04-14) 160 DeepSeek-V3.1 (Thinking) 161 GLM-4.5 162 Mistral Medium 3.1 (2508) 164 Claude 3.7 Sonnet (Thinking 32K, 20250219) 165 Qwen3-VL-235B-A22B-Thinking 167 Claude Sonnet 4 (20250514) 169 DeepSeek-V3.1 170 MiMo-V2-Flash (Non-Thinking) 172 Qwen3-235B-A22B (Non-Thinking) 173 Qwen3-Next-80B-A3B-Instruct 174 DeepSeek-R1 176 Grok 3 Preview (02-24) 177 Qwen3-235B-A22B-Thinking (2507) 178 DeepSeek-V3.1-Terminus 179 Grok 4 Fast (Reasoning) 180 Qwen3-30B-A3B-Instruct (2507) 181 MiniMax-M2.1 Preview 182 Hunyuan Vision 1.5 Thinking 183 Claude 3.5 Sonnet (20241022) 184 amazon-nova-experimental-chat (12-10) 186 Grok 4 (0709) 188 o3-mini (High) 189 o4-mini (2025-04-16) 190 GPT-4.1 mini (2025-04-14) 191 o1 (2024-12-17) 192 GPT-5 mini (High) 193 Mistral Medium 3 (2505) 194 MiMo-V2-Flash (Thinking) 195 Claude 3.7 Sonnet (20250219) 196 Qwen3-235B-A22B 197 ERNIE-5.0-Preview (1022) 198 NVIDIA-Nemotron-3.5-Lightning-30B-A3B (NVFP4) 199 DeepSeek-V3 (0324) 200 Gemini 2.5 Flash Preview (09-2025) 201 GLM-4.5-Air 202 Gemini 2.5 Flash 203 GLM-4.7-Flash 204 Qwen3-Next-80B-A3B-Thinking 205 amazon-nova-experimental-chat (11-10) 206 GLM-4.6V 207 o3-mini 208 MiniMax-M1 209 o1-preview 210 INTELLECT-3 212 Mistral Small 3.2 (2506) 213 amazon-nova-experimental-chat (10-20) 214 Step-3 215 Ling-flash-2.0 216 NVIDIA-Nemotron-3-Super-120B-A12B 217 Qwen3-32B 218 Llama 3.3 Nemotron Super 49B v1.5 219 GLM-4.5V 220 Qwen2.5-Max 221 Hunyuan T1 (20250711) 222 Claude 3.5 Sonnet (20240620) 223 Hunyuan TurboS (20250226) 224 Gemini 2.5 Flash-Lite Preview (Non-Thinking, 09-2025) 225 Granite 4.2 30B 226 Hunyuan TurboS (20250416) 227 Amazon Nova 2 Lite 228 Mercury 2 229 Grok 3 Mini (High) 230 amazon-nova-experimental-chat (10-09) 231 Llama 3.1 Nemotron Ultra 253B v1 232 Ring-flash-2.0 233 gpt-oss-120b 234 Command A (03-2025) 235 Magistral Medium (2506) 236 DeepSeek-V3 237 Grok 3 Mini Beta 238 GPT-5 nano (High) 239 o1-mini 240 Claude 3.5 Haiku (20241022) 241 Qwen3-30B-A3B 242 MiniMax-M2 243 Gemini 2.5 Flash-Lite Preview (Thinking, 06-17) 244 QwQ-32B 245 Olmo 3.1 32B Instruct 246 Qwen-Plus (0125) 247 Llama 3.1 405B Instruct (BF16) 248 Granite 4.2 3B 249 DeepSeek-V2.5 (1210) 250 GPT-4.1 nano (2025-04-14) 251 Llama 4 Maverick 17B 128E Instruct 252 Step-2 16K Exp (202412) 253 Hunyuan Turbo (0110) 254 Llama 3.1 405B Instruct (FP8) 255 GPT-4o (2024-05-13) 256 Athene V2 Chat 257 Yi Lightning 258 gpt-oss-20b 259 Granite 4.2 8B 260 DeepSeek-V2.5 261 Hunyuan Large (2025-02-10) 262 Mercury 263 Gemini 2.0 Flash (001) 264 Llama 4 Scout 17B 16E Instruct 265 Llama 3.3 Nemotron Super 49B v1 266 NVIDIA-Nemotron-3-Nano-30B-A3B (BF16) 267 Mistral Small 3.1 24B Instruct (2503) 268 GPT-4o (2024-08-06) 269 Olmo 3 32B Think 270 Hunyuan Large Vision 271 Gemma 3 27B IT 272 Grok 2 (2024-08-13) 273 Qwen2.5-Plus (1127) 274 Gemini 1.5 Pro (002) 275 Claude 3 Opus (20240229) 276 Qwen2.5-72B-Instruct 278 Mistral Large 2 (2407) 279 Qwen-Max (0919) 280 GLM-4-Plus 281 Step-1o Turbo (202506) 282 Athene 70B (0725) 283 GPT-4o mini (2024-07-18) 284 GPT-4 Turbo (2024-04-09) 285 Gemini 1.5 Pro (001) 286 Llama 3.3 70B Instruct 287 Mistral Large (2411) 288 Amazon Nova Pro 1.0 289 Gemini 2.0 Flash-Lite Preview (02-05) 290 DeepSeek-Coder-V2 291 Qwen2.5-Coder-32B-Instruct 292 GPT-4 Turbo Preview (1106) 293 Olmo 3.1 32B Think 294 Gemini Advanced (0514) 295 Grok 2 mini (2024-08-13) 296 Llama 3.1 70B Instruct 297 GPT-4 Turbo Preview (0125) 298 Hunyuan Standard (2025-02-10) 299 GLM-4-Plus (0111) 300 Granite-4.0-H-Small 301 GPT-4 (0314) 302 Llama 3.1 Nemotron 70B Instruct 303 Claude 3 Sonnet (20240229) 304 Gemini 1.5 Flash (002) 305 Gemma 3 12B IT 306 Reka Core (20240904) 307 GPT-4 (0613) 308 Llama 3.1 Nemotron 51B Instruct 309 Mistral Small 24B Instruct (2501) 310 Jamba 1.5 Large 311 GLM-4 (0520) 312 Nemotron-4 340B Instruct 313 Gemini 1.5 Flash (001) 314 Llama 3.1 Tulu 3 70B 315 Gemma 3n E4B IT 316 Llama 3 70B Instruct 317 Phi-4 318 Amazon Nova Lite 1.0 319 Gemma 2 27B IT 320 Claude 3 Haiku (20240307) 321 Hunyuan Standard 256K 322 Qwen2-72B-Instruct 323 Mistral Large (2402) 324 Aya Expanse 32B 325 Reka Flash (20240904) 326 Amazon Nova Micro 1.0 327 Granite 3.1 8B Instruct 328 Command R (08-2024) 329 Command R+ (08-2024) 330 Qwen1.5-110B-Chat 331 OLMo 2 32B Instruct (0325) 332 Reka Flash 21B (Online, 20240226) 333 Mixtral 8x22B Instruct v0.1 334 Qwen1.5-72B-Chat 335 GPT-3.5 Turbo (0125) 336 Ministral 8B (2410) 337 Gemma 3 4B IT 338 Command R+ 339 Gemini 1.5 Flash-8B (001) 340 Gemma 2 9B IT SimPO 341 Gemma 2 9B IT 342 Reka Flash 21B (20240226) 343 Jamba 1.5 Mini 344 Mistral Medium 345 Qwen1.5-32B-Chat 346 GPT-3.5 Turbo (1106) 347 Llama 3.1 8B Instruct 348 Aya Expanse 8B 349 Llama 3 8B Instruct 350 Llama 3.1 Tulu 3 8B 351 DBRX Instruct Preview 352 Granite 3.1 2B Instruct 353 InternLM2.5 20B Chat 354 Yi 1.5 34B Chat 355 Gemini Pro 356 Zephyr ORPO 141B A35B v0.1 357 Command R 358 Granite 3.0 8B Instruct 359 Qwen1.5-14B-Chat 360 Mixtral 8x7B Instruct v0.1 361 Gemini Pro (Dev API) 362 Starling LM 7B Beta 363 Phi-3 Medium 4K Instruct 364 OpenChat 3.5 (0106) 365 Snowflake Arctic Instruct 366 DeepSeek LLM 67B Chat 367 Gemma 1.1 7B IT 368 Tulu 2 DPO 70B 369 Qwen1.5-7B-Chat 370 Granite 3.0 2B Instruct 371 Starling LM 7B Alpha 372 Yi 34B Chat 373 Phi-3 Small 8K Instruct 374 OpenChat 3.5 375 Qwen-14B-Chat 376 Phi-3 Mini 4K Instruct (June 2024) 377 Vicuna 33B 378 WizardLM 70B 379 Gemma 2 2B IT 380 Phi-3 Mini 4K Instruct 381 OpenHermes 2.5 Mistral 7B 382 Mistral 7B Instruct v0.2 383 SOLAR 10.7B Instruct v1.0 384 Llama 2 70B Chat 385 Llama 3.2 3B Instruct 386 Nous Hermes 2 Mixtral 8x7B DPO 387 QwQ-32B-Preview 388 Gemma 1.1 2B IT 389 MPT 30B Chat 390 Zephyr 7B Alpha 391 Gemma 7B IT 392 Vicuna 13B 393 Llama 2 13B Chat 394 SmolLM2 1.7B Instruct 395 Code Llama 34B Instruct 396 Phi-3 Mini 128K Instruct 397 PaLM 2 398 Zephyr 7B Beta 399 WizardLM 13B 400 Llama 3.2 1B Instruct 401 Llama 2 70B SteerLM Chat 402 Mistral 7B Instruct 403 Gemma 2B IT 404 Vicuna 7B 405 Qwen1.5-4B-Chat 406 StripedHyena Nous 7B 407 Guanaco 33B 408 OLMo 7B Instruct 409 Llama 2 7B Chat 410 ChatGLM3 6B 411 Koala 13B 412 MPT 7B Chat 413 RWKV-4 Raven 14B 414 OpenAssistant Pythia 12B 415 ChatGLM 6B 416 ChatGLM2 6B 417 StableLM Tuned Alpha 7B 418 Alpaca 13B 419 Dolly 2.0 12B 420 FastChat-T5 3B 421 LLaMA 13B