315 models not plottedThese models are on the leaderboard but do not appear on the Pareto chart because they have insufficient cost data. The numbers beside their names show their leaderboard ranks.
24 Claude Opus 4.5 (High, 32K, 20251101) 35 Claude Opus 4.5 (20251101) 40 Gemini 3 Pro 52 Muse Spark 53 Claude Sonnet 4.5 (High, 32K, 20250929) 55 Claude Sonnet 4.5 (20250929) 60 Claude Opus 4.1 (Thinking 16K, 20250805) 61 Gemini 3 Flash 66 Claude Opus 4.1 (20250805) 69 Gemma 4 31B 72 Qwen3.6-Max-Preview 73 GPT-5.1 (High) 78 GLM-5 83 Claude Opus 4 (Thinking 16K, 20250514) 88 Gemini 2.5 Pro 89 Gemma 4 26B A4B 91 GPT-4.5 Preview (2025-02-27) 100 Beam 1.0 501B A23B 101 Kimi K2.5 (Instant) 103 Grok 4.1 104 Grok 4.1 (Thinking) 108 GPT-5.2 (High) 109 ChatGPT-4o Latest (20250326) 110 GPT-5.1 111 GLM-4.7 113 ERNIE 5.0 (0110) 114 Qwen3-Max-Preview 119 DeepSeek-V3.2 121 DeepSeek-V3.2 (Thinking) 122 ERNIE-5.0-Preview (1203) 123 Kimi K2 Thinking Turbo 124 DeepSeek-V3.1-Terminus (Thinking) 125 DeepSeek-V3.1 (Thinking) 126 DeepSeek-V3.2-Exp (Thinking) 127 LongCat-Flash-Chat Exp (2602) 128 Claude Sonnet 4 (Thinking 32K, 20250514) 130 GPT-5 Chat 131 Claude Opus 4 (20250514) 132 amazon-nova-experimental-chat (26-02-10) 133 DeepSeek-V3.2-Exp 135 Qwen3-235B-A22B-Instruct (2507) 136 Qwen3-Max (2025-09-23) 137 GLM-4.6 138 NVIDIA-Nemotron-3.5-Super-VL-120B-A12B (NVFP4) 139 Muse Glimmer 140 Claude 3.7 Sonnet (Thinking 32K, 20250219) 141 GPT-5 (High) 144 Qwen3-VL-235B-A22B-Instruct 146 o1 (2024-12-17) 148 NVIDIA-Nemotron-3-Ultra-550B-A55B (NVFP4) 149 GLM-4.5 150 GPT-4.1 (2025-04-14) 152 o3 (2025-04-16) 153 Grok 3 Preview (02-24) 154 DeepSeek-V3.1 155 Grok 4.1 Fast (Reasoning) 157 Gemini 2.5 Flash Preview (09-2025) 158 Gemini 2.5 Flash 159 ERNIE-5.0-Preview (1022) 160 DeepSeek-R1 161 amazon-nova-experimental-chat (26-01-10) 164 Grok 4 (0709) 165 Claude Sonnet 4 (20250514) 166 Hunyuan Vision 1.5 Thinking 167 Mistral Medium 3.1 (2508) 168 Grok 4 Fast (Non-Reasoning) 169 DeepSeek-V3.1-Terminus 170 DeepSeek-R1 (0528) 171 Kimi K2 Preview (0905) 172 Grok 4 Fast (Reasoning) 174 LongCat-Flash-Chat 176 Qwen3-235B-A22B-Thinking (2507) 177 MiniMax-M2.1 Preview 178 Claude 3.7 Sonnet (20250219) 180 Qwen3-Coder-480B-A35B-Instruct 181 MiMo-V2-Flash (Non-Thinking) 183 Qwen3-VL-235B-A22B-Thinking 184 o1-preview 185 Kimi K2 Preview (0711) 187 Qwen3-235B-A22B (Non-Thinking) 188 DeepSeek-V3 (0324) 190 Qwen3-Next-80B-A3B-Instruct 191 amazon-nova-experimental-chat (12-10) 192 MiMo-V2-Flash (Thinking) 193 Claude 3.5 Sonnet (20241022) 194 Hunyuan T1 (20250711) 195 GPT-4.1 mini (2025-04-14) 196 GPT-5 mini (High) 198 Gemini 2.5 Flash-Lite Preview (Thinking, 06-17) 199 o4-mini (2025-04-16) 200 GLM-4.6V 201 o3-mini (High) 202 Mistral Medium 3 (2505) 203 Qwen3-30B-A3B-Instruct (2507) 204 Gemini 2.5 Flash-Lite Preview (Non-Thinking, 09-2025) 205 GLM-4.5-Air 206 Grok 3 Mini (High) 207 amazon-nova-experimental-chat (11-10) 208 Qwen3-Next-80B-A3B-Thinking 210 Qwen3-235B-A22B 211 Qwen2.5-Max 212 Hunyuan TurboS (20250416) 213 Grok 3 Mini Beta 214 Llama 3.1 Nemotron Ultra 253B v1 215 Hunyuan TurboS (20250226) 216 Gemini 2.0 Flash (001) 217 GLM-4.7-Flash 218 amazon-nova-experimental-chat (10-20) 219 MiniMax-M1 220 Step-3 221 o3-mini 222 Gemma 3 27B IT 223 NVIDIA-Nemotron-3.5-Lightning-30B-A3B (NVFP4) 224 DeepSeek-V3 225 NVIDIA-Nemotron-3-Super-120B-A12B 226 Command A (03-2025) 227 Granite 4.2 30B 228 Gemini 1.5 Pro (002) 229 GLM-4.5V 230 Claude 3.5 Sonnet (20240620) 231 Mistral Small 3.2 (2506) 232 MiniMax-M2 233 INTELLECT-3 234 o1-mini 235 Qwen-Plus (0125) 236 Gemini 2.0 Flash-Lite Preview (02-05) 237 Qwen3-32B 238 Amazon Nova 2 Lite 239 Mercury 2 240 GPT-5 nano (High) 241 GPT-4o (2024-05-13) 242 Llama 3.3 Nemotron Super 49B v1 243 gpt-oss-120b 244 QwQ-32B 245 Llama 3.3 Nemotron Super 49B v1.5 246 Gemma 3 12B IT 247 Olmo 3.1 32B Instruct 248 GPT-4o (2024-08-06) 249 Gemini Advanced (0514) 250 Claude 3.5 Haiku (20241022) 251 Ring-flash-2.0 252 Hunyuan Large (2025-02-10) 253 Ling-flash-2.0 254 Step-2 16K Exp (202412) 255 Llama 3.1 405B Instruct (FP8) 256 GLM-4-Plus (0111) 257 Claude 3 Opus (20240229) 258 Llama 3.1 405B Instruct (BF16) 259 DeepSeek-V2.5 (1210) 260 Llama 4 Maverick 17B 128E Instruct 261 Hunyuan Turbo (0110) 262 amazon-nova-experimental-chat (10-09) 263 Grok 2 (2024-08-13) 264 Gemini 1.5 Pro (001) 265 Qwen3-30B-A3B 266 Yi Lightning 267 Step-1o Turbo (202506) 268 Molmo 2 8B 269 GPT-4 Turbo (2024-04-09) 270 Athene V2 Chat 271 Qwen-Max (0919) 272 GLM-4-Plus 273 Magistral Medium (2506) 274 GPT-4.1 nano (2025-04-14) 275 Mistral Large 2 (2407) 276 Llama 4 Scout 17B 16E Instruct 277 Olmo 3 32B Think 278 GPT-4 Turbo Preview (1106) 279 Mistral Large (2411) 280 Qwen2.5-Plus (1127) 281 GPT-4o mini (2024-07-18) 282 Mistral Small 3.1 24B Instruct (2503) 283 Llama 3.3 70B Instruct 284 Qwen2.5-72B-Instruct 285 DeepSeek-V2.5 286 NVIDIA-Nemotron-3-Nano-30B-A3B (BF16) 287 GPT-4 Turbo Preview (0125) 288 Gemini 1.5 Flash (002) 290 Hunyuan Large Vision 291 GPT-4 (0314) 292 Grok 2 mini (2024-08-13) 293 Granite 4.2 3B 294 Granite 4.2 8B 295 Gemma 3n E4B IT 296 Hunyuan Standard (2025-02-10) 297 gpt-oss-20b 298 Olmo 3.1 32B Think 299 Llama 3.1 Nemotron 70B Instruct 300 Athene 70B (0725) 301 GPT-4 (0613) 302 Amazon Nova Pro 1.0 303 Llama 3.1 70B Instruct 304 Llama 3.1 Tulu 3 70B 305 Gemma 2 27B IT 306 Mercury 307 Granite-4.0-H-Small 308 Claude 3 Sonnet (20240229) 309 Gemma 3 4B IT 310 Jamba 1.5 Large 311 Gemini 1.5 Flash (001) 312 Qwen2.5-Coder-32B-Instruct 313 Llama 3.1 Nemotron 51B Instruct 314 Reka Core (20240904) 315 Nemotron-4 340B Instruct 316 Llama 3 70B Instruct 317 GLM-4 (0520) 318 Mistral Small 24B Instruct (2501) 319 Command R+ (08-2024) 320 DeepSeek-Coder-V2 321 Gemma 2 9B IT SimPO 322 Reka Flash (20240904) 323 Aya Expanse 32B 324 Gemma 2 9B IT 325 Claude 3 Haiku (20240307) 326 Phi-4 327 Amazon Nova Lite 1.0 328 Hunyuan Standard 256K 329 Qwen2-72B-Instruct 330 Command R+ 331 Gemini 1.5 Flash-8B (001) 332 Mistral Large (2402) 333 Command R (08-2024) 334 OLMo 2 32B Instruct (0325) 335 Gemini Pro 336 Qwen1.5-110B-Chat 337 GPT-3.5 Turbo (0125) 338 Mixtral 8x22B Instruct v0.1 339 Amazon Nova Micro 1.0 340 Qwen1.5-72B-Chat 341 Ministral 8B (2410) 342 Gemini Pro (Dev API) 343 Mistral Medium 344 Llama 3.1 Tulu 3 8B 345 Jamba 1.5 Mini 346 Aya Expanse 8B 347 Reka Flash 21B (Online, 20240226) 348 Command R 349 GPT-3.5 Turbo (1106) 350 Zephyr ORPO 141B A35B v0.1 351 Granite 3.1 8B Instruct 352 Llama 3 8B Instruct 353 Reka Flash 21B (20240226) 354 Llama 3.1 8B Instruct 355 Yi 1.5 34B Chat 356 DBRX Instruct Preview 357 Qwen1.5-32B-Chat 358 Mixtral 8x7B Instruct v0.1 359 InternLM2.5 20B Chat 360 Phi-3 Medium 4K Instruct 361 Granite 3.1 2B Instruct 362 Granite 3.0 8B Instruct 363 Gemma 2 2B IT 364 Tulu 2 DPO 70B 365 Qwen1.5-14B-Chat 366 WizardLM 70B 367 DeepSeek LLM 67B Chat 368 Gemma 1.1 7B IT 369 OpenChat 3.5 (0106) 370 OpenChat 3.5 371 Phi-3 Small 8K Instruct 372 Snowflake Arctic Instruct 373 OpenHermes 2.5 Mistral 7B 374 Yi 34B Chat 375 Llama 3.2 3B Instruct 376 Starling LM 7B Beta 377 QwQ-32B-Preview 378 Vicuna 33B 379 Starling LM 7B Alpha 380 MPT 30B Chat 381 Llama 2 70B Chat 382 Falcon 180B Chat 383 Granite 3.0 2B Instruct 384 Dolphin 2.2.1 Mistral 7B 385 Llama 2 70B SteerLM Chat 386 Phi-3 Mini 4K Instruct (June 2024) 387 WizardLM 13B 388 Qwen1.5-7B-Chat 389 Mistral 7B Instruct v0.2 390 Qwen-14B-Chat 391 PaLM 2 392 Vicuna 13B 393 SOLAR 10.7B Instruct v1.0 394 Phi-3 Mini 4K Instruct 395 Llama 2 13B Chat 396 Nous Hermes 2 Mixtral 8x7B DPO 397 Gemma 7B IT 398 Code Llama 34B Instruct 399 SmolLM2 1.7B Instruct 400 Gemma 1.1 2B IT 401 Phi-3 Mini 128K Instruct 402 Zephyr 7B Alpha 403 Code Llama 70B Instruct 404 StripedHyena Nous 7B 405 Zephyr 7B Beta 406 Mistral 7B Instruct 407 Llama 3.2 1B Instruct 408 Vicuna 7B 409 Gemma 2B IT 410 Qwen1.5-4B-Chat 411 Llama 2 7B Chat 412 Guanaco 33B 413 GPT4All 13B Snoozy 414 ChatGLM3 6B 415 OLMo 7B Instruct 416 Koala 13B 417 Alpaca 13B 418 MPT 7B Chat 419 OpenAssistant Pythia 12B 420 ChatGLM2 6B 421 ChatGLM 6B 422 RWKV-4 Raven 14B 423 FastChat-T5 3B 424 Dolly 2.0 12B 425 LLaMA 13B 426 StableLM Tuned Alpha 7B