These models are on the leaderboard but do not appear on the Pareto chart because they have insufficient cost data. The numbers beside their names show their leaderboard ranks.
17 Muse Spark 21 Gemini 3 Pro 43 Claude Opus 4.5 (High, 32K, 20251101) 45 Gemini 3 Flash 50 Claude Opus 4.5 (20251101) 55 Grok 4.1 (Thinking) 62 Qwen3.6-Max-Preview 63 Grok 4.1 66 GLM-5 70 Claude Sonnet 4.5 (High, 32K, 20250929) 71 GPT-5.1 (High) 73 Claude Sonnet 4.5 (20250929) 78 Gemma 4 31B 80 Claude Opus 4.1 (Thinking 16K, 20250805) 82 ERNIE-5.0-Preview (1203) 85 Claude Opus 4.1 (20250805) 88 ERNIE 5.0 (0110) 89 Gemini 2.5 Pro 90 GPT-4.5 Preview (2025-02-27) 93 ChatGPT-4o Latest (20250326) 97 GLM-4.7 100 GPT-5.1 101 Gemma 4 26B A4B 102 GPT-5.2 (High) 103 LongCat-Flash-Chat Exp (2602) 107 GPT-5 (High) 108 Beam 1.0 501B A23B 109 Qwen3-Max-Preview 114 o3 (2025-04-16) 115 Kimi K2.5 (Instant) 116 Grok 4.1 Fast (Reasoning) 118 Kimi K2 Thinking Turbo 119 GPT-5 Chat 120 amazon-nova-experimental-chat (26-02-10) 122 NVIDIA-Nemotron-3-Ultra-550B-A55B (NVFP4) 123 Claude Opus 4 (Thinking 16K, 20250514) 124 DeepSeek-V3.2-Exp (Thinking) 125 DeepSeek-V3.2 126 Muse Glimmer 127 GLM-4.6 128 Qwen3-Max (2025-09-23) 130 DeepSeek-V3.2 (Thinking) 132 Qwen3-235B-A22B-Instruct (2507) 133 DeepSeek-V3.2-Exp 134 DeepSeek-R1 (0528) 135 Grok 4 Fast (Non-Reasoning) 136 Kimi K2 Preview (0905) 137 ERNIE-5.0-Preview (1022) 138 Kimi K2 Preview (0711) 139 DeepSeek-V3.1 141 DeepSeek-V3.1-Terminus (Thinking) 142 DeepSeek-V3.1 (Thinking) 143 NVIDIA-Nemotron-3.5-Super-VL-120B-A12B (NVFP4) 145 DeepSeek-V3.1-Terminus 147 GPT-4.1 (2025-04-14) 148 Claude Opus 4 (20250514) 150 Qwen3-VL-235B-A22B-Instruct 152 amazon-nova-experimental-chat (26-01-10) 153 Grok 3 Preview (02-24) 154 GLM-4.5 155 Grok 4 (0709) 156 Gemini 2.5 Flash 159 Mistral Medium 3.1 (2508) 161 Grok 4 Fast (Reasoning) 162 Gemini 2.5 Flash Preview (09-2025) 163 o1 (2024-12-17) 164 Qwen3-235B-A22B (Non-Thinking) 165 Claude Sonnet 4 (Thinking 32K, 20250514) 167 LongCat-Flash-Chat 168 Qwen3-235B-A22B-Thinking (2507) 169 Qwen3-Next-80B-A3B-Instruct 170 DeepSeek-R1 172 DeepSeek-V3 (0324) 173 Qwen3-VL-235B-A22B-Thinking 174 Hunyuan Vision 1.5 Thinking 177 amazon-nova-experimental-chat (12-10) 178 MiMo-V2-Flash (Non-Thinking) 179 Claude Sonnet 4 (20250514) 180 o4-mini (2025-04-16) 182 GPT-5 mini (High) 183 o1-preview 184 Claude 3.7 Sonnet (Thinking 32K, 20250219) 185 Qwen3-Coder-480B-A35B-Instruct 187 Hunyuan T1 (20250711) 188 Mistral Medium 3 (2505) 189 MiMo-V2-Flash (Thinking) 190 MiniMax-M2.1 Preview 191 Hunyuan TurboS (20250416) 192 GPT-4.1 mini (2025-04-14) 193 Qwen3-30B-A3B-Instruct (2507) 194 Gemini 2.5 Flash-Lite Preview (Non-Thinking, 09-2025) 196 GLM-4.6V 197 Gemini 2.5 Flash-Lite Preview (Thinking, 06-17) 198 Qwen3-235B-A22B 199 Claude 3.5 Sonnet (20241022) 200 Qwen2.5-Max 201 GLM-4.5-Air 202 Claude 3.7 Sonnet (20250219) 203 Qwen3-Next-80B-A3B-Thinking 205 Gemma 3 27B IT 206 GLM-4.7-Flash 207 MiniMax-M1 208 Grok 3 Mini (High) 209 o3-mini (High) 210 amazon-nova-experimental-chat (11-10) 211 Gemini 2.0 Flash (001) 212 NVIDIA-Nemotron-3-Super-120B-A12B 213 DeepSeek-V3 214 Grok 3 Mini Beta 215 Mistral Small 3.2 (2506) 216 INTELLECT-3 217 Command A (03-2025) 218 Gemini 2.0 Flash-Lite Preview (02-05) 219 GLM-4.5V 220 gpt-oss-120b 221 NVIDIA-Nemotron-3.5-Lightning-30B-A3B (NVFP4) 222 Gemini 1.5 Pro (002) 223 Hunyuan TurboS (20250226) 224 Step-3 225 amazon-nova-experimental-chat (10-20) 226 o3-mini 227 Llama 3.1 Nemotron Ultra 253B v1 228 Qwen3-32B 229 GPT-4o (2024-05-13) 230 amazon-nova-experimental-chat (10-09) 231 Qwen-Plus (0125) 232 MiniMax-M2 233 Claude 3.5 Sonnet (20240620) 234 Llama 3.3 Nemotron Super 49B v1.5 235 Ling-flash-2.0 236 Mercury 2 237 GLM-4-Plus (0111) 238 Gemma 3 12B IT 239 Hunyuan Turbo (0110) 240 Granite 4.2 30B 241 GPT-5 nano (High) 242 o1-mini 243 Gemini Advanced (0514) 244 Grok 2 (2024-08-13) 245 GPT-4o (2024-08-06) 246 QwQ-32B 247 Llama 3.1 405B Instruct (BF16) 248 Amazon Nova 2 Lite 249 Llama 3.1 405B Instruct (FP8) 250 Step-2 16K Exp (202412) 251 Olmo 3.1 32B Instruct 252 Yi Lightning 253 Llama 3.3 Nemotron Super 49B v1 254 Llama 4 Maverick 17B 128E Instruct 255 Qwen3-30B-A3B 256 Hunyuan Large (2025-02-10) 257 Claude 3.5 Haiku (20241022) 258 GPT-4 Turbo (2024-04-09) 259 Gemini 1.5 Pro (001) 260 DeepSeek-V2.5 (1210) 261 Ring-flash-2.0 262 GPT-4.1 nano (2025-04-14) 263 Claude 3 Opus (20240229) 264 Llama 4 Scout 17B 16E Instruct 265 Molmo 2 8B 266 Step-1o Turbo (202506) 267 GLM-4-Plus 268 Qwen-Max (0919) 269 Llama 3.3 70B Instruct 270 GPT-4o mini (2024-07-18) 271 gpt-oss-20b 272 Gemma 3n E4B IT 273 Qwen2.5-Plus (1127) 274 Mistral Large 2 (2407) 275 Athene V2 Chat 276 NVIDIA-Nemotron-3-Nano-30B-A3B (BF16) 277 GPT-4 Turbo Preview (0125) 278 GPT-4 Turbo Preview (1106) 279 Hunyuan Standard (2025-02-10) 280 Gemini 1.5 Flash (002) 281 Grok 2 mini (2024-08-13) 282 DeepSeek-V2.5 283 Athene 70B (0725) 284 Olmo 3 32B Think 285 Mistral Large (2411) 286 Mercury 287 Magistral Medium (2506) 289 Gemma 3 4B IT 290 Qwen2.5-72B-Instruct 291 Mistral Small 3.1 24B Instruct (2503) 292 Llama 3.1 Nemotron 70B Instruct 293 Hunyuan Large Vision 294 Llama 3.1 70B Instruct 295 Amazon Nova Pro 1.0 296 Gemma 2 27B IT 297 Granite 4.2 8B 298 Jamba 1.5 Large 299 Granite 4.2 3B 300 Reka Core (20240904) 301 GPT-4 (0314) 302 Granite-4.0-H-Small 303 Llama 3.1 Nemotron 51B Instruct 304 Gemini 1.5 Flash (001) 305 Llama 3.1 Tulu 3 70B 306 Olmo 3.1 32B Think 307 Claude 3 Sonnet (20240229) 308 Gemma 2 9B IT SimPO 309 Nemotron-4 340B Instruct 310 Llama 3 70B Instruct 311 GPT-4 (0613) 312 Command R+ (08-2024) 313 Mistral Small 24B Instruct (2501) 314 GLM-4 (0520) 315 Reka Flash (20240904) 316 Qwen2.5-Coder-32B-Instruct 317 Aya Expanse 32B 318 Gemma 2 9B IT 319 DeepSeek-Coder-V2 320 Qwen2-72B-Instruct 321 Command R+ 322 Claude 3 Haiku (20240307) 323 Amazon Nova Lite 1.0 324 Gemini 1.5 Flash-8B (001) 325 Phi-4 326 OLMo 2 32B Instruct (0325) 327 Command R (08-2024) 328 Mistral Large (2402) 329 Amazon Nova Micro 1.0 330 Jamba 1.5 Mini 331 Ministral 8B (2410) 332 Gemini Pro (Dev API) 333 Qwen1.5-110B-Chat 334 Reka Flash 21B (Online, 20240226) 335 Qwen1.5-72B-Chat 336 Hunyuan Standard 256K 337 Mixtral 8x22B Instruct v0.1 338 Command R 339 Reka Flash 21B (20240226) 340 GPT-3.5 Turbo (0125) 341 Gemini Pro 342 Llama 3 8B Instruct 343 Aya Expanse 8B 344 Mistral Medium 345 Llama 3.1 Tulu 3 8B 346 Zephyr ORPO 141B A35B v0.1 347 Yi 1.5 34B Chat 348 Llama 3.1 8B Instruct 349 Granite 3.1 8B Instruct 350 GPT-3.5 Turbo (1106) 351 Qwen1.5-32B-Chat 352 Gemma 2 2B IT 353 Phi-3 Medium 4K Instruct 354 Mixtral 8x7B Instruct v0.1 355 DBRX Instruct Preview 356 Qwen1.5-14B-Chat 357 InternLM2.5 20B Chat 358 DeepSeek LLM 67B Chat 359 WizardLM 70B 360 Yi 34B Chat 361 Granite 3.0 8B Instruct 362 OpenChat 3.5 363 OpenChat 3.5 (0106) 364 Gemma 1.1 7B IT 365 Snowflake Arctic Instruct 366 Granite 3.1 2B Instruct 367 Tulu 2 DPO 70B 368 OpenHermes 2.5 Mistral 7B 369 Vicuna 33B 370 Phi-3 Small 8K Instruct 371 Starling LM 7B Beta 372 Llama 2 70B Chat 373 Starling LM 7B Alpha 374 Llama 3.2 3B Instruct 375 Nous Hermes 2 Mixtral 8x7B DPO 376 Granite 3.0 2B Instruct 377 Llama 2 70B SteerLM Chat 378 QwQ-32B-Preview 379 SOLAR 10.7B Instruct v1.0 380 Dolphin 2.2.1 Mistral 7B 381 MPT 30B Chat 382 WizardLM 13B 383 Mistral 7B Instruct v0.2 384 Falcon 180B Chat 385 Qwen1.5-7B-Chat 386 Phi-3 Mini 4K Instruct (June 2024) 387 Vicuna 13B 388 Llama 2 13B Chat 389 Qwen-14B-Chat 390 PaLM 2 391 Gemma 7B IT 392 Code Llama 34B Instruct 393 Zephyr 7B Beta 394 Phi-3 Mini 128K Instruct 395 Phi-3 Mini 4K Instruct 396 Guanaco 33B 397 Zephyr 7B Alpha 398 StripedHyena Nous 7B 399 Code Llama 70B Instruct 400 Gemma 1.1 2B IT 401 Vicuna 7B 402 SmolLM2 1.7B Instruct 403 Llama 3.2 1B Instruct 404 Mistral 7B Instruct 405 Llama 2 7B Chat 406 Gemma 2B IT 407 Qwen1.5-4B-Chat 408 OLMo 7B Instruct 409 Koala 13B 410 Alpaca 13B 411 GPT4All 13B Snoozy 412 MPT 7B Chat 413 ChatGLM3 6B 414 RWKV-4 Raven 14B 415 ChatGLM2 6B 416 OpenAssistant Pythia 12B 417 ChatGLM 6B 418 FastChat-T5 3B 419 Dolly 2.0 12B 420 LLaMA 13B 421 StableLM Tuned Alpha 7B