288 models not plottedThese models are on the leaderboard but do not appear on the Pareto chart because they have insufficient cost data. The numbers beside their names show their leaderboard ranks.
16 Gemini 3 Pro 17 Muse Spark 34 Claude Opus 4.5 (High, 32K, 20251101) 36 Gemini 3 Flash 38 Claude Opus 4.5 (20251101) 52 Grok 4.1 (Thinking) 55 Grok 4.1 63 Gemini 2.5 Pro 66 GPT-4.5 Preview (2025-02-27) 67 GLM-5 70 GPT-5.1 (High) 74 DeepSeek-V3.1-Terminus (Thinking) 76 Claude Sonnet 4.5 (20250929) 77 Gemma 4 26B A4B 78 Claude Sonnet 4.5 (High, 32K, 20250929) 79 Claude Opus 4.1 (Thinking 16K, 20250805) 82 GPT-5 (High) 83 Qwen3.6-Max-Preview 84 ChatGPT-4o Latest (20250326) 85 GPT-5 Chat 86 Claude Opus 4.1 (20250805) 87 ERNIE-5.0-Preview (1203) 94 Gemma 4 31B 95 GLM-4.7 97 o3 (2025-04-16) 98 GPT-5.1 99 Kimi K2 Preview (0905) 100 ERNIE-5.0-Preview (1022) 101 GPT-5.2 (High) 109 amazon-nova-experimental-chat (26-02-10) 114 Kimi K2.5 (Instant) 119 Claude Opus 4 (20250514) 120 ERNIE 5.0 (0110) 122 GPT-4.1 (2025-04-14) 123 GLM-4.6 124 Kimi K2 Thinking Turbo 125 Claude Opus 4 (Thinking 16K, 20250514) 126 Qwen3-235B-A22B-Instruct (2507) 127 Muse Glimmer 128 Beam 1.0 501B A23B 129 DeepSeek-V3.2 131 Qwen3-Max-Preview 132 Qwen3-VL-235B-A22B-Instruct 134 DeepSeek-V3.2 (Thinking) 135 NVIDIA-Nemotron-3-Ultra-550B-A55B (NVFP4) 136 LongCat-Flash-Chat Exp (2602) 137 Grok 4.1 Fast (Reasoning) 138 Gemini 2.5 Flash 139 Grok 4 Fast (Reasoning) 140 Gemini 2.5 Flash Preview (09-2025) 141 Grok 3 Preview (02-24) 142 DeepSeek-V3.2-Exp (Thinking) 144 Grok 4 (0709) 145 Grok 4 Fast (Non-Reasoning) 147 DeepSeek-V3.1 (Thinking) 148 DeepSeek-V3.1 149 Kimi K2 Preview (0711) 150 DeepSeek-V3.1-Terminus 151 GLM-4.5 152 Mistral Medium 3.1 (2508) 155 DeepSeek-R1 (0528) 156 DeepSeek-V3.2-Exp 157 Qwen3-Max (2025-09-23) 158 Mistral Medium 3 (2505) 160 DeepSeek-V3 (0324) 161 Claude Sonnet 4 (20250514) 162 Qwen3-Next-80B-A3B-Instruct 163 o1 (2024-12-17) 164 Hunyuan T1 (20250711) 165 Claude Sonnet 4 (Thinking 32K, 20250514) 167 Qwen3-VL-235B-A22B-Thinking 168 Qwen3-235B-A22B (Non-Thinking) 171 GLM-4.6V 173 Qwen3-Coder-480B-A35B-Instruct 175 o4-mini (2025-04-16) 176 DeepSeek-R1 177 amazon-nova-experimental-chat (12-10) 178 GPT-5 mini (High) 179 Qwen3-235B-A22B-Thinking (2507) 180 amazon-nova-experimental-chat (26-01-10) 181 Gemini 2.5 Flash-Lite Preview (Non-Thinking, 09-2025) 182 Claude 3.7 Sonnet (Thinking 32K, 20250219) 183 GPT-4.1 mini (2025-04-14) 184 MiMo-V2-Flash (Thinking) 185 LongCat-Flash-Chat 188 MiniMax-M2.1 Preview 189 Claude 3.7 Sonnet (20250219) 191 o1-preview 192 MiMo-V2-Flash (Non-Thinking) 193 Qwen2.5-Max 194 Grok 3 Mini (High) 195 Gemma 3 27B IT 196 Qwen3-30B-A3B-Instruct (2507) 197 DeepSeek-V3 198 Gemini 2.5 Flash-Lite Preview (Thinking, 06-17) 199 Gemma 3 12B IT 201 Claude 3.5 Sonnet (20241022) 202 Hunyuan TurboS (20250416) 203 GLM-4-Plus (0111) 204 Gemini 2.0 Flash (001) 205 Gemini 2.0 Flash-Lite Preview (02-05) 206 GLM-4.7-Flash 207 NVIDIA-Nemotron-3.5-Super-VL-120B-A12B (NVFP4) 208 Qwen-Plus (0125) 209 Command A (03-2025) 211 Gemini Advanced (0514) 212 GLM-4.5-Air 213 GPT-4o (2024-05-13) 214 Mistral Small 3.2 (2506) 215 Llama 3.1 405B Instruct (BF16) 216 Llama 3.1 405B Instruct (FP8) 217 GLM-4.5V 218 Gemini 1.5 Pro (002) 219 NVIDIA-Nemotron-3-Super-120B-A12B 220 Qwen3-235B-A22B 221 Grok 2 (2024-08-13) 222 Yi Lightning 223 amazon-nova-experimental-chat (11-10) 224 MiniMax-M1 225 Grok 3 Mini Beta 226 Qwen3-Next-80B-A3B-Thinking 227 o3-mini (High) 228 MiniMax-M2 229 Olmo 3.1 32B Instruct 230 Claude 3.5 Sonnet (20240620) 231 Llama 3.3 Nemotron Super 49B v1.5 232 Claude 3.5 Haiku (20241022) 233 GPT-4.1 nano (2025-04-14) 235 GLM-4-Plus 236 Claude 3 Opus (20240229) 237 Step-2 16K Exp (202412) 238 GPT-4o (2024-08-06) 239 GPT-4o mini (2024-07-18) 240 Ling-flash-2.0 241 o1-mini 242 Llama 3.3 70B Instruct 243 Llama 4 Maverick 17B 128E Instruct 244 NVIDIA-Nemotron-3.5-Lightning-30B-A3B (NVFP4) 245 Step-3 246 Llama 4 Scout 17B 16E Instruct 247 gpt-oss-120b 248 o3-mini 249 Gemma 3 4B IT 250 amazon-nova-experimental-chat (10-09) 251 QwQ-32B 252 Hunyuan Standard (2025-02-10) 253 amazon-nova-experimental-chat (10-20) 254 Mistral Large 2 (2407) 255 GPT-4 Turbo (2024-04-09) 256 Step-1o Turbo (202506) 257 Hunyuan Large (2025-02-10) 258 Amazon Nova 2 Lite 259 Athene 70B (0725) 260 Gemini 1.5 Pro (001) 261 Qwen2.5-72B-Instruct 262 Llama 3.1 Nemotron 51B Instruct 263 DeepSeek-V2.5 264 Grok 2 mini (2024-08-13) 265 Reka Core (20240904) 266 GPT-5 nano (High) 267 Llama 3.1 70B Instruct 268 Llama 3.1 Nemotron 70B Instruct 269 Gemini 1.5 Flash (002) 270 INTELLECT-3 271 Athene V2 Chat 272 Qwen3-32B 273 Qwen-Max (0919) 274 Gemma 3n E4B IT 275 Gemma 2 9B IT SimPO 276 Mistral Large (2411) 277 Granite 4.2 30B 278 DeepSeek-V2.5 (1210) 279 Amazon Nova Pro 1.0 280 Jamba 1.5 Large 281 GPT-4 Turbo Preview (0125) 282 Qwen2.5-Plus (1127) 283 Qwen3-30B-A3B 284 gpt-oss-20b 285 Command R+ (08-2024) 286 Nemotron-4 340B Instruct 287 GPT-4 Turbo Preview (1106) 288 Granite 4.2 3B 289 Command R+ 290 GLM-4 (0520) 291 Gemma 2 27B IT 292 Qwen2.5-Coder-32B-Instruct 293 Mistral Small 3.1 24B Instruct (2503) 294 Gemini 1.5 Flash (001) 295 Olmo 3.1 32B Think 296 Claude 3 Sonnet (20240229) 297 NVIDIA-Nemotron-3-Nano-30B-A3B (BF16) 298 Magistral Medium (2506) 299 Command R (08-2024) 300 Llama 3 70B Instruct 301 Aya Expanse 32B 302 Phi-4 303 Olmo 3 32B Think 304 GPT-4 (0314) 305 Gemini 1.5 Flash-8B (001) 306 Ring-flash-2.0 307 Hunyuan Large Vision 308 Granite 4.2 8B 309 Jamba 1.5 Mini 310 Claude 3 Haiku (20240307) 311 Reka Flash (20240904) 312 Gemma 2 9B IT 313 Granite-4.0-H-Small 314 Amazon Nova Lite 1.0 315 Reka Flash 21B (Online, 20240226) 316 Command R 317 Mistral Small 24B Instruct (2501) 318 DeepSeek-Coder-V2 319 OLMo 2 32B Instruct (0325) 320 Qwen2-72B-Instruct 321 GPT-4 (0613) 322 Ministral 8B (2410) 323 Mistral Large (2402) 324 Qwen1.5-110B-Chat 325 Aya Expanse 8B 326 Amazon Nova Micro 1.0 327 Gemini Pro (Dev API) 328 Reka Flash 21B (20240226) 329 Qwen1.5-72B-Chat 330 Mixtral 8x22B Instruct v0.1 331 Mistral Medium 332 Yi 1.5 34B Chat 333 Granite 3.1 8B Instruct 334 GPT-3.5 Turbo (0125) 335 Llama 3.1 8B Instruct 336 Llama 3 8B Instruct 337 OpenChat 3.5 338 Qwen1.5-32B-Chat 339 Mixtral 8x7B Instruct v0.1 340 Zephyr ORPO 141B A35B v0.1 341 Gemini Pro 342 Gemma 2 2B IT 343 Yi 34B Chat 344 WizardLM 70B 345 Tulu 2 DPO 70B 346 Phi-3 Medium 4K Instruct 347 OpenHermes 2.5 Mistral 7B 348 Gemma 1.1 7B IT 349 Starling LM 7B Beta 350 DBRX Instruct Preview 351 Qwen1.5-14B-Chat 352 OpenChat 3.5 (0106) 353 Starling LM 7B Alpha 354 GPT-3.5 Turbo (1106) 355 DeepSeek LLM 67B Chat 356 Snowflake Arctic Instruct 357 InternLM2.5 20B Chat 358 WizardLM 13B 359 Phi-3 Small 8K Instruct 360 Granite 3.0 8B Instruct 361 Llama 2 70B Chat 362 Vicuna 33B 363 Llama 3.2 3B Instruct 364 Zephyr 7B Beta 365 Mistral 7B Instruct v0.2 366 SOLAR 10.7B Instruct v1.0 367 Granite 3.0 2B Instruct 368 Qwen1.5-7B-Chat 369 Qwen-14B-Chat 370 Vicuna 13B 371 Code Llama 34B Instruct 372 Gemma 7B IT 373 Llama 2 13B Chat 374 QwQ-32B-Preview 375 Phi-3 Mini 4K Instruct 376 PaLM 2 377 Phi-3 Mini 4K Instruct (June 2024) 378 Llama 3.2 1B Instruct 379 Mistral 7B Instruct 380 Vicuna 7B 381 Gemma 2B IT 382 Llama 2 7B Chat 383 Qwen1.5-4B-Chat 384 Gemma 1.1 2B IT 385 Phi-3 Mini 128K Instruct 386 StripedHyena Nous 7B 387 RWKV-4 Raven 14B 388 OLMo 7B Instruct 389 ChatGLM3 6B 390 Alpaca 13B 391 Koala 13B 392 OpenAssistant Pythia 12B 393 FastChat-T5 3B 394 ChatGLM 6B