225 models not plottedThese models are on the leaderboard but do not appear on the Pareto chart because they have insufficient cost data. The numbers beside their names show their leaderboard ranks.
3 Gemini 3 Pro 5 Muse Spark 14 Gemini 3 Flash 35 Claude Opus 4.5 (20251101) 37 GPT-4.5 Preview (2025-02-27) 38 Claude Opus 4.5 (High, 32K, 20251101) 47 Gemini 2.5 Pro 54 Grok 4.1 59 Grok 4.1 (Thinking) 60 GPT-5.2 (High) 61 ERNIE-5.0-Preview (1203) 64 Claude Sonnet 4.5 (High, 32K, 20250929) 71 GLM-5 73 GPT-5.1 (High) 76 Claude Opus 4.1 (Thinking 16K, 20250805) 78 Claude Opus 4 (Thinking 16K, 20250514) 79 Qwen3-Max-Preview 82 NVIDIA-Nemotron-3-Ultra-550B-A55B (NVFP4) 85 GPT-5 (High) 88 DeepSeek-V3.2-Exp 89 Claude Sonnet 4.5 (20250929) 92 Claude Opus 4.1 (20250805) 94 GPT-5.1 95 o3 (2025-04-16) 97 Qwen3-Max (2025-09-23) 100 DeepSeek-V3.2-Exp (Thinking) 103 Kimi K2.5 (Instant) 106 Claude Opus 4 (20250514) 107 ERNIE 5.0 (0110) 109 ChatGPT-4o Latest (20250326) 111 GLM-4.6 112 GLM-4.7 113 Qwen3-235B-A22B-Instruct (2507) 115 GPT-5 Chat 116 Kimi K2 Preview (0905) 117 Kimi K2 Preview (0711) 118 Grok 4.1 Fast (Reasoning) 119 Grok 3 Preview (02-24) 120 DeepSeek-V3.2 (Thinking) 121 Grok 4 (0709) 122 Qwen3-VL-235B-A22B-Thinking 124 DeepSeek-V3.2 126 Gemini 2.5 Flash Preview (09-2025) 128 Qwen3-VL-235B-A22B-Instruct 129 Kimi K2 Thinking Turbo 131 GPT-4.1 (2025-04-14) 132 DeepSeek-V3.1 133 Gemini 2.5 Flash 134 Mistral Medium 3.1 (2508) 135 Qwen3-235B-A22B-Thinking (2507) 137 DeepSeek-R1 138 DeepSeek-V3.1 (Thinking) 139 Mistral Medium 3 (2505) 140 GPT-4.1 mini (2025-04-14) 142 Claude Sonnet 4 (20250514) 143 DeepSeek-R1 (0528) 146 DeepSeek-V3 (0324) 148 MiMo-V2-Flash (Thinking) 149 Qwen3-Next-80B-A3B-Instruct 151 Claude 3.7 Sonnet (Thinking 32K, 20250219) 152 Grok 4 Fast (Reasoning) 153 GPT-5 mini (High) 154 Qwen3-235B-A22B 156 MiniMax-M2.1 Preview 157 Gemini 2.5 Flash-Lite Preview (Non-Thinking, 09-2025) 158 Qwen3-235B-A22B (Non-Thinking) 159 Claude Sonnet 4 (Thinking 32K, 20250514) 160 Claude 3.5 Sonnet (20241022) 161 Gemini 2.5 Flash-Lite Preview (Thinking, 06-17) 162 LongCat-Flash-Chat Exp (2602) 163 LongCat-Flash-Chat 164 GLM-4.5 165 o4-mini (2025-04-16) 167 o1 (2024-12-17) 168 Gemma 3 12B IT 169 Gemma 3 27B IT 170 Qwen3-30B-A3B-Instruct (2507) 171 Claude 3.7 Sonnet (20250219) 172 MiniMax-M1 174 Qwen3-Next-80B-A3B-Thinking 175 Command A (03-2025) 177 Gemini 2.0 Flash (001) 178 MiMo-V2-Flash (Non-Thinking) 179 MiniMax-M2 180 Step-3 181 GLM-4.5-Air 182 Mistral Small 3.2 (2506) 183 Qwen2.5-Max 184 o1-preview 185 DeepSeek-V3 186 Qwen3-Coder-480B-A35B-Instruct 187 Hunyuan TurboS (20250416) 188 GLM-4-Plus (0111) 189 GPT-5 nano (High) 191 GLM-4.7-Flash 192 Grok 3 Mini (High) 193 Qwen3-32B 194 Grok 3 Mini Beta 195 Claude 3.5 Sonnet (20240620) 196 Llama 4 Maverick 17B 128E Instruct 197 Gemini 2.0 Flash-Lite Preview (02-05) 198 amazon-nova-experimental-chat (10-20) 199 GPT-4o (2024-05-13) 200 amazon-nova-experimental-chat (11-10) 201 gpt-oss-120b 202 Gemini Advanced (0514) 203 o3-mini (High) 204 o3-mini 205 NVIDIA-Nemotron-3.5-Lightning-30B-A3B (NVFP4) 206 GPT-4.1 nano (2025-04-14) 207 Gemma 3n E4B IT 208 Claude 3 Opus (20240229) 209 Grok 2 (2024-08-13) 210 NVIDIA-Nemotron-3-Super-120B-A12B 211 Gemini 1.5 Pro (002) 212 GPT-4o (2024-08-06) 213 Claude 3.5 Haiku (20241022) 214 GPT-4 Turbo (2024-04-09) 215 Llama 4 Scout 17B 16E Instruct 216 QwQ-32B 217 Magistral Medium (2506) 218 Amazon Nova 2 Lite 219 NVIDIA-Nemotron-3-Nano-30B-A3B (BF16) 220 GLM-4-Plus 221 Qwen3-30B-A3B 222 Llama 3.1 405B Instruct (BF16) 223 Mistral Large 2 (2407) 224 Llama 3.1 405B Instruct (FP8) 225 GPT-4o mini (2024-07-18) 226 Gemini 1.5 Pro (001) 227 o1-mini 228 Olmo 3.1 32B Instruct 229 GPT-4 Turbo Preview (1106) 230 Mistral Small 3.1 24B Instruct (2503) 231 Step-1o Turbo (202506) 232 Grok 2 mini (2024-08-13) 233 GPT-4 Turbo Preview (0125) 234 Yi Lightning 235 Gemma 3 4B IT 236 Llama 3.3 70B Instruct 237 DeepSeek-V2.5 (1210) 238 Athene 70B (0725) 239 Mistral Large (2411) 240 Qwen-Max (0919) 241 Olmo 3 32B Think 242 Reka Core (20240904) 243 Athene V2 Chat 244 Amazon Nova Pro 1.0 245 Gemini 1.5 Flash (002) 246 GPT-4 (0314) 247 gpt-oss-20b 248 Claude 3 Sonnet (20240229) 249 Gemma 2 27B IT 250 Gemma 2 9B IT SimPO 251 Olmo 3.1 32B Think 252 Gemini 1.5 Flash (001) 253 Qwen2.5-72B-Instruct 254 DeepSeek-V2.5 255 Amazon Nova Lite 1.0 256 Command R+ (08-2024) 257 Llama 3.1 70B Instruct 258 Mistral Small 24B Instruct (2501) 259 Phi-4 260 Jamba 1.5 Large 261 GPT-4 (0613) 262 Command R+ 263 Qwen2.5-Plus (1127) 264 Claude 3 Haiku (20240307) 265 Gemma 2 9B IT 266 Nemotron-4 340B Instruct 267 Command R (08-2024) 268 Mistral Large (2402) 269 Aya Expanse 32B 270 DeepSeek-Coder-V2 271 Gemini 1.5 Flash-8B (001) 272 Reka Flash (20240904) 273 GLM-4 (0520) 274 Llama 3 70B Instruct 275 Amazon Nova Micro 1.0 276 Qwen2-72B-Instruct 277 Aya Expanse 8B 278 Reka Flash 21B (20240226) 279 Reka Flash 21B (Online, 20240226) 280 Mixtral 8x22B Instruct v0.1 281 Mistral Medium 282 Jamba 1.5 Mini 283 Gemini Pro (Dev API) 284 GPT-3.5 Turbo (0125) 285 Command R 286 Qwen1.5-110B-Chat 287 Mixtral 8x7B Instruct v0.1 288 GPT-3.5 Turbo (1106) 289 Llama 3.1 8B Instruct 290 Phi-3 Medium 4K Instruct 291 Llama 3 8B Instruct 292 Gemma 2 2B IT 293 Gemma 1.1 7B IT 294 Yi 1.5 34B Chat 295 Qwen1.5-72B-Chat 296 WizardLM 70B 297 Phi-3 Small 8K Instruct 298 Snowflake Arctic Instruct 299 DBRX Instruct Preview 300 OpenChat 3.5 (0106) 301 Vicuna 33B 302 Qwen1.5-32B-Chat 303 Llama 3.2 3B Instruct 304 Starling LM 7B Beta 305 Qwen1.5-14B-Chat 306 Phi-3 Mini 4K Instruct 307 Phi-3 Mini 4K Instruct (June 2024) 308 Yi 34B Chat 309 Llama 2 70B Chat 310 Phi-3 Mini 128K Instruct 311 InternLM2.5 20B Chat 312 Starling LM 7B Alpha 313 Vicuna 13B 314 Llama 2 13B Chat 315 Llama 3.2 1B Instruct 316 Zephyr 7B Beta 317 Mistral 7B Instruct v0.2 318 Gemma 1.1 2B IT 319 Llama 2 7B Chat 320 Mistral 7B Instruct 321 Qwen1.5-4B-Chat