52 models not plottedThese models are on the leaderboard but do not appear on the Pareto chart because they have insufficient cost data. The numbers beside their names show their leaderboard ranks.
13 Muse Spark 14 Gemini 3 Pro 36 Gemini 3 Flash 48 Dola Seed 2.0 Pro 56 GPT-5.1 (High) 60 GPT-5.2 (High) 62 Gemini 2.5 Pro 64 GPT-5.1 69 ChatGPT-4o Latest (20250326) 70 GPT-5 Chat 73 Kimi K2.5 (Instant) 75 Gemini 2.5 Flash Preview (09-2025) 76 GPT-5.2 77 GPT-5 (High) 79 ERNIE-5.0-Preview (1220) 80 Qwen3-VL-235B-A22B-Instruct 82 GPT-4.1 (2025-04-14) 83 o3 (2025-04-16) 84 NVIDIA-Nemotron-3.5-Super-VL-120B-A12B (NVFP4) 85 Gemini 2.5 Flash 87 Claude Opus 4 (Thinking 16K, 20250514) 88 Claude Sonnet 4 (Thinking 32K, 20250514) 91 Qwen-VL-Max (2025-08-13) 93 o4-mini (2025-04-16) 94 Claude 3.7 Sonnet (Thinking 32K, 20250219) 95 GPT-4.1 mini (2025-04-14) 96 GPT-5 mini (High) 97 Qwen3-VL-235B-A22B-Thinking 98 Claude Opus 4 (20250514) 100 Claude Sonnet 4 (20250514) 101 Gemini 2.5 Flash-Lite Preview (Thinking, 06-17) 102 Claude 3.7 Sonnet (20250219) 103 Gemini 2.5 Flash-Lite Preview (Non-Thinking, 09-2025) 104 Claude 3.5 Sonnet (20241022) 105 Grok 4 (0709) 106 Mistral Medium 3.1 (2508) 107 GLM-4.6V 108 Gemini 2.0 Flash (001) 109 Gemma 3 27B IT 110 Mistral Medium 3 (2505) 111 GPT-5 nano (High) 112 GLM-4.5V 113 Hunyuan Vision 1.5 Thinking 114 Llama 4 Maverick 17B 128E Instruct 115 Step-1o Turbo (202506) 116 Step-3 117 Hunyuan Large Vision 118 Mistral Small 3.2 (2506) 119 Mistral Small 3.1 24B Instruct (2503) 120 Claude 3.5 Haiku (20241022) 121 Llama 4 Scout 17B 16E Instruct 122 Molmo 2 8B