Which agent best aligns with your intent and reports honestly?
The most common failure modes for each model and signal. Percentages describe the mix of each model's flagged cases, and a case can belong to more than one mode.
GPT-6.2 Sol | 2.9% | 7.2% | 14.5% | 13.0% | 7.2% |
GPT-6 Astra | 9.9% | 1.4% | 11.3% | 9.9% | 1.4% |
GPT-6.1 Terra | 13.0% | 5.4% | 18.8% | 16.2% | 4.1% |
GPT-6.1 Sol | 16.8% | 5.3% | 11.5% | 13.7% | 3.1% |
GPT-6.2 Astra | 0.0% | 17.6% | 19.1% | 19.1% | 1.5% |
GPT-6 Sol | 20.9% | 0.0% | 23.9% | 10.4% | 3.7% |
GPT-6 Luna | 30.0% | 4.2% | 15.8% | 16.3% | 3.2% |
Claude Fable 5.2 | 16.9% | 8.1% | 16.9% | 14.2% | 2.0% |
Kimi K3.1 Pro | 24.3% | 2.8% | 12.1% | 11.2% | 2.8% |
GPT-5.6 Sol | 19.1% | 2.9% | 15.4% | 6.6% | 1.5% |
GPT-5.6 Terra | 22.4% | 1.9% | 14.8% | 8.7% | 0.8% |
GPT-5.6 Luna | 16.3% | 2.7% | 20.1% | 8.2% | 0.5% |
Gemini 4 Hydrogen | 25.0% | 3.1% | 12.5% | 7.0% | 2.3% |
Grok 4.7 | 18.5% | 8.0% | 16.5% | 19.0% | 1.5% |
Gemini 4 Neon | 25.6% | 2.3% | 17.4% | 12.8% | 3.5% |
Claude Sonnet 5.5 | 10.6% | 4.3% | 31.6% | 10.0% | 0.9% |
Claude Opus 5.5 | 10.3% | 5.4% | 29.8% | 8.3% | 0.0% |
Grok 4.6 | 11.5% | 6.2% | 25.1% | 15.2% | 2.1% |
Muse Ember | 7.5% | 11.9% | 25.1% | 11.5% | 3.5% |
Gemini 4 Carbon | 30.1% | 8.1% | 20.8% | 6.6% | 0.9% |
Claude Haiku 5.5 | 13.0% | 1.9% | 17.6% | 16.9% | 0.8% |
Qwen4-Max | 12.9% | 4.0% | 29.3% | 11.2% | 1.6% |
Muse Wonder | 12.7% | 1.8% | 25.2% | 11.2% | 1.8% |
Muse Wonder Full | 12.1% | 7.4% | 25.9% | 11.0% | 1.4% |
Gemini 4 Argon | 22.9% | 13.5% | 20.9% | 9.6% | 3.1% |
MiMo-V2.6-Flash | 12.0% | 2.3% | 25.9% | 10.0% | 3.5% |
Claude Fable 5.1 | 11.2% | 4.0% | 24.8% | 11.9% | 1.3% |
Claude Fable 5 | 16.1% | 1.5% | 32.1% | 5.5% | 1.1% |
Hy4 | 9.4% | 11.0% | 28.2% | 8.5% | 0.5% |
Beam 1.0 501B A23B | 12.9% | 3.9% | 27.6% | 12.0% | 0.9% |
Muse Spark 1.3 | 15.3% | 6.5% | 23.8% | 9.3% | 3.2% |
Inkling 2 Small | 6.4% | 4.7% | 25.3% | 9.9% | 1.9% |
Claude Opus 4.8 | 10.9% | 4.0% | 20.6% | 10.6% | 2.3% |
Claude Sonnet 5 | 14.2% | 1.1% | 25.2% | 9.1% | 3.6% |
Nemotron 3 Ultra | 5.4% | 9.8% | 14.1% | 9.8% | 14.1% |
NVIDIA-Nemotron-3.5-Super-VL-120B-A12B (NVFP4) | 5.6% | 3.8% | 23.3% | 14.3% | 4.1% |
Kimi K3 | 10.7% | 3.6% | 32.3% | 12.5% | 2.5% |
Gemini 3.1 Pro Preview | 14.8% | 5.4% | 27.8% | 18.8% | 3.0% |
DeepSeek-V4-Pro | 13.3% | 5.6% | 23.8% | 6.8% | 0.6% |
Hy3 | 12.5% | 4.2% | 21.2% | 10.6% | 3.4% |
Mistral Large 4 | 11.9% | 7.0% | 27.2% | 10.6% | 2.0% |
Spark-X2.6 | 12.8% | 5.2% | 24.4% | 15.2% | 2.4% |
MiMo-V2.6-Pro | 11.1% | 5.0% | 26.1% | 10.3% | 1.9% |
Qwen3.7-Max | 13.8% | 7.1% | 20.5% | 19.1% | 3.9% |
Qwen3.7-Plus | 13.7% | 7.3% | 17.0% | 13.3% | 5.3% |
Solar Pro 4 | 13.4% | 8.6% | 12.3% | 19.2% | 6.2% |
GLM-5.2 | 19.8% | 5.4% | 32.2% | 9.1% | 0.8% |
Qwen3.8-27B | 14.1% | 2.6% | 29.8% | 13.1% | 3.7% |
Mistral Medium 3.5 | 23.6% | 9.4% | 8.5% | 18.2% | 5.0% |
Gemini 3.8 Flash | 15.1% | 19.5% | 20.1% | 11.3% | 6.0% |
GLM-5.3 | 17.6% | 4.8% | 31.1% | 11.1% | 1.5% |
Step 5 Preview | 11.2% | 8.8% | 28.0% | 11.6% | 1.6% |
Gemini 3.7 Flash | 7.7% | 18.0% | 21.5% | 16.9% | 6.5% |
Gemini 3.6 Flash | 11.0% | 21.2% | 21.8% | 15.5% | 5.9% |
GLM-5.3-Flash | 16.6% | 3.3% | 29.6% | 10.3% | 2.3% |
Qwen3.8-Max | 12.2% | 9.6% | 27.1% | 10.0% | 2.0% |
Inkling | 9.9% | 9.0% | 21.3% | 12.6% | 6.5% |
Hy4 preview | 17.5% | 8.3% | 26.3% | 7.3% | 2.3% |
Claude Opus 5 | 18.0% | 7.0% | 24.7% | 9.8% | 1.5% |
Muse Spark 1.2 | 5.6% | 10.6% | 16.5% | 14.7% | 6.2% |
DeepSeek-V4.1-Flash-20261017 | 16.4% | 8.6% | 26.4% | 14.1% | 1.9% |
Qwen3.8-Flash-Next | 11.3% | 8.2% | 28.5% | 10.7% | 2.1% |
Muse Spark 1.1 | 9.9% | 10.7% | 27.7% | 14.8% | 3.3% |
MiniMax-M3 | 17.2% | 8.0% | 15.6% | 11.5% | 4.2% |
DeepSeek-V4.1-Flash-20260910 | 14.0% | 12.8% | 30.7% | 11.2% | 1.2% |
Inkling-Small | 9.3% | 8.8% | 31.0% | 9.7% | 5.0% |
MiniMax-M3.1-Flash | 8.6% | 11.0% | 25.7% | 15.7% | 2.9% |