
Interaction-as-a-Judge
We study Interaction-as-a-Judge, a paradigm which uses computer-use agents to evaluate applications. We find that Interaction-as-a-Judge improves both evaluation and downstream generation. We see improvements to inference-time scaling (55.4% → 75.5%) and find that we can do reinforcement learning with an interaction-only reward model (+50 Arena points).











