Skip to content
arXiv cs.AI · Papers

Beyond Success Rate: Cost-Aware Evaluation of Offensive and Defensive Security Agents

arXiv:2607.15263v1 Announce Type: cross Abstract: Security-agent evaluations commonly measure peak offensive capability under generous inference budgets, emphasizing vulnerability discovery, exploit development, penetration testing, and CTF completion. Such measurements are useful but incomplete: in operational securit