arXiv cs.CL
· Papers
Position: Coding Benchmarks Are Misaligned with Agentic Software Engineering
arXiv:2606.17799v2 Announce Type: replace-cross Abstract: Coding agents have become a major mode of software engineering, but the benchmarks we use to compare them were designed in a pre-agent era: they collapse model, harness, and environment into a single end-to-end score, typically computed against one reference sol