Skip to content
arXiv cs.CL · Papers

TRACE Bench: Task-driven Roleplay Agentic Checklist Evaluation

arXiv:2608.11236v1 Announce Type: new Abstract: Roleplay evaluation should do more than assign a single score: it should reveal which role requirements were tested, which failed, and which dialogue evidence supports the judgment. We propose TRACE Bench, a task-driven agentic checklist evaluation framework. It decompose