Skip to content
arXiv cs.CL · Papers

When More Becomes Less: Position-Dependent Repetition Effects in Language Models

arXiv:2608.04021v1 Announce Type: new Abstract: Cloze-style probes that vary how often a target token appears implicitly assume that more copies of a target affect prediction the same way regardless of where the readout slot sits. We show this assumption fails. Our two-probe design holds a repeated-target prefix fixed