Skip to content
arXiv cs.CL · Papers

Estimating near-verbatim extraction risk in language models with decoding-constrained beam search

arXiv:2603.24917v2 Announce Type: replace Abstract: Recent work shows that standard greedy-decoding extraction methods for quantifying memorization in LLMs miss how extraction risk varies across sequences. Probabilistic extraction -- computing the probability of generating a target suffix given a prefix under a decodin