arXiv cs.CL
· Papers
Key-Value Means: Transformers with Expandable Block-Recurrent Compressed Memory
arXiv:2605.09877v4 Announce Type: replace-cross Abstract: Recall presents a difficult choice: transformers have a linearly growing memory that slows each successive token, while linear RNNs typically have fixed costs but limited recall. We present Key-Value Means ("KVM"), a novel block-recurrence for attention that can