arXiv cs.AI
· Papers
The State-Prediction Separation Hypothesis
arXiv:2607.01218v1 Announce Type: cross Abstract: Transformers use the same forward computation stream to both predict the next token and store useful state for future token predictions. We formulate the emph{state-prediction separation hypothesis}: disentangling the two roles yields better language modeling performan