arXiv cs.LG
· Papers
The Orthogonalized Read Is a Removable Training Scaffold for Recurrent Memory
arXiv:2607.19390v1 Announce Type: new Abstract: A recent report finds that orthogonalizing the mLSTM memory matrix at read time (five Newton-Schulz iterations, trained through) substantially improves noisy associative recall. The effect replicates, but it is not a memory improvement. Training on this task is a long cha