arXiv stat.ML
· Papers
RotRNN: Modelling Long Sequences with Rotations
arXiv:2407.07239v3 Announce Type: replace-cross Abstract: Linear recurrent neural networks, such as State Space Models (SSMs) and Linear Recurrent Units (LRUs), have recently shown state-of-the-art performance on long sequence modelling benchmarks. Despite their success, their empirical performance is not well understo