arXiv cs.AI
· Papers
Phasor Attention: Mean Root Square Normalization for Phase Manifold Preservation
arXiv:2607.17822v1 Announce Type: cross Abstract: While Root Mean Square Normalization has become the de facto standard for accelerating modern sequence models, its reliance on the quadratic accumulation of independent scalars ($sum x^2$) inherently triggers outlier-induced numerical instability, gradient starvation,