arXiv cs.CL
· Papers
xHC: Expanded Hyper-Connections
arXiv:2607.14530v1 Announce Type: cross Abstract: Hyper-Connections (HC) expand the residual stream of Transformers into $N$ parallel streams, providing a form of memory scaling beyond model width and depth. Manifold-Constrained HC (mHC) stabilizes this formulation at scale. The large gains from $N{=}1$ to $N{=}4$ sugg