arXiv cs.NE
· Papers
Toward Manifest Relationality in Transformers via Symmetry Reduction
arXiv:2602.18948v2 Announce Type: replace-cross Abstract: Transformer models contain substantial internal redundancy arising from coordinate-dependent representations and continuous symmetries, in model space and in head space, respectively. While recent approaches address this by explicitly breaking symmetry, we propo