Toward Manifest Relationality in Transformers via Symmetry Reduction
arXiv:2602.18948v2 Announce Type: replace-cross Abstract: Transformer models contain substantial internal redundancy arising from coordinate-dependent representations and continuous symmetries, in model space and in head space, respectively.…