arXiv cs.CV
· Papers
Tensorion: A Tensor-Aware Generalization of the Muon Optimizer
arXiv:2606.25975v1 Announce Type: cross Abstract: Common first-order optimizers, such as Adam, implicitly treat each parameter block as an unstructured vector, which disregards the multilinear weight structure present in many modern machine learning models. Recent work has shown that exploiting matrix structure can imp