arXiv cs.LG
· Papers
LiMuon: Light and Fast Muon Optimizer for Large Models
arXiv:2509.14562v5 Announce Type: replace Abstract: Large models recently are widely applied in machine learning, so efficient training of large models has received widespread attention. More recently, the useful Muon optimizer is specifically designed for matrix-structured parameters of large models. Although some wor