arXiv cs.LG
· Papers
A Trust-region Framework for Moment Estimation
arXiv:2608.04026v1 Announce Type: new Abstract: In this paper, we develop a trust-region framework for understanding the behavior of adaptive moment estimation mechanisms, such as textsc{Adam}, in stochastic gradient optimization. Specifically, in this framework, the magnitude of the update step for each individual we