Skip to content
arXiv stat.ML · Papers

SGD at the Edge of Stability: Stochastic Stabilization with Large Learning Rates

arXiv:2606.30930v1 Announce Type: new Abstract: Modern deep learning has been shown to operate at the edge of stability, routinely using learning rates far larger than those justified by classical optimization theory. Most prior analyses of the edge of stability phenomenon focus on deterministic gradient descent, leavi