Skip to content
arXiv stat.ML · Papers

Limitations of SGD for Multi-Index Models Beyond Statistical Queries

arXiv:2602.05704v2 Announce Type: replace-cross Abstract: Understanding the limitations of gradient methods, and stochastic gradient descent (SGD) in particular, is a central challenge in learning theory. To that end, a commonly used tool is the Statistical Queries (SQ) framework, which studies performance limits of al