r/MachineLearning
· Communities
Decoupled Descent: Enforcing Exact Train-Test Error Tracking Via AMP Onsager Corrections [R]
Link: https://arxiv.org/pdf/2604.27883 Hi, Most of use are familiar with the headache of training a neural network using gradient descent where the training error may go to zero but the test error may stay the same as initialization or even increases. My paper treats this phenomena as a consequence of data reuse bias a