X · @ylecun
· X / Twitter
RT Haiyu Wu: Today's leading SSL methods rely heavily on training heuristics—EMA, teacher-student training, layer freezing, and more—to remain stabl…
RT Haiyu WuToday's leading SSL methods rely heavily on training heuristics—EMA, teacher-student training, layer freezing, and more—to remain stable.Regularization-based methods are much simpler, but have long failed to match the generalization performance of leading SSL approaches.VISReg breaks this trade-off.We introd