X · @ylecun
· X / Twitter
RT Reza Bayat: World Modeling with JEPA has recently gained traction thanks to a novel anti-collapse mechanism called "SIGReg" (by @ylecun and @randal…
RT Reza BayatWorld Modeling with JEPA has recently gained traction thanks to a novel anti-collapse mechanism called "SIGReg" (by @ylecun and @randall_balestr). The math is clean, but it is rarely explained from first principles, so I broke it down in a detailed blog post 📰Here is the summary (🧵):The problem: in JEPA, b