X · @ylecun
· X / Twitter
RT Randall Balestriero: Can regularization based JEPA (e.g. SIGReg) scale and compete with SOTA foundation models (DINO)? Here is the answer: yes and …
RT Randall BalestrieroCan regularization based JEPA (e.g. SIGReg) scale and compete with SOTA foundation models (DINO)? Here is the answer: yes and with 10x less data.VISReg (slight variation of SIGReg) competes with DINOv2-LVD142M while only training on inet22k.Try it out: https://huggingface.co/BooBooWu/visregHaiyu W