On-policy distillation provides an elegant way to use the teacher model as a process reward model to provide dense reward while preventing SFT style "…
On-policy distillation provides an elegant way to use the teacher model as a process reward model to provide dense reward while preventing SFT style "OOD shock"…