HF Daily Papers
· Papers
MOPD: Multi-Teacher On-Policy Distillation for Capability Integration in LLM Post-Training
Modern large language models (LLMs) rely on reinforcement learning during post-training to push specific capabilities, yet integrating multiple capabilities into one model remains hard. Existing methods, such as Off-Policy Finetune and Mix-RL, are either inefficient or lose performance. In this work