arXiv cs.AI
· Papers
RoCo-ACE: Rollout-Conditioned Online Distillation for Retention-Aware Knowledge Injection
arXiv:2607.24771v1 Announce Type: new Abstract: Knowledge injection updates pretrained MLLMs with new factual or domain-specific knowledge, but fitting full authoritative answers can cause drift in non-updated behavior. Online distillation mitigates this drift by training on model-generated rollouts, yet uniform refere