arXiv cs.CL
· Papers
From Weights to Features: SAE-Guided Activation Regularization for LLM Continual Learning
arXiv:2606.26629v1 Announce Type: cross Abstract: Weight-space regularization methods such as Elastic Weight Consolidation (EWC) are the standard approach to catastrophic forgetting in continual learning. However, those methods tend to underperform when applied to large language models. We argue that such underperforma