arXiv cs.LG
· Papers
LARA: Lightweight Adapters in the Residual Stream for Composable Adaptation and Alignment
arXiv:2607.28669v1 Announce Type: new Abstract: We present LARA (Lightweight Additive Residual Adaptation), a method for efficient adaptation that operates in the residual stream of a frozen model rather than in its weights. Where LoRA adds an update of low rank to weight matrices, LARA reads the hidden state at a smal