arXiv cs.LG
· Papers
LAARA: Layer-Aware Adaptive Rank Allocation for Parameter-Efficient Fine-Tuning
arXiv:2607.19391v1 Announce Type: new Abstract: Low-Rank Adaptation is widely used for parameter-efficient fine-tuning, yet existing methods typically assign the same adapter rank to every transformer layer despite their heterogeneous adaptation requirements. In this work, we show theoretically and empirically that uni