arXiv stat.ML
· Papers
Statistical Inference for Rank Allocation in Low-Rank Adaptation
arXiv:2607.20205v1 Announce Type: new Abstract: Low-rank adaptation (LoRA) has become a widely used parameter-efficient fine-tuning method for large language models. Since different modules and layers may contribute unequally to downstream adaptation, allocating rank resources under a fixed parameter budget is an impor