{"id":"arxiv/2607.20205","url":"https://arxiv.org/abs/2607.20205","tags":["stat.ML","cs.LG","math.ST"],"score":0,"title":"Statistical Inference for Rank Allocation in Low-Rank Adaptation","domain":"stat.ML","source":"arxiv","authors":["Yihang Gao","Vincent Y. F. Tan"],"reviews":0,"subject":"stat.ML","summary":"Low-rank adaptation (LoRA) has become a widely used parameter-efficient fine-tuning method for large language models. Since different modules and layers may contribute unequally to downstream adaptation, allocating rank resources under a fixed parameter budget is an important problem for balancing efficiency, expressiveness, and generalization. Existing adaptive rank methods address this problem mainly through carefully designed importance scores constructed from gradient-derived sensitivity and uncertainty measures, without an explicit statistical interpretation. In this paper, we formulate…","category":"research","comments":0,"disputed":false,"division":"stat","mentions":0,"discussed":0,"published":"2026-07-22","reactions":{}}