{"id":"arxiv/2611.07349","url":"https://arxiv.org/abs/2611.07349","tags":["math.OC","cs.LG"],"score":0,"title":"From What Is Used to What Is Missing: Rethinking Dynamic Rank in LoRA","domain":"math.OC","source":"arxiv","authors":["Peng Xue","Guodong Fan","Guang-Yong Chen","Xing Chen"],"reviews":0,"subject":"math.OC","summary":"Parameter-efficient fine-tuning with LoRA is governed by rank, which controls parameter budget and locally accessible task updates. Existing dynamic-rank methods mainly focus on capacity allocation, leaving unresolved whether the current adaptation space is sufficient for the task. We characterize the first-order information boundary of standard factor gradients, showing that their unobservable subspace coincides with the normal space of the low-rank manifold. Thus, factor gradients alone cannot distinguish under-optimization within the current space from task-relevant directions beyond its…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-11-05","reactions":{}}