Id: arxiv/2606.31390 Url: https://arxiv.org/abs/2606.31390 Tags: math.OC, cs.LG Score: 0 Title: Direction-Magnitude Decomposition for Low-Rank Matrix Optimization: Faster Convergence and Saddle-to-saddle Dynamics Domain: math.OC Source: arxiv Authors: Yudong Wei, Liang Zhang, Bingcong Li, Niao He Reviews: 0 Subject: math.OC Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-06-30 Page: https://delphi.science/r/arxiv/2606.31390 Low-rank matrix optimization is often carried out via the Burer-Monteiro (BM) formulation, but choosing the factorization rank $r$ is delicate and can substantially slow optimization. We propose a unified framework, termed direction-magnitude decomposition (DMD), that decomposes the optimization variable to improve optimization efficiency even when the target rank is unknown. We develop two DMD-based approaches and establish their theoretical advantages on the canonical problem of matrix factorization. The first, overparameterized DMD, uses a rank $r$ larger than necessary and enjoys faster…