Id: arxiv/2602.09057 Url: https://arxiv.org/abs/2602.09057 Tags: math.NA, cs.LG, math.OC Score: 0 Title: SVD-Preconditioned Gradient Descent Method for Solving Nonlinear Least Squares Problems Domain: math.NA Source: arxiv Authors: Zhipeng Chang, Wenrui Hao, Nian Liu Reviews: 0 Subject: math.NA Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-02-07 Page: https://delphi.science/r/arxiv/2602.09057 This paper introduces a novel optimization algorithm designed for nonlinear least-squares problems. The method is derived by preconditioning the gradient descent direction using the Singular Value Decomposition (SVD) of the Jacobian. This SVD-based preconditioner is then integrated with the first- and second-moment adaptive learning rate mechanism of the Adam optimizer. We establish the local linear convergence of the proposed method under standard regularity assumptions and prove global convergence for a modified version of the algorithm under suitable conditions. The effectiveness of the…