Id: arxiv/2602.23444 Url: https://arxiv.org/abs/2602.23444 Tags: math.OC Score: 0 Title: Generalized Stochastic Gradient Descent with Momentum Methods for Smooth Optimization Domain: math.OC Source: arxiv Authors: Zimeng Wang, Alp Yurtsever Reviews: 0 Subject: math.OC Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-02-26 Page: https://delphi.science/r/arxiv/2602.23444 Stochastic gradient descent with momentum (SGDM) methods have become fundamental optimization tools in machine learning, combining the computational efficiency of stochastic gradients with the acceleration benefits of momentum. Despite their widespread use in practice, the theoretical understanding of SGDM remains incomplete, with most existing analyses focusing on specific momentum schemes or requiring restrictive assumptions. In this paper, we introduce a generalized SGDM framework that unifies a broad class of momentum-based methods, including SGD with Polyak's momentum, SGD with…