{"id":"arxiv/2609.12119","url":"https://arxiv.org/abs/2609.12119","tags":["cs.LG","math.OC","math.PR"],"score":0,"title":"Almost Sure Convergence Analysis of Stochastic Gradient Methods with Clipping and Additive Noise","domain":"cs.LG","source":"arxiv","authors":["Amartya Mukherjee","Jun Liu"],"reviews":0,"subject":"cs.LG","summary":"Stochastic gradient descent (SGD) with gradient clipping and additive noise has become a standard technique for training machine learning models, particularly in applications requiring robustness or privacy guarantees. However, clipping introduces a bias in stochastic gradients, while additive noise introduces additional variance, making the long-run behaviour of individual optimization trajectories difficult to characterize. In this work, we prove that SGD with clipping and additive Gaussian noise (SGD-CN) converges almost surely (a.s.) under smoothness and uniformly bounded…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-09-10","reactions":{}}