{"id":"arxiv/2609.12785","url":"https://arxiv.org/abs/2609.12785","tags":["cs.LG","math.OC","stat.ML"],"score":0,"title":"Convergence of Stochastic Gradient Methods under Heavy-Tailed Noise and Hölder Smoothness","domain":"cs.LG","source":"arxiv","authors":["Misbah Uz Zaman","Anirbit Mukherjee"],"reviews":0,"subject":"cs.LG","summary":"Classical convergence guarantees for stochastic gradient methods typically assume Lipschitz-smooth objectives and finite-variance gradient noise, both frequently violated in practice. In contrast, we study nonconvex stochastic optimization under the joint relaxation of these assumptions: objectives with $(L,s)$-Hölder continuous gradients, $s\\in(0,1]$, and gradient noise satisfying only a bounded $α$-th moment condition for $α\\in(1,2]$. We establish three convergence results. Firstly, that standard SGD converges at rate $O(T^{-s/(1+s)})$ whenever $α\\ge1+s$, extending the classical nonconvex…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-09-11","reactions":{}}