{"id":"arxiv/2608.22953","url":"https://arxiv.org/abs/2608.22953","tags":["cs.LG","math.OC","stat.ML"],"score":0,"title":"Stochastic gradient descent with initial regularization","domain":"cs.LG","source":"arxiv","authors":["Nabil Kahalé"],"reviews":0,"subject":"cs.LG","summary":"We analyze a variant of stochastic gradient descent with initial regularization (SGDIR) and derive dimension-free upper bounds on its expected excess risk for the squared loss. In the noiseless case, we obtain new bounds for both averaged and non-averaged SGDIR under moment, source, and capacity assumptions. For a particular value of the source parameter, these bounds are of order $m^{-2}\\log^{2}m$, where the number of training samples is of order $m$. For another value of the source parameter, we obtain, for any $ε>0$, bounds of order $m^{-3+ε}$, provided that the capacity parameter exceeds…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-08-24","reactions":{}}