{"id":"arxiv/2610.28561","url":"https://arxiv.org/abs/2610.28561","tags":["cs.LG","math.OC"],"score":0,"title":"Convergence of stochastic gradient descent for learning linear neural networks","domain":"cs.LG","source":"arxiv","authors":["Gabin Maxime Nguegnang","Bubacarr Bah","Holger Rauhut","Ulrich Terstiege"],"reviews":0,"subject":"cs.LG","summary":"Stochastic gradient descent (SGD) is the cornerstone of modern deep learning, yet its theoretical convergence properties remain poorly understood in non-convex settings. To address this gap, we study SGD dynamics in deep linear neural networks - simplified models that retain key non-convex characteristics while remaining analytically tractable. Building on recent results for gradient descent, we extend convergence guarantees to SGD under regularized squared loss. We establish almost sure boundedness of SGD iterates. Using the framework of asymptotic pseudotrajectories from stochastic…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-10-20","reactions":{}}