{"id":"arxiv/2609.07755","url":"https://arxiv.org/abs/2609.07755","tags":["cs.LG","math.OC"],"score":0,"title":"A Theoretical Analysis of Generalization Dynamics in Neural Networks under Gradient Descent with Weight Decay","domain":"cs.LG","source":"arxiv","authors":["Yuqing Wang","Ioannis G. Kevrekidis","Mikhail Belkin"],"reviews":0,"subject":"cs.LG","summary":"Understanding generalization remains a central challenge in machine learning because it requires jointly considering data, architecture, and training dynamics. In this paper, we develop a theoretical framework that characterizes how these factors jointly shape generalization performance throughout training. More precisely, we study a broad class of neural networks trained under the $\\ell^2$ loss by gradient descent (GD) with weight decay, and prove the convergence of GD to a neighbourhood of the global minimizers of the empirical loss. By partitioning the space based on the input data, we…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-09-07","reactions":{}}