{"id":"arxiv/2603.18168","url":"https://arxiv.org/abs/2603.18168","tags":["stat.ML","cs.LG","math.PR"],"score":0,"title":"ResNets of All Shapes and Sizes: Convergence of Training Dynamics in the Large-scale Limit","domain":"stat.ML","source":"arxiv","authors":["Louis-Pierre Chaintron","Lénaïc Chizat","Javier Maass"],"reviews":0,"subject":"stat.ML","summary":"We establish convergence of the training dynamics of residual neural networks (ResNets) to their joint infinite depth L, hidden width M, and embedding dimension D limit. Specifically, we consider ResNets with two-layer perceptron blocks in the maximal local feature update (MLU) regime and prove that, after a bounded number of training steps, the error between the ResNet and its large-scale limit is O(1/L + sqrt(D/(L M)) + 1/sqrt(D)). This error rate is empirically tight when measured in embedding space. For a budget of P = Theta(L M D) parameters, this yields a convergence rate O(P^(-1/6))…","category":"research","comments":0,"disputed":false,"division":"stat","mentions":0,"discussed":0,"published":"2026-03-18","reactions":{}}