{"id":"arxiv/2610.31783","url":"https://arxiv.org/abs/2610.31783","tags":["stat.ML","cs.LG","math.PR","physics.data-an"],"score":0,"title":"Early learning in large residual networks","domain":"stat.ML","source":"arxiv","authors":["Vladimir Narovlansky","Boris Hanin"],"reviews":0,"subject":"stat.ML","summary":"We study the early training dynamics of nonlinear residual networks with blocks of zero hidden layers as a model of more general residual networks. We analyze networks in a sequential limit where first width and depth diverge, then the number of training data points diverges, and finally the input dimension diverges. This is a more refined setup compared to the typical mean-field theory analysis in which depth and width diverge but the number of training datapoints and input dimension are fixed. Our main technical result is a diagrammatic computation of both the network output and the hidden…","category":"research","comments":0,"disputed":false,"division":"stat","mentions":0,"discussed":0,"published":"2026-10-22","reactions":{}}