{"id":"arxiv/2610.14344","url":"https://arxiv.org/abs/2610.14344","tags":["cs.LG","math.OC"],"score":0,"title":"On the Depth Transfer of Neural Optimizers via L-Smoothness","domain":"cs.LG","source":"arxiv","authors":["Maximilian Wong","Chenyu Xu","Jiajin Li","Yiping Lu"],"reviews":0,"subject":"cs.LG","summary":"Scaling deep learning models efficiently requires predictable performance transfer across compute regimes. Establishing reliable hyperparameter transfer allows optimal training dynamics and structural choices to be discovered on low-cost proxy models, avoiding catastrophic failures during massive-scale training. Existing depth-transfer analyses are architecture-specific and heuristic: hyperparameter transfer is only justified through toy blocks, and both rely on infinite-depth dynamics, a specific initialization, and feature-learning criteria. Building on $L$-smoothness framework of Xu et…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-10-09","reactions":{}}