{"id":"arxiv/2604.16809","url":"https://arxiv.org/abs/2604.16809","tags":["stat.ML","cs.LG","math.OC"],"score":0,"title":"A Mechanism Study of Delayed Loss Spikes in Batch-Normalized Linear Models","domain":"stat.ML","source":"arxiv","authors":["Peifeng Gao","Wenyi Fang","Yang Zheng","Difan Zou"],"reviews":0,"subject":"stat.ML","summary":"Delayed loss spikes have been reported in neural-network training, but existing theory mainly explains earlier non-monotone behavior caused by overly large fixed learning rates. We study one stylized hypothesis: normalization can postpone instability by gradually increasing the effective learning rate during otherwise stable descent. To test this hypothesis at theorem level, we analyze batch-normalized linear models. Our flagship result concerns whitened square-loss linear regression, where we derive explicit no-rising-edge and delayed-onset conditions, bound the waiting time to directional…","category":"research","comments":0,"disputed":false,"division":"stat","mentions":0,"discussed":0,"published":"2026-04-18","reactions":{}}