{"id":"arxiv/2605.23476","url":"https://arxiv.org/abs/2605.23476","tags":["cs.LG","cond-mat.dis-nn","cond-mat.mtrl-sci","math.OC"],"score":0,"title":"Non-normal spectral signatures of instability in neural network training dynamics","domain":"cs.LG","source":"arxiv","authors":["Souvik Ghosh"],"reviews":0,"subject":"cs.LG","summary":"Training instabilities in deep networks - loss spikes, oscillatory convergence, and gradient pathologies - are empirically prevalent but lack a rigorous operator-theoretic explanation. We show that the linearized update operators for practically used optimizers are generically non-normal: for Adam, non-normality is controlled by the commutator [H, M] between the Hessian and the diagonal adaptive preconditioner, while for SGD with momentum it arises from the augmented state-space structure of the update map. Applying non-normal stability theory to these operators, we derive a conservative…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-05-22","reactions":{}}