{"id":"arxiv/2604.14108","url":"https://arxiv.org/abs/2604.14108","tags":["cs.LG","math.DS","math.OC","stat.ML"],"score":0,"title":"Momentum Further Constrains Sharpness at the Edge of Stochastic Stability","domain":"cs.LG","source":"arxiv","authors":["Arseniy Andreyev","Advikar Ananthkumar","Marc Walden","Tomaso Poggio","Pierfrancesco Beneventano"],"reviews":0,"subject":"cs.LG","summary":"Recent work suggests that (stochastic) gradient descent self-organizes near an instability boundary, shaping both optimization and the solutions found. Momentum and mini-batch gradients are widely used in practical deep learning optimization, but it remains unclear whether they operate in a comparable regime of instability. We demonstrate that SGD with momentum exhibits an Edge of Stochastic Stability (EoSS)-like regime with batch-size-dependent behavior that cannot be explained by a single momentum-adjusted stability threshold. Batch Sharpness (the expected directional mini-batch curvature)…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-04-15","reactions":{}}