{"id":"arxiv/2607.16384","url":"https://arxiv.org/abs/2607.16384","tags":["cs.LG","math.OC","math.PR","stat.ML"],"score":0,"title":"Scaling Limits of Constant-Stepsize SGD at Flat Minima","domain":"cs.LG","source":"arxiv","authors":["Jingyi Zhang","Cheng Mao","Debankur Mukherjee"],"reviews":0,"subject":"cs.LG","summary":"For stochastic gradient descent (SGD) with a constant stepsize $α$, the invariant law of the iterates, centered at a minimizer, describes the behavior of the algorithm over long time horizons. In the strongly convex case, this invariant law has the familiar $\\sqrtα$ scaling and a Gaussian limit as $α\\downarrow 0$. We show that this behavior changes fundamentally for convex objectives $H$ with flat minima and (sub)quadratic tails. More specifically, we study SGD with Markovian noise generated by a contractive driving chain. For every sufficiently small constant stepsize $α$, we prove…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-07-17","reactions":{}}