{"id":"arxiv/2611.14926","url":"https://arxiv.org/abs/2611.14926","tags":["math.OC","cs.LG","stat.ML"],"score":0,"title":"Understanding the Asymptotic Transience of Q-Learning via Distributional Expansion","domain":"math.OC","source":"arxiv","authors":["Shengbo Wang"],"reviews":0,"subject":"math.OC","summary":"Q-learning has been empirically observed to exhibit substantial transient error. This transient remains uncaptured by the leading Gaussian limit because the central-limit normalization removes the smaller-scale displacement generated by the initial nonlinear evolution. On the other hand, worst-case finite-sample guarantees, while accounting for transient effects, can obscure the mechanisms responsible for the error on a particular problem instance. We develop a finer asymptotic analysis that gives an asymptotically exact characterization of this transient for a fixed instance. Specifically,…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-11-11","reactions":{}}