{"id":"arxiv/2609.20409","url":"https://arxiv.org/abs/2609.20409","tags":["cs.LG","math.OC","stat.ML"],"score":0,"title":"The Bias of Nonlinear Two-Time-scale Stochastic Approximation under Constant Step-Sizes","domain":"cs.LG","source":"arxiv","authors":["Djamel Rassem Lamouri","Dorian Baudry","Nicolas Gast"],"reviews":0,"subject":"cs.LG","summary":"Two-timescale stochastic approximation (TTSA) is a fundamental tool for analyzing coupled iterative algorithms in reinforcement learning, optimization, and stochastic control. However, finite-time guarantees for nonlinear two-timescale schemes remain difficult to obtain, especially under constant step-sizes. In this paper, we study nonlinear TTSA with step-sizes $α\\ggβ$. Under standard stability, regularity, and Markovian noise assumptions, we upper bound the mean-squared error and the bias of both iterates around their limiting equilibria. Our bounds scale as $O(α+β^2/α^2)$, which we prove…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-09-17","reactions":{}}