{"id":"arxiv/2606.24981","url":"https://arxiv.org/abs/2606.24981","tags":["cs.LG","math.OC","stat.ML"],"score":0,"title":"A Single Stepsize Suffices for Unprojected Linear TD(0): Simultaneous Robust and Fast Rates via Polyak--Ruppert Averaging","domain":"cs.LG","source":"arxiv","authors":["Wei-Cheng Lee","Francesco Orabona"],"reviews":0,"subject":"cs.LG","summary":"We study linear TD(0) under Markovian sampling, where data are generated along a single trajectory. We provide high-probability guarantees for a plain unprojected TD(0) algorithm with Polyak-Ruppert (PR) averaging, using a single stepsize schedule $η_t \\propto \\frac{1}{τ_{\\mathrm{mix}}\\log(t)\\sqrt{t}}$ that depends on the mixing time but requires no prior knowledge of the curvature parameter $ω$. Our first result shows that such a choice of the stepsize guarantees that the TD(0) iterates are automatically and uniformly bounded with high probability, without projections and without any…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-06-23","reactions":{}}