{"id":"arxiv/2605.06866","url":"https://arxiv.org/abs/2605.06866","tags":["cs.LG","math.OC"],"score":0,"title":"A Sharp Finite-Iteration Theory for Asynchronous Categorical Distributional Temporal-Difference Learning","domain":"cs.LG","source":"arxiv","authors":["Ege C. Kaya","Abolfazl Hashemi"],"reviews":0,"subject":"cs.LG","summary":"We study finite-iteration behavior of asynchronous categorical distributional temporal-difference methods, covering scalar categorical TD (CTD) in the Cramér geometry and multivariate signed-categorical TD (MTD) in the maximum mean discrepancy (MMD) geometry. We establish high-probability guarantees under i.i.d. sampling and under a continuing Markovian trajectory. For CTD, the Cramér sample complexity to the true return law has leading term $\\tilde O(ρ_{\\min}^{-1}(1-γ)^{-2}\\varepsilon^{-2})$ in the i.i.d. and $\\tilde O(μ_{\\min}^{-1}(1-γ)^{-2}\\varepsilon^{-2}+μ_{\\min}^{-1}t_{\\mathrm{mix}})$…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-05-07","reactions":{}}