{"id":"arxiv/2604.07323","url":"https://arxiv.org/abs/2604.07323","tags":["stat.ML","cs.LG","math.PR"],"score":0,"title":"Gaussian Approximation for Asynchronous Q-learning","domain":"stat.ML","source":"arxiv","authors":["Artemy Rubtsov","Sergey Samsonov","Vladimir Ulyanov","Alexey Naumov"],"reviews":0,"subject":"stat.ML","summary":"In this paper, we derive rates of convergence in the high-dimensional central limit theorem for Polyak-Ruppert averaged iterates generated by the asynchronous Q-learning algorithm with a polynomial stepsize $k^{-ω},\\, ω\\in (1/2, 1]$. Assuming that the sequence of state-action-next-state triples $(s_k, a_k, s_{k+1})_{k \\geq 0}$ forms a uniformly geometrically ergodic Markov chain, we establish a rate of order up to $n^{-1/6} \\log^{4} (nS A)$ over the class of hyper-rectangles, where $n$ is the number of samples used by the algorithm and $S$ and $A$ denote the numbers of states and actions,…","category":"research","comments":0,"disputed":false,"division":"stat","mentions":0,"discussed":0,"published":"2026-04-08","reactions":{}}