{"id":"arxiv/2605.08417","url":"https://arxiv.org/abs/2605.08417","tags":["cs.LG","math.OC"],"score":0,"title":"Central Limit Theorem for Two-Time-Scale Approximate Distributionally Robust RL","domain":"cs.LG","source":"arxiv","authors":["Shengbo Wang","Zexi Zhang"],"reviews":0,"subject":"cs.LG","summary":"Designing model-free algorithms for distributionally robust reinforcement learning (DRRL) poses fundamental challenges. The robust Bellman operator is nonlinear in the transition kernel, which makes one-sample Bellman updates biased, while the adversarial optimization underlying robustness makes robust evaluation computationally demanding. To address these difficulties, we consider the natural small-ambiguity regime under Kullback--Leibler ambiguity sets and propose an approximate DRRL framework based on a first-order expansion of the relevant robust functional. This yields an approximate…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-05-08","reactions":{}}