{"id":"arxiv/2608.06545","url":"https://arxiv.org/abs/2608.06545","tags":["cs.LG","math.OC","stat.ML"],"score":0,"title":"Robust Average-Reward Markov Decision Processes: Minimax-Optimal Learning via Plug-in Reductions","domain":"cs.LG","source":"arxiv","authors":["Yuepeng Yang","Yuxin Chen","Yuejie Chi"],"reviews":0,"subject":"cs.LG","summary":"Distributionally robust Markov decision processes provide a principled framework for sequential decision making under model uncertainty. We study how many samples are necessary and sufficient to learn an $\\varepsilon$-optimal robust policy under the average-reward criterion. A generative model provides samples from the nominal transition kernel, whereas policy performance is evaluated over $(s,a)$-rectangular total-variation uncertainty sets of radius at most $σ$. Let $H_0$ and $H_σ$ denote the nominal and robust optimal bias spans, respectively. We identify $σH_0$ as the perturbation scale…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-08-06","reactions":{}}