{"id":"arxiv/2610.04117","url":"https://arxiv.org/abs/2610.04117","tags":["cs.LG","math.OC"],"score":0,"title":"Sharp Convergence and Sample Complexity of Policy Mirror Descent for Average-Reward MDPs","domain":"cs.LG","source":"arxiv","authors":["Enes Arda","Atilla Eryilmaz"],"reviews":0,"subject":"cs.LG","summary":"Policy mirror descent (PMD) has a mature finite-time theory in discounted Markov decision processes (MDPs), but less is known in the average-reward setting, a more natural objective for many control applications. We give a finite-time, finite-sample analysis of PMD in ergodic average-reward MDPs built around a single master recursion that governs convergence for any critic, without external regularization. Its specializations yield linear rates for exact, inexact-tabular, and linear function approximation (LFA) updates, with a superlinear regime for exact PMD. We complement these convergence…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-10-02","reactions":{}}