{"id":"arxiv/2605.11586","url":"https://arxiv.org/abs/2605.11586","tags":["cs.LG","math.OC"],"score":0,"title":"Learning Weakly Communicating Average-Reward CMDPs: Strong Duality and Improved Regret","domain":"cs.LG","source":"arxiv","authors":["Kihyun Yu","Beomhan Baek","Dabeen Lee"],"reviews":0,"subject":"cs.LG","summary":"We study infinite-horizon average-reward constrained Markov decision processes (CMDPs) under the weakly communicating assumption. Our contributions are twofold. First, we establish strong duality for weakly communicating average-reward CMDPs over stationary policies with finite state and action spaces. Despite the absence of a linear programming formulation and the resulting nonconvexity under the weakly communicating setting, we show that strong duality still holds by carefully exploiting the geometric structure of the occupation measure set. Second, building on this result, we propose a…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-05-12","reactions":{}}