{"id":"arxiv/2606.16729","url":"https://arxiv.org/abs/2606.16729","tags":["cs.LG","math.OC"],"score":0,"title":"Learning Policy from a Single Trajectory in Average-Reward Markov Decision Process","domain":"cs.LG","source":"arxiv","authors":["Jongmin Lee","Ernest K. Ryu","Vaneet Aggarwal"],"reviews":0,"subject":"cs.LG","summary":"While there is an extensive body of work characterizing the sample complexity of discounted cumulative-reward MDPs, finite sample analyses for average-reward MDPs have been limited, and most existing works rely on restrictive assumptions such as ergodicity or access to a generative model. In this work, we establish the first finite sample complexity guarantees from a single trajectory for weakly communicating average-reward MDPs. To this end, we study the dynamics of a single trajectory in weakly communicating MDPs and based on this analysis, we develop novel model-free methods. Notably, our…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-06-15","reactions":{}}