Id: arxiv/2603.09734 Url: https://arxiv.org/abs/2603.09734 Tags: math.OC Score: 0 Title: Long-Run Conditional Value at Risk Reinforcement Learning Domain: math.OC Source: arxiv Authors: Qixin Wang, Hao Cao, Jian-Qiang Hu, Mingjie Hu, Li Xia Reviews: 0 Subject: math.OC Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-03-10 Page: https://delphi.science/r/arxiv/2603.09734 We propose a reinforcement learning method for minimizing the long-run conditional value at risk (CVaR) in Markov decision processes with finite state and action spaces. The method uses a single sample trajectory to update a quantile estimate, a $Q$-function, and a randomized policy, without requiring knowledge of transition probabilities or cost distributions. Under appropriate conditions, we show that the estimates track their changing targets as the policy is updated and exploration decreases, even when the proportion of updates for some state and action pairs tends to zero. With a strict…