{"id":"arxiv/2607.23030","url":"https://arxiv.org/abs/2607.23030","tags":["cs.LG","math.OC"],"score":0,"title":"Online Policy Evaluation for MDPs with Dynamic UBSR Measures","domain":"cs.LG","source":"arxiv","authors":["Weikai Wang","Erick Delage"],"reviews":0,"subject":"cs.LG","summary":"Developing efficient function-approximation methods for policy evaluation is a fundamental challenge in risk-aware reinforcement learning. Existing approaches either focus on restrictive classes of risk measures or rely on access to a simulator, limiting their applicability in fully online settings. In this work, we propose computationally efficient online learning algorithms for policy evaluation in Markov decision processes (MDPs) with dynamic utility-based shortfall risk (UBSR) measures under linear function approximation. Specifically, we introduce the UBSR-TD algorithm, establish…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-07-25","reactions":{}}