{"id":"arxiv/2605.00654","url":"https://arxiv.org/abs/2605.00654","tags":["cs.LG","cs.AI","math.OC","stat.ML"],"score":0,"title":"Reinforcement Learning with Markov Risk Measures and Multipattern Risk Approximation","domain":"cs.LG","source":"arxiv","authors":["Andrzej Ruszczynski","Tiangang Zhang"],"reviews":0,"subject":"cs.LG","summary":"For a risk-averse finite-horizon Markov Decision Problem, we introduce a special class of Markov coherent risk measures, called mini-batch measures. We also define the class of multipattern risk-averse problems that generalizes the class of linear systems. We use both concepts in a feature-based $Q$-learning method with multipattern $Q$-factor approximation and we prove a high-probability regret bound of $\\mathcal{O}\\big(H^2 N^H \\sqrt{ K}\\big)$, where $H$ is the horizon, $N$ is the mini-batch size, and $K$ is the number of episodes. We also propose an economical version of the $Q$-learning…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-05-01","reactions":{}}