Id: arxiv/2602.06567 Url: https://arxiv.org/abs/2602.06567 Tags: math.OC Score: 0 Title: Markov Decision Processes of the Third Kind: Learning Distributions by Policy Gradient Descent Domain: math.OC Source: arxiv Authors: Nicole Bäuerle, Athanasios Vasileiadis Reviews: 0 Subject: math.OC Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-02-06 Page: https://delphi.science/r/arxiv/2602.06567 The goal of this paper is to analyze distributional Markov Decision Processes as a class of control problems in which the objective is to learn policies that steer the distribution of a cumulative reward toward a prescribed target law, rather than optimizing an expected value or a risk functional. To solve the resulting distributional control problem in a model-free setting, we propose a policy-gradient algorithm based on neural-network parameterizations of randomized Markov policies, defined on an augmented state space and a sample-based evaluation of the characteristic-function loss. Under…