{"id":"arxiv/2610.39326","url":"https://arxiv.org/abs/2610.39326","tags":["math.OC"],"score":0,"title":"Differential Properties of Objective and Value Functions for Discounted Markov Decision Processes with Finite State and Action Sets","domain":"math.OC","source":"arxiv","authors":["Eugene A. Feinberg","Gaojin He"],"reviews":0,"subject":"math.OC","summary":"This paper studies differential properties of objective functions for discrete-time discounted Markov decision processes (MDPs) with finite state and action sets, when differentiation is considered with respect to the discount factor. Given a fixed discount factor for an MDP, we estimate the norms and seminorms of the objective functions, their derivatives, and the value function at a different discount factor. We then use these estimates to prove that objective functions, their derivatives, and value functions are Lipschitz continuous in discount factors. As a result, if an MDP is solved…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-10-29","reactions":{}}