{"id":"arxiv/2603.06946","url":"https://arxiv.org/abs/2603.06946","tags":["cs.LG","math.OC"],"score":0,"title":"Joint MDPs and Reinforcement Learning in Coupled-Dynamics Environments","domain":"cs.LG","source":"arxiv","authors":["Ege C. Kaya","Mahsa Ghasemi","Abolfazl Hashemi"],"reviews":0,"subject":"cs.LG","summary":"Many distributional quantities in reinforcement learning are intrinsically joint across actions, including distributions of gaps and probabilities of superiority. However, the classical Markov decision process (MDP) formalism specifies only marginal laws and leaves the joint law of counterfactual one-step outcomes across multiple possible actions at a state unspecified. We study coupled-dynamics environments with a multi-action generative interface which can sample counterfactual one-step outcomes for multiple actions under shared exogenous randomness. We propose joint MDPs (JMDPs) as a…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-03-06","reactions":{}}