{"id":"arxiv/2608.22765","url":"https://arxiv.org/abs/2608.22765","tags":["cs.LG","math.OC"],"score":0,"title":"Learning to Control Coupled-Dynamics Environments with Joint Markov Decision Processes","domain":"cs.LG","source":"arxiv","authors":["Ege C. Kaya","Aliasghar Pourghani","Mahsa Ghasemi","Vijay Gupta","Abolfazl Hashemi"],"reviews":0,"subject":"cs.LG","summary":"Coupled-dynamics environments expose the one-step outcomes that would follow from several possible counterfactual actions under a common realization of exogenous randomness. The ordinary Markov decision process formalism allows one to reason about the marginal law of each action but discards dependence across these counterfactual outcomes. The Joint Markov decision process (JMDP) formalism preserves that dependence. Prior work established the formalism and solved the fixed-policy joint moment evaluation problem in JMDPs. This paper develops optimal-control methods. We define a nonparametric…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-08-24","reactions":{}}