{"id":"arxiv/2605.14297","url":"https://arxiv.org/abs/2605.14297","tags":["cs.LG","cs.AI","math.OC","stat.ML"],"score":0,"title":"Policy Optimization in Hybrid Discrete-Continuous Action Spaces via Mixed Gradients","domain":"cs.LG","source":"arxiv","authors":["Matias Alvo","Daniel Russo","Yash Kanoria"],"reviews":0,"subject":"cs.LG","summary":"We study reinforcement learning in hybrid discrete-continuous action spaces, such as settings where the discrete component selects a regime (or index) and the continuous component optimizes within it -- a structure common in robotics, control, and operations problems. Standard model-free policy gradient methods rely on score-function (SF) estimators and suffer from severe credit-assignment issues in high-dimensional settings, leading to poor gradient quality. On the other hand, differentiable simulation largely sidesteps these issues by backpropagating through a simulator, but the presence…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-05-14","reactions":{}}