{"id":"arxiv/2610.28580","url":"https://arxiv.org/abs/2610.28580","tags":["cs.LG","math.OC"],"score":0,"title":"Continuous-Time Policy Gradient from Discrete Data: Convergence Analysis and Model-Free Algorithms","domain":"cs.LG","source":"arxiv","authors":["Martin Hernandez","Xinyan Qing","Mo Zhou","Yuhua Zhu"],"reviews":0,"subject":"cs.LG","summary":"Continuous-time reinforcement learning seeks an optimal policy under unknown dynamics driven by stochastic differential equations using observations collected at discrete times. We develop a policy gradient framework that combines rigorous convergence analysis with learning from discrete data. We first establish a performance difference lemma and derive policy gradient formulas for randomized and parametrized policies. We then prove exponential convergence of an entropy-regularized policy flow to the regularized optimum. For discrete parametrized updates, we derive a convergence bound that…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-10-20","reactions":{}}