{"id":"arxiv/2610.28915","url":"https://arxiv.org/abs/2610.28915","tags":["cs.LG","math.OC"],"score":0,"title":"A Model-Free Continuous-Time RL Algorithm from Discrete-Time Off-Policy Data with End-to-End Guarantees","domain":"cs.LG","source":"arxiv","authors":["Chaorui Yao","Yuming Paul Zhang","Lin Yang","Yuhua Zhu"],"reviews":0,"subject":"cs.LG","summary":"In this paper, we study continuous-time reinforcement learning, where the state follows an unknown stochastic differential equation but only a fixed off-policy batch of discrete-time transitions is available. Standard discrete-time Q-learning becomes problematic as the sampling interval shrinks, because differences between action values vanish. Continuous-time alternatives, such as Deep Advantage Updating and martingale q-learning, preserve the action signal but jointly learn a value function and an action-dependent critic. Building on the PhiBE-Q formulation (arXiv:2606.21925), we develop a…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-10-20","reactions":{}}