{"id":"arxiv/2604.18972","url":"https://arxiv.org/abs/2604.18972","tags":["stat.ML","cs.LG","math.OC"],"score":0,"title":"Beyond Bellman: High-Order Generator Regression for Continuous-Time Policy Evaluation","domain":"stat.ML","source":"arxiv","authors":["Yaowei Zheng","Richong Zhang","Shenxi Wu","Shirui Bian","Haosong Zhang","Li Zeng","Xingjian Ma","Yichi Zhang"],"reviews":0,"subject":"stat.ML","summary":"We study finite-horizon continuous-time policy evaluation from discrete closed-loop trajectories under time-inhomogeneous dynamics. The target value surface solves a backward parabolic equation, but the Bellman baseline obtained from one-step recursion is only first-order in the grid width. We estimate the time-dependent generator from multi-step transitions using moment-matching coefficients that cancel lower-order truncation terms, and combine the resulting surrogate with backward regression. The main theory gives an end-to-end decomposition into generator misspecification, projection…","category":"research","comments":0,"disputed":false,"division":"stat","mentions":0,"discussed":0,"published":"2026-04-21","reactions":{}}