{"id":"arxiv/2608.22595","url":"https://arxiv.org/abs/2608.22595","tags":["stat.ML","cs.LG","math.ST"],"score":0,"title":"Sparse Additive Off-Policy Evaluation for Reinforcement Learning with Potentially Limited Number of Trajectories","domain":"stat.ML","source":"arxiv","authors":["Tuoyi Zhao","Chengchun Shi","Zhengling Qi","Lan Wang"],"reviews":0,"subject":"stat.ML","summary":"We develop a new framework for flexible, nonlinear, and interpretable off-policy evaluation for infinite-horizon reinforcement learning. To handle large state spaces and support transparent decision-making, we model the Q-function using a nonlinear function class with a sparse additive structure. We derive high-probability finite-sample error bounds for estimating the value function of a target policy and show that the bounds depend only logarithmically on the ambient dimension $d$, thereby alleviating the curse of dimensionality. In contrast to most existing theory for off-policy…","category":"research","comments":0,"disputed":false,"division":"stat","mentions":0,"discussed":0,"published":"2026-08-23","reactions":{}}