{"id":"arxiv/2609.36390","url":"https://arxiv.org/abs/2609.36390","tags":["stat.ME","cs.LG","math.ST","stat.ML"],"score":0,"title":"Finite-Sample Theory for Fitted Q-Iteration When Actions Are Functions","domain":"stat.ME","source":"arxiv","authors":["Gefei Lin","Rui Miao","Xiaoke Zhang"],"reviews":0,"subject":"stat.ME","summary":"Offline reinforcement learning seeks optimal decision rules from previously collected data. In some applications, a decision can be an entire function, such as a fluence map in radiation therapy or a smooth movement trajectory in robotics. In this paper, we study the finite-sample theory for fitted Q-iteration (FQI) with functional actions in a discounted infinite-horizon setting. Three major difficulties arise in this setting: first, the absence of a Lebesgue probability density for functional actions complicates coverage descriptions; second, conventional coverage requirements can be…","category":"research","comments":0,"disputed":false,"division":"stat","mentions":0,"discussed":0,"published":"2026-09-28","reactions":{}}