{"id":"arxiv/2609.18782","url":"https://arxiv.org/abs/2609.18782","tags":["cs.LG","cs.RO","math.OC"],"score":0,"title":"A Convergence Framework for Deep $V$-Learning: Error Propagation and Sharp Action-Gap Bounds","domain":"cs.LG","source":"arxiv","authors":["Yury Kolomeytsev"],"reviews":0,"subject":"cs.LG","summary":"We establish convergence bounds for deep $V$-learning with horizon $H$. The algorithm fits a scalar value function to targets from executed transitions and selects actions using a predictive model and the value function. For current observed-successor targets with fresh true-kernel outcomes, the conditional mean is $\\mathcal{T}^βV$, which averages over behavior-policy actions. The Bellman optimality update is $\\mathcal{T} V$. We decompose the update error into six residuals: fitting, transition reuse, target construction, replay, action selection, and exploration. Under $L^s$…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-09-16","reactions":{}}