{"id":"arxiv/2609.27741","url":"https://arxiv.org/abs/2609.27741","tags":["cs.LG","math.OC"],"score":0,"title":"Limiting-Kernel Q($λ$): Bridging Short and Long Horizons","domain":"cs.LG","source":"arxiv","authors":["Tolga Ok","Arman Sharifi Kolarijani","Peyman Mohajerin Esfahani","Mohamad Amin Sharifi Kolarijani"],"reviews":0,"subject":"cs.LG","summary":"In reinforcement learning, more accurate policy evaluation has been frequently shown to improve downstream policy optimization performance. For tractability, most value estimators rely on $n$-step truncation and thereby omit the long-horizon behavior of the transition dynamics. Methods that instead capture this behavior through the global structure of the dynamics can converge faster, but their computational and memory requirements limit their scalability to large or continuous state spaces. To reconcile these limitations, we introduce Limiting-Kernel Q($λ$) (LKQL), an off-policy value…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-09-23","reactions":{}}