{"id":"arxiv/2608.22636","url":"https://arxiv.org/abs/2608.22636","tags":["cs.LG","math.OC","stat.ML"],"score":0,"title":"Q-Learning with Stable Infinite-Dimensional Linear Function Approximation","domain":"cs.LG","source":"arxiv","authors":["Shengbo Wang"],"reviews":0,"subject":"cs.LG","summary":"Q-learning with linear function approximation can be unstable because an arbitrary approximation architecture need not preserve the Bellman contraction. We develop a stable infinite-dimensional linear function approximation framework for Q-learning from a single Markovian behavior-policy trajectory. The learning variable is a coefficient field $θ\\in C(\\mathbb L)$ on a compact latent metric space $(\\mathbb L,ρ)$. The framework uses a reconstruction operator that maps $θ$ to a continuous Q-function and a compression operator that maps Bellman updates back to latent coordinates.…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-08-23","reactions":{}}