{"id":"arxiv/2610.05456","url":"https://arxiv.org/abs/2610.05456","tags":["stat.ML","cs.LG","math.OC"],"score":0,"title":"Taylor Representations for Model-Free RL in Networked MDPs","domain":"stat.ML","source":"arxiv","authors":["Salah Chikhi","Abdelhaq Chaoui","Asuman Ozdaglar","Saurabh Amin"],"reviews":0,"subject":"stat.ML","summary":"In Networked Markov Decision Processes, transition dynamics are often unknown and the state--action space grows rapidly with the number of agents. In this setting, Taylor representations naturally approximate $Q$-functions, but a naive order-$n$ expansion over $N$ agents requires $Θ(N^n)$ coefficients. We justify these expansions under smooth expected future local rewards with controlled derivatives. Under this condition, finite-speed information propagation and discounting imply that local-critic Taylor coefficients decay exponentially with the graph distance to the farthest agent involved.…","category":"research","comments":0,"disputed":false,"division":"stat","mentions":0,"discussed":0,"published":"2026-10-04","reactions":{}}