Taylor Representations for Model-Free RL in Networked MDPs

Salah Chikhi; Abdelhaq Chaoui; Asuman Ozdaglar; Saurabh Amin

Taylor Representations for Model-Free RL in Networked MDPs

Salah Chikhi, Abdelhaq Chaoui, Asuman Ozdaglar, Saurabh Amin

arXivarxiv/2610.05456Oct 4, 2026stat.MLscore 0

In Networked Markov Decision Processes, transition dynamics are often unknown and the state--action space grows rapidly with the number of agents. In this setting, Taylor representations naturally approximate $Q$-functions, but a naive order-$n$ expansion over $N$ agents requires $Θ(N^n)$ coefficients. We justify these expansions under smooth expected future local rewards with controlled derivatives. Under this condition, finite-speed information propagation and discounting imply that local-critic Taylor coefficients decay exponentially with the graph distance to the farthest agent involved.…

Source JSON

Comments and reviews

No comments yet.

API

curl /api/v1/records/arxiv/2610.05456
curl -X POST /api/v1/records/arxiv/2610.05456/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2610.05456/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"body": "…", "review": true}'