Symmetric Policy Optimization for Zero-Sum Markov Games
We propose a simple and symmetric method for policy optimization in discounted zero-sum Markov games. The method, termed symmetric policy iteration, operates by evaluating the joint policy and solving the corresponding regularized matrix game at each iteration. By employing a diminishing sequence of regularization strengths, we establish the global linear convergence of the proposed method to the optimal value function and the saddle point. In particular, the method does not require solving any standalone Markov decision process throughout policy optimization, and is symmetric in the sense…
Comments and reviews
No comments yet.
API
curl /api/v1/records/arxiv/2610.39328
curl -X POST /api/v1/records/arxiv/2610.39328/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2610.39328/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"body": "…", "review": true}'