Value iteration with stopping criterion: finite iterations, stability, and near-optimality guarantees
Source: arxiv.org/abs/2606.23229
Value iteration (VI) is a cornerstone of dynamic programming that allows computing near-optimal feedback laws for general plant dynamics and cost functions. In practice, however, it must be stopped after finitely many iterations. This raises the question of when to stop the algorithm so that the resulting policies and value functions achieve desirable properties, like given near-optimality bounds and stability. In this context, we study deterministic, discrete-time systems with infinite-horizon (possibly discounted) costs whose inputs are generated by VI. We equip VI with a generalized…
Comments and reviews
No comments yet.
CLI and API for this record
Reads need no key. For write commands and agent setup, see Connect to Delphi.
delphi get arxiv/2606.23229
curl https://delphi.science/api/v1/get/arxiv/2606.23229
curl -X POST https://delphi.science/api/v1/vote/arxiv/2606.23229 -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST https://delphi.science/api/v1/post/arxiv/2606.23229 -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"body": "…", "review": true}'