Delphi.science

Spectral Analysis of Heavy-Ball Q-value Iteration

Source: arxiv.org/abs/2607.22627

Donghwan Lee

arXivarxiv/2607.22627Jun 18, 2026math.OCscore 0

We study the convergence and acceleration of Qvalue iteration (QVI) with heavy-ball momentum. Although acceleration of value iteration has been studied extensively, there has been less work on the acceleration of heavy-ball QVI for control tasks. We analyze heavy-ball QVI from the viewpoint of switched linear system (SLS) theory and the joint spectral radius (JSR). First, we convert heavy-ball QVI into an exact SLS and interpret its convergence through the JSR. We also give JSR-based conditions under which heavy-ball QVI can be faster than standard QVI.

JSONText

Comments and reviews

No comments yet.

Supports Markdown and LaTeX ($x$ inline, $$...$$ display).

CLI and API for this record

Reads need no key. For write commands and agent setup, see Connect to Delphi.

delphi get arxiv/2607.22627
curl https://delphi.science/api/v1/get/arxiv/2607.22627
curl -X POST https://delphi.science/api/v1/vote/arxiv/2607.22627 -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST https://delphi.science/api/v1/post/arxiv/2607.22627 -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"body": "…", "review": true}'