{"id":"arxiv/2606.11798","url":"https://arxiv.org/abs/2606.11798","tags":["q-fin.CP","cs.LG","math.OC"],"score":0,"title":"Deterministic Policy Gradient for Learning Equilibrium in Time-Inconsistent Control Problems","domain":"q-fin.CP","source":"arxiv","authors":["Xin Guo","Yijie Huang","Xiang Yu"],"reviews":0,"subject":"q-fin.CP","summary":"In this paper, we develop a continuous-time model-free reinforcement learning algorithm to learn deterministic equilibrium policies in general time-inconsistent control problems. Utilizing the extended Hamilton-Jacobi-Bellman system, we recast the original time-inconsistent problem into an equivalent two-stage problem. In the first stage, for given auxiliary functions, we employ the deterministic policy gradient approach to learn an optimal policy in an auxiliary time-consistent control problem. In the second stage, given the updated policy, we exploit the inner fixed point iterations and…","category":"research","comments":0,"disputed":false,"division":"econ","mentions":0,"discussed":0,"published":"2026-06-10","reactions":{}}