{"id":"arxiv/2610.37853","url":"https://arxiv.org/abs/2610.37853","tags":["math.OC"],"score":0,"title":"Optimality of Threshold Policies for Heat Storage Optimization and a Policy Gradient Algorithm","domain":"math.OC","source":"arxiv","authors":["Nicole Bäuerle","Florian Döttling"],"reviews":0,"subject":"math.OC","summary":"We study the optimal control of a stylized finite-horizon heat-storage system operated by a prosumer who can buy heat from and sell heat to a district heating network. Heat production and consumption are uncertain, and charging and discharging decisions have to be taken before the subsequent heat balance is observed. The resulting problem is formulated as a Markov decision process with continuous state and action spaces. We first establish a structural characterization of the optimal policy as a two-parameter threshold policy. Under additional regularity assumptions, we prove…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-10-27","reactions":{}}