{"id":"arxiv/2610.31094","url":"https://arxiv.org/abs/2610.31094","tags":["math.OC"],"score":0,"title":"Policy Evaluation and Policy Gradient for Continuous-Time Markov Regime-Switching Systems","domain":"math.OC","source":"arxiv","authors":["Minghui Zhang","Xun Li","Xin Zhang"],"reviews":0,"subject":"math.OC","summary":"We study policy evaluation (PE) and policy gradient (PG) for continuous-time stochastic control with Markov regime-switching. The main challenges are the coexistence of diffusion and regime jumps, the coupling of regime-dependent value functions, and the construction of model-free learning rules from the coupled generators. We establish a martingale characterization of PE that incorporates both Brownian and switching martingales, and extend martingale loss and orthogonality methods to this setting. We further derive a coupled PG equation and a trajectory-based gradient representation that,…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-10-22","reactions":{}}