{"id":"arxiv/2610.35004","url":"https://arxiv.org/abs/2610.35004","tags":["cs.GT","math.OC"],"score":0,"title":"Follow the Regularized Leader Does Not Converge in Constrained Optimization","domain":"cs.GT","source":"arxiv","authors":["Ioannis Anagnostides","Ioannis Panageas","Nikolas Patris","Tuomas Sandholm"],"reviews":0,"subject":"cs.GT","summary":"Follow the regularized leader (FTRL) is a foundational algorithm in online learning whose regret properties have been extensively studied for decades. However, in stark contrast to mirror descent---and gradient descent in particular---the convergence of FTRL to first-order stationary points in constrained nonconvex optimization was not well understood. In this paper, we show that continuous-time FTRL can fail to converge even asymptotically in infinitely smooth constrained optimization problems: its Karush-Kuhn-Tucker (KKT) gap can remain bounded away from zero indefinitely. This is…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-10-26","reactions":{}}