{"id":"arxiv/2607.17607","url":"https://arxiv.org/abs/2607.17607","tags":["cs.LG","math.OC","stat.ML"],"score":0,"title":"Optimizing the Preconditioner: A Black-box Online-to-Nonconvex Conversion with Static Regret Minimization Oracles","domain":"cs.LG","source":"arxiv","authors":["Haichen Hu","David Simchi-Levi"],"reviews":0,"subject":"cs.LG","summary":"Stochastic nonconvex optimization is central to training deep networks and LLMs in modern machine learning. We give a black-box reduction from stochastic nonconvex optimization to ordinary static regret minimization in online convex optimization (OCO), thereby resolving the open problem posed by Chen and Hazan (2024). Our reduction maintains a predictable gradient tracker, while a black-box online learner $\\mathcal{A}$ selects a preconditioner that transforms this tracker into the update direction. Given a \\(β\\)-smooth function with a range bounded by $M$ and an unbiased gradient oracle with…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-07-20","reactions":{}}