Id: arxiv/2606.20534 Url: https://arxiv.org/abs/2606.20534 Tags: math.OC Score: 0 Title: On Second-Order Methods for Bilevel Optimization Domain: math.OC Source: arxiv Authors: Jiawen Bi, Jiaxiang Li, Mingyi Hong, Shuzhong Zhang Reviews: 0 Subject: math.OC Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-06-18 Page: https://delphi.science/r/arxiv/2606.20534 Bilevel optimization is an indispensable modeling tool for modern machine learning and engineering design. However, the theory and practice for finding second order stationary points in the context of bilevel optimization still remain largely unsettled. Even for bilevel optimization with strongly convex lower-level problem, the hyperfunction it induces is in general nonconvex. Although the Cubic Regularized Newton methods (CRN) famously achieve the optimal $\mathcal{O}(\varepsilon^{-1.5})$ SOSP (second-order stationary point) rate in single-level optimization, it is unclear how to control…