Id: arxiv/2602.08069 Url: https://arxiv.org/abs/2602.08069 Tags: math.OC Score: 0 Title: Skip the Hessian, Keep the Rates: Globalized Semismooth Newton with Lazy Hessian Updates Domain: math.OC Source: arxiv Authors: Amal Alphonse, Pavel Dvurechensky, Clemens Sirotenko Reviews: 0 Subject: math.OC Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-02-08 Page: https://delphi.science/r/arxiv/2602.08069 Second-order methods are provably faster than first-order methods, and their efficient implementations for large-scale optimization problems have attracted significant attention. Yet, optimization problems in ML often have nonsmooth derivatives, which makes the existing convergence rate theory of second-order methods inapplicable. In this paper, we propose a new semismooth Newton method (SSN) that enjoys both global convergence rates and asymptotic superlinear convergence without requiring second-order differentiability. Crucially, our method does not require (generalized) Hessians to be…