{"id":"arxiv/2610.33516","url":"https://arxiv.org/abs/2610.33516","tags":["stat.ML","cs.LG","math.OC"],"score":0,"title":"Affine-invariant Cubic Newton with Weak Learners","domain":"stat.ML","source":"arxiv","authors":["Nikita Zozoulenko","Daniel Falkowski","Thomas Cass","Lukas Gonon"],"reviews":0,"subject":"stat.ML","summary":"Modern gradient boosting algorithms are based on Newton's method, which excels empirically but lacks global convergence guarantees. While recent work on Gradient-Regularized Newton (GRN) boosting achieved a global $\\mathcal{O}(1/γ^{12}k^2)$ rate, its analysis was not able to exploit the natural Hessian geometry and suffers from a heavy $γ^{12}$ dependence on a worst-case `weak gradient edge' $γ$. In this paper, we tackle these theoretical drawbacks by generalizing the Affine-Invariant Cubic Newton (AICN) scheme to convex optimization with weak learners. Our analysis is based on average…","category":"research","comments":0,"disputed":false,"division":"stat","mentions":0,"discussed":0,"published":"2026-10-24","reactions":{}}