{"id":"arxiv/2608.22129","url":"https://arxiv.org/abs/2608.22129","tags":["cs.LG","math.NA"],"score":0,"title":"Blockwise Stabilized Adaptive Cubic Regularization with Subsolvers via Recurrence","domain":"cs.LG","source":"arxiv","authors":["Rodion Podorozhny"],"reviews":0,"subject":"cs.LG","summary":"Overparameterized networks often have ill-conditioned, saddle rich loss landscapes. They are usually trained with first-order methods that struggle on those landscapes, while many second-order methods stay infeasible at scale. Some scalable cubic methods replace the Hessian by a computationally cheap approximation and drop the exact block curvature. This paper introduces ARC-block, a blockwise adaptive regularization with cubics (ARC) optimizer. For each parameter tensor it minimizes a cubic model over the true block Hessian, with a per-block adaptive cubic constant and a monotone guard on…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-08-22","reactions":{}}