{"id":"arxiv/2608.29448","url":"https://arxiv.org/abs/2608.29448","tags":["cs.LG","cs.AI","math.OC","stat.ML"],"score":0,"title":"SS-ESOAP: Self-Scaled Adaptive Preconditioning for Physics-Informed Learning","domain":"cs.LG","source":"arxiv","authors":["Guangyuan Wang","Mads Toftrup","Sebastian Loeschcke","Yixuan Wang","Anima Anandkumar"],"reviews":0,"subject":"cs.LG","summary":"Physics-informed neural networks (PINNs) often face ill-conditioned objectives that limit high-accuracy training. Dense quasi-Newton methods improve local conditioning but require expensive optimizer state, while Kronecker-factored methods such as SOAP scale to larger networks but rely on periodic basis updates. We introduce \\method, which augments SOAP-style preconditioning with a scalar secant-energy correction adapted to Kronecker geometry and an adaptive basis update followed by variance-state downscaling. We characterize the directional secant matching induced by the scalar correction…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-08-29","reactions":{}}