{"id":"arxiv/2608.24963","url":"https://arxiv.org/abs/2608.24963","tags":["cs.LG","math.OC"],"score":0,"title":"Why and When Neural Networks Improve Local Approximation in Optimization","domain":"cs.LG","source":"arxiv","authors":["Chengkuo Bian","Pengcheng Xie"],"reviews":0,"subject":"cs.LG","summary":"Published experience with neural surrogates in derivative-free optimisation is contradictory: the same family of models that cuts the evaluation count of one solver leaves another unchanged, or makes it worse. We show that the contradiction dissolves once three factors are stated, and that these, rather than the fit accuracy a training curve reports, are what delimit when a learned local model pays. Role: a surrogate that proposes candidates the true objective must still approve helps, while one that replaces a gradient the solver depends on hurts. Radius: a model fitted to an optimisation…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-08-25","reactions":{}}