{"id":"arxiv/2610.01728","url":"https://arxiv.org/abs/2610.01728","tags":["cs.LG","cs.AI","math.OC"],"score":0,"title":"Removing spurious minima for planar features by skip connections","domain":"cs.LG","source":"arxiv","authors":["Jakob Paul Zimmermann","Andrei Balakin","Moritz Grillo","Georg Loho"],"reviews":0,"subject":"cs.LG","summary":"Understanding loss landscapes is central to explaining neural-network training, yet their structure remains only partially understood even in simple models. We study the Gaussian population loss of shallow, bias-free ReLU networks in the teacher--student setting. This provides a simple model for studying essential aspects such as feature learning and overparameterization. For teacher networks with positive output weights and planar features, we show that including a learned linear skip removes all spurious local minima with non-negative student output weights once the student network is at…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-10-01","reactions":{}}