{"id":"arxiv/2611.23773","url":"https://arxiv.org/abs/2611.23773","tags":["cs.LG","math.AP","math.OC"],"score":0,"title":"A Systematic Analysis of a Small Optimal Subspace for Physics-Informed Neural Networks: $n$-DAS $\\subset \\mathbb{R}^p$","domain":"cs.LG","source":"arxiv","authors":["Ahmad AliAhmad","Khemraj Shukla"],"reviews":0,"subject":"cs.LG","summary":"The search for a low-dimensional subspace that governs neural network training has been a persistent goal in optimization. Yet subspaces defined by Hessian eigenvalue magnitude, such as the dominant/bulk decomposition underlying Dom-SGD and Bulk-SGD, have repeatedly failed to capture where optimization takes place, and adaptive Krylov-based alternatives built on energy-fraction thresholds show promise but still struggle at lower eigenmodes. We argue this failure is structural: the directions of highest curvature are not, in general, the directions along which training moves. We introduce the…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-11-18","reactions":{}}