{"id":"arxiv/2606.16575","url":"https://arxiv.org/abs/2606.16575","tags":["cs.LG","math-ph"],"score":0,"title":"RepNN: Tackling spectral bias in deep neural networks for regression and PDE problems via parameter reparameterization","domain":"cs.LG","source":"arxiv","authors":["Yong Wang","Tao Zhou","Xuhui Meng"],"reviews":0,"subject":"cs.LG","summary":"Deep neural networks (DNNs) have achieved remarkable success in scientific computing, yet they often suffer from spectral bias in capturing oscillatory and multiscale behaviors. In this study, we investigate this limitation by examining the failure of shallow ReLU neural networks in fitting high-frequency functions. This observation identifies two important factors in resolving rapid oscillations: the initial slope scale and the distribution of partition points induced by the networks. Motivated by this analysis, we propose RepNN, a reparameterized neural network model with ReLU or tanh…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-06-15","reactions":{}}