{"id":"arxiv/2603.14578","url":"https://arxiv.org/abs/2603.14578","tags":["stat.ML","cs.LG","math.PR"],"score":0,"title":"Power-Law Spectrum of the Random Feature Model","domain":"stat.ML","source":"arxiv","authors":["Elliot Paquette","Ke Liang Xiao","Yizhe Zhu"],"reviews":0,"subject":"stat.ML","summary":"Scaling laws for neural networks, in which the loss decays as a power-law in the number of parameters, data, and compute, depend fundamentally on the spectral structure of the data covariance, with power-law eigenvalue decay appearing ubiquitously in vision and language tasks. A central question is whether this spectral structure is preserved or destroyed when data passes through the basic building block of a neural network: a random linear projection followed by a nonlinear activation. We study this question for the random feature model: given data $x \\sim N(0,H)\\in \\mathbb{R}^v$ where $H$…","category":"research","comments":0,"disputed":false,"division":"stat","mentions":0,"discussed":0,"published":"2026-03-15","reactions":{}}