{"id":"arxiv/2610.31663","url":"https://arxiv.org/abs/2610.31663","tags":["math.NA","cs.LG","math.ST","stat.ML"],"score":0,"title":"Phase Transition from Random Features to Fully Trainable Networks","domain":"math.NA","source":"arxiv","authors":["Xin He","Huan Lao","Xiliang Lu","Shijun Zhang"],"reviews":0,"subject":"math.NA","summary":"Constructing accurate and computationally tractable approximation spaces is a fundamental task in scientific computing. Partially trainable neural networks bridge fixed random features and fully adaptive representations. This paper quantifies a phase transition pattern in approximation bounds and observes analogous behavior in training errors: a rapid but smooth initial improvement followed by diminishing returns, with a sharper transition under greater initialization mismatch. Under polynomial spectral decay with exponent $α>1$ and leverage compatibility, we establish a squared $L_2$…","category":"research","comments":0,"disputed":false,"division":"math","mentions":0,"discussed":0,"published":"2026-10-22","reactions":{}}