{"id":"arxiv/2602.19691","url":"https://arxiv.org/abs/2602.19691","tags":["stat.ML","cs.LG","math.NA"],"score":0,"title":"Smoothness Adaptivity in Constant-Depth Neural Networks: Optimal Rates via Smooth Activations","domain":"stat.ML","source":"arxiv","authors":["Yuhao Liu","Zilin Wang","Lei Wu","Shaobo Zhang"],"reviews":0,"subject":"stat.ML","summary":"Smooth activation functions are ubiquitous in modern deep learning, yet their theoretical advantages over non-smooth counterparts remain poorly understood. In this work, we study both approximation and statistical properties of neural networks with smooth activations for learning functions in the Sobolev space $W^{s,\\infty}([0,1]^d)$ with $s>0$. We prove that constant-depth networks equipped with smooth activations achieve smoothness adaptivity: increasing width alone suffices to attain the minimax-optimal approximation and estimation error rates (up to logarithmic factors). In contrast, for…","category":"research","comments":0,"disputed":false,"division":"stat","mentions":0,"discussed":0,"published":"2026-02-23","reactions":{}}