{"id":"arxiv/2606.05599","url":"https://arxiv.org/abs/2606.05599","tags":["cs.LG","math.ST","stat.ME","stat.ML"],"score":0,"title":"Mitigating the Curse of Dimensionality in Uniform Convergence of Deep Neural Networks via Smooth Activations","domain":"cs.LG","source":"arxiv","authors":["Yizhe Ding","Runze Li","Jia Liu","Lingzhou Xue"],"reviews":0,"subject":"cs.LG","summary":"This paper establishes a theoretical framework for the uniform convergence of smoothly activated deep neural network (DNN) estimators. While standard ReLU networks achieve minimax-optimal rates in the $L^2(P)$ norm for various nonparametric regression tasks, we establish a theoretical lower bound demonstrating that least-squares ReLU estimators can suffer from the curse of dimensionality in their uniform convergence behavior. Motivated by the need for reliable uniform guarantees in downstream tasks requiring worst-case reliability, we address this limitation by analyzing smoothly activated…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-06-04","reactions":{}}