{"id":"arxiv/2606.11104","url":"https://arxiv.org/abs/2606.11104","tags":["cs.LG","math.CA","stat.ML"],"score":0,"title":"Limitations of Learning Tanh Neural Networks with Finite Precision","domain":"cs.LG","source":"arxiv","authors":["Philipp Grohs","Matěj Trödler"],"reviews":0,"subject":"cs.LG","summary":"We investigate limitations of learning $\\tanh$ neural networks from point evaluations under finite-precision computations and $L^p$ accuracy guarantees, building on Berner, Grohs, and Voigtländer (2023). Our approach is based on a novel construction of sharply localized bump functions via iterated $\\tanh$ activations. Using this mechanism, we show that, in a finite-precision setting, no adaptive randomized algorithm based on $m$ samples can achieve a convergence rate higher than the Monte Carlo rate $O(m^{-1/p})$ in the $L^p$ norm, unless the sampling budget grows exponentially with the size…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-06-09","reactions":{}}