{"id":"arxiv/2607.05546","url":"https://arxiv.org/abs/2607.05546","tags":["stat.ML","cs.LG","math.FA"],"score":0,"title":"Deep Neural Variation Spaces: A Unifying Perspective on Depth and Complexity","domain":"stat.ML","source":"arxiv","authors":["Julia Nakhleh","Robert D. Nowak"],"reviews":0,"subject":"stat.ML","summary":"We develop a unified function space theory of deep fully connected neural networks. Functions in our spaces are defined recursively as $\\ell^1$-bounded linear combinations of activated functions from preceding layers, with a dictionary of affine functions at the first layer. Unlike existing theories that are largely specialized to homogeneous activations such as the ReLU, our framework provides a meaningful notion of functional complexity for deep networks with a broad range of homogeneous and non-homogeneous activation functions commonly used in practice. This simple construction unites…","category":"research","comments":0,"disputed":false,"division":"stat","mentions":0,"discussed":0,"published":"2026-07-06","reactions":{}}