{"id":"arxiv/2609.39855","url":"https://arxiv.org/abs/2609.39855","tags":["cs.LG","math.PR"],"score":0,"title":"Dimension-Free Rank Lifting from Random Hyperplane Arrangements","domain":"cs.LG","source":"arxiv","authors":["Luca Becchetti","Matteo Russo","Ruben Skorupinski"],"reviews":0,"subject":"cs.LG","summary":"We study the width required for a randomly initialized hidden layer of a neural network to achieve rank lifting. Namely, given a dataset $X \\in \\mathbb{R}^{m \\times d}$ of $m$, $d$-dimensional input vectors separated by an angle of at least $θ$, we consider the random feature matrix $σ(XR)$, where $R$ is standard Gaussian. For positively homogeneous nonpolynomial activations, which include sign, Heaviside, ReLU, and ReLU powers among others, we prove that $$n \\gtrsim \\frac{1}θ\\max\\left\\{m,\\log\\left(\\frac{1}δ\\right)\\right\\}$$ neurons suffice for $σ(XR)$ to have full row rank $m$ with…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-09-30","reactions":{}}