{"id":"arxiv/2610.08420","url":"https://arxiv.org/abs/2610.08420","tags":["cs.LG","math.PR","stat.ML"],"score":0,"title":"Symmetry-Aware Feature Learning: A Polynomial Separation for Multi-Index Models","domain":"cs.LG","source":"arxiv","authors":["Jivan Waber","Vanessa Piccolo","Yatin Dandi","Florent Krzakala"],"reviews":0,"subject":"cs.LG","summary":"We establish a polynomial sample complexity separation between symmetry-aware and symmetry-agnostic feature learning. We study growing-rank multi-index models with high-dimensional Gaussian covariates in $\\mathbb{R}^d$ and $r=Θ(d^δ)$ teacher directions forming a cyclic symmetry orbit, where $0<δ<1/2$. We compare three ways of exploiting this structure: architectural weight sharing, data augmentation over the full symmetry group, and learning without access to the symmetry. In particular, we analyze a symmetry-tied convolutional network, an untied network, and the same untied network trained…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-10-06","reactions":{}}