{"id":"arxiv/2606.02993","url":"https://arxiv.org/abs/2606.02993","tags":["cs.LG","math.OC","math.RT","math.ST","stat.ML"],"score":0,"title":"Neural Networks Provably Learn Spectral Representations for Group Composition","domain":"cs.LG","source":"arxiv","authors":["Jianliang He","Leda Wang","Fengzhuo Zhang","Siyu Chen","Zhuoran Yang"],"reviews":0,"subject":"cs.LG","summary":"Understanding how structured internal structure emerges during neural network training is central to the study of deep learning. We investigate this phenomenon through the group composition task, where a two-layer neural network is trained to predict $g_1 \\star g_2$ for elements of a finite group $G$. By lifting the projected gradient flow to the Fourier domain, we demonstrate that the training dynamics are governed by a Riemannian gradient ascent on a representation-theoretic energy functional. We prove that, under random initialization, this flow drives each neuron to converge almost…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-06-02","reactions":{}}