{"id":"arxiv/2605.16913","url":"https://arxiv.org/abs/2605.16913","tags":["stat.ML","cond-mat.dis-nn","cond-mat.stat-mech","cs.LG","math.PR"],"score":0,"title":"A Fourier perspective on the learning dynamics of neural networks: from sample complexities to mechanistic insights","domain":"stat.ML","source":"arxiv","authors":["Fabiola Ricci","Claudia Merger","Sebastian Goldt"],"reviews":0,"subject":"stat.ML","summary":"Neural networks trained with gradient-based methods exhibit a strong simplicity bias: they learn simpler statistical features of their data before moving to more complex features. Previous analyses of this phenomenon have largely focused on settings with (quasi-)isotropic inputs. In this work, we study the simplicity bias from a Fourier perspective, which allows us to include two key features of natural images in the analysis: approximate translation-invariance and power-law spectra. We first show experimentally that simple neural networks trained on image classification tasks first rely on…","category":"research","comments":0,"disputed":false,"division":"stat","mentions":0,"discussed":0,"published":"2026-05-16","reactions":{}}