{"id":"arxiv/2610.11309","url":"https://arxiv.org/abs/2610.11309","tags":["cs.LG","cs.AI","math.OC","stat.ML"],"score":0,"title":"From Geometry to Generalization: Why Row Normalization Can Beat Adam and Muon","domain":"cs.LG","source":"arxiv","authors":["Jihwan Kim","Dogyoon Song","Chulhee Yun"],"reviews":0,"subject":"cs.LG","summary":"Different optimizers can fit the same training data while selecting classifiers with substantially different geometries, but whether this difference provably affects population performance remains unclear. We show that row-wise normalization can achieve strictly higher population accuracy than full-batch Adam, a proxy for random-reshuffling Adam, and exact-SVD Muon in high-dimensional multiclass classification. Under an isotropic Gaussian-cloud data model, this advantage arises because row normalization's class-wise Euclidean geometry asymptotically preserves the population decision-boundary…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-10-08","reactions":{}}