{"id":"arxiv/2605.11181","url":"https://arxiv.org/abs/2605.11181","tags":["cs.LG","cs.AI","math.NA","math.OC","stat.ML"],"score":0,"title":"Muon is Not That Special: Random or Inverted Spectra Work Just as Well","domain":"cs.LG","source":"arxiv","authors":["Zakhar Shumaylov","Nathaël Da Costa","Peter Zaika","Bálint Mucsányi","Alex Massucco","Yoav Gelberg","Carola-Bibiane Schönlieb","Yarin Gal","Philipp Hennig"],"reviews":0,"subject":"cs.LG","summary":"The recent empirical success of the Muon optimizer has renewed interest in non-Euclidean optimization, typically justified by similarities with second-order methods, and linear minimization oracle (LMO) theory. In this paper, we challenge this geometric narrative through three contributions, demonstrating that precise geometric structure is not the key factor affecting optimization performance. First, we introduce Freon, a family of optimizers based on Schatten (quasi-)norms, powered by a novel, provably optimal QDWH-based iterative approximation. Freon naturally interpolates between SGD and…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-05-11","reactions":{}}