{"id":"arxiv/2609.33152","url":"https://arxiv.org/abs/2609.33152","tags":["cs.LG","math.OC"],"score":0,"title":"Convergence of Practical Muon","domain":"cs.LG","source":"arxiv","authors":["Haonan Wang","Yu Wu","Minghui Liwang","Xinlei Yi","Yiguang Hong"],"reviews":0,"subject":"cs.LG","summary":"Muon is emerging as a promising alternative to AdamW for large-scale neural network training, yet theoretical understanding of its practical implementation remains incomplete, as existing analyses often simplify or omit two key components: (i) practical Newton--Schulz iterations with empirically tuned polynomial coefficients $(3.4445,-4.7750,2.0315)$; and (ii) decoupled weight decay for regularization. In this paper, we provide an optimization interpretation and establish convergence for practical Muon, jointly accounting for both components. Specifically, we interpret practical Muon as…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-09-27","reactions":{}}