Id: arxiv/2611.18124 Url: https://arxiv.org/abs/2611.18124 Tags: math.OC, cs.LG Score: 0 Title: Muon Attains $\mathcal{O}(\varepsilon^{-3})$ Iteration Complexity under Shuffling Domain: math.OC Source: arxiv Authors: Kun Huang, Shi Pu, Karl Henrik Johansson Reviews: 0 Subject: math.OC Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-11-13 Page: https://delphi.science/r/arxiv/2611.18124 Muon is a stochastic first-order optimizer for matrix-valued parameters. It maintains an exponential moving average of stochastic gradients in a momentum buffer with coefficient $β$, and orthogonalizes the buffer to obtain the update direction. Muon has been reported to accelerate and stabilize the training of large language models. In practice, it is often used with shuffling (sampling without replacement), where each epoch visits the components of a finite-sum objective in a permuted order. However, its iteration complexity in this setting remains open. We analyze Muon under shuffling,…