Id: arxiv/2606.32005 Url: https://arxiv.org/abs/2606.32005 Tags: math.OC, cs.LG, stat.ML Score: 0 Title: Random Reshuffling Dominates Stochastic Gradient Descent Domain: math.OC Source: arxiv Authors: Zijian Liu Reviews: 0 Subject: math.OC Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-06-30 Page: https://delphi.science/r/arxiv/2606.32005 Stochastic Gradient Descent ($\textsf{SGD}$) is one of the most classical optimization algorithms with favorable theoretical guarantees, yet the practical implementation of $\textsf{SGD}$ differs subtly from its well-known form and is often referred to as Shuffling Stochastic Gradient Descent ($\textsf{Shuffling SGD}$). A particularly popular strategy in $\textsf{Shuffling SGD}$ is Random Reshuffling ($\textsf{RR}$), which has achieved great empirical success across numerous experiments. Despite its strong performance, $\textsf{RR}$ has long been considered a heuristic due to a lack of…