{"id":"arxiv/2605.09991","url":"https://arxiv.org/abs/2605.09991","tags":["cs.AI","cs.LG","math.OC"],"score":0,"title":"Optimizer-Induced Mode Connectivity: From AdamW to Muon","domain":"cs.AI","source":"arxiv","authors":["Fangzhao Zhang","Sungyoon Kim","Erica Zhang","Yiqi Jiang","Mert Pilanci"],"reviews":0,"subject":"cs.AI","summary":"Mode connectivity has been widely studied, yet the role of the optimizer remains underexplored. We revisit it through optimizer-induced implicit regularization, asking how connectivity behaves when restricted to solutions constrained by a given optimizer. For two-layer ReLU networks, we show that solutions from a single optimizer -- AdamW, Muon, or others in the Lion-$\\mathcal{K}$ family -- form a connected set at sufficiently large width, a result not implied by prior work. We then characterize how optimizer-induced regions interact: at large width two different regions can be disjoint or…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-05-11","reactions":{}}