{"id":"arxiv/2608.12710","url":"https://arxiv.org/abs/2608.12710","tags":["cs.LG","math.OC"],"score":0,"title":"Federated Compositional Muon Optimizer for Matrix-Wise Models","domain":"cs.LG","source":"arxiv","authors":["Wang Yan","Feihu Huang"],"reviews":0,"subject":"cs.LG","summary":"Muon, a more recently developed optimizer, is useful for matrix-wise models in AI areas. Although many works have studied Muon and its variants, these methods are still not particularly well-suited for hierarchical structured problems. To fill this gap, we propose an effective federated compositional Muon (FedCoMuon) optimizer to solve distributed matrix-wise compositional optimization problems. Specifically, our FedCoMuon optimizer builds on compositional gradient tracking and orthogonalized momentum. Moreover, we propose a variance reduced variant of FedCoMuon (FedCoMuon-VR) based on a…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-08-13","reactions":{}}