{"id":"arxiv/2606.25975","url":"https://arxiv.org/abs/2606.25975","tags":["cs.LG","cs.CV","math.NA"],"score":0,"title":"Tensorion: A Tensor-Aware Generalization of the Muon Optimizer","domain":"cs.LG","source":"arxiv","authors":["Vladimir Bogachev","Vladimir Aletov","Alexander Molozhavenko","Sergei Kudriashov","Maxim Rakhuba"],"reviews":0,"subject":"cs.LG","summary":"Common first-order optimizers, such as Adam, implicitly treat each parameter block as an unstructured vector, which disregards the multilinear weight structure present in many modern machine learning models. Recent work has shown that exploiting matrix structure can improve optimization dynamics. A notable example is Muon, which performs steepest descent under the spectral norm constraint. We take the next step and introduce Tensorion, a tensor-aware optimizer that extends Muon's constrained optimization perspective from matrices to higher-order tensors. Tensorion is built around a linear…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-06-24","reactions":{}}