{"id":"arxiv/2610.38773","url":"https://arxiv.org/abs/2610.38773","tags":["cs.LG","cs.DC","math.OC"],"score":0,"title":"Rennala NSGD: Asynchronous Stochastic Optimization Beyond Euclidean Geometry","domain":"cs.LG","source":"arxiv","authors":["Igor Sokolov","Alexander Tyurin","Peter Richtárik"],"reviews":0,"subject":"cs.LG","summary":"The empirical success of matrix-aware optimizers, such as Muon (Jordan et al., 2024) and Shampoo (arXiv:1802.09568), highlights the potential of non-Euclidean geometry for deep learning, including large language model (LLM) training. Despite this progress, the theoretical understanding of stochastic optimization in general normed spaces remains limited, particularly in distributed settings. We analyze minibatch stochastic gradient descent (SGD) for smooth nonconvex optimization with respect to an arbitrary norm on a finite-dimensional space. Using the framework of $κ$-regular normed spaces…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-10-28","reactions":{}}