{"id":"arxiv/2609.39357","url":"https://arxiv.org/abs/2609.39357","tags":["cs.LG","cs.DC","math.OC"],"score":0,"title":"Robustifying Asynchronous SGD via Soft Throttling","domain":"cs.LG","source":"arxiv","authors":["Kaoru Otsuka","Maxime Meyer","Yuki Takezawa","Makoto Yamada","Anastasia Koloskova"],"reviews":0,"subject":"cs.LG","summary":"Asynchronous SGD is a popular algorithm for distributed learning where each client's gradient update is applied on arrival. This leads to a speed-up, but also an increased vulnerability to attacks, as fast clients can dominate the total update. We introduce Throttle, a Byzantine-robust generalization of asynchronous SGD where the key idea is to exponentially down-weight updates from faster clients by a factor $q$. Both asynchronous SGD ($q=1$) and synchronous Byzantine-robust SGD ($q\\to\\infty$) correspond to specific settings of Throttle. We provide a theoretical analysis of the convergence…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-09-30","reactions":{}}