{"id":"arxiv/2603.21191","url":"https://arxiv.org/abs/2603.21191","tags":["cs.LG","math.OC","stat.ML"],"score":0,"title":"On the Role of Batch Size in Stochastic Conditional Gradient Methods","domain":"cs.LG","source":"arxiv","authors":["Rustem Islamov","Roman Machacek","Aurelien Lucchi","Antonio Silveti-Falls","Eduard Gorbunov","Volkan Cevher"],"reviews":0,"subject":"cs.LG","summary":"We study the role of batch size in stochastic conditional gradient methods under a $μ$-Kurdyka-Łojasiewicz ($μ$-KL) condition. Focusing on momentum-based stochastic conditional gradient algorithms (e.g., Scion), we derive a new analysis that explicitly captures the interaction between stepsize, batch size, and stochastic noise. Our study reveals a regime-dependent behavior: increasing the batch size initially improves optimization accuracy but, beyond a critical threshold, the benefits saturate and can eventually degrade performance under a fixed token budget. Notably, the theory predicts…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-03-22","reactions":{}}