{"id":"arxiv/2610.13789","url":"https://arxiv.org/abs/2610.13789","tags":["cs.LG","math.OC"],"score":0,"title":"Randomized Momentum Transport with Cheap Predictors","domain":"cs.LG","source":"arxiv","authors":["El Mahdi Chayti","Martin Jaggi"],"reviews":0,"subject":"cs.LG","summary":"Momentum methods such as STORM and second-order momentum track the gradient by adding a transport correction to momentum, at the cost of an extra oracle call per iteration. We introduce randomized momentum transport, which evaluates the correction with probability $q$ and otherwise uses a cheap prediction, with importance weighting that preserves the conditional mean and adds $(q^{-1}-1)$ times the prediction loss to the variance. Under transport-bias, second-moment, and residual-control assumptions, linear minimization oracle (LMO) updates, including normalized, sign, and exact spectral…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-10-09","reactions":{}}