{"id":"arxiv/2610.21020","url":"https://arxiv.org/abs/2610.21020","tags":["stat.ML","cs.LG","math.OC"],"score":0,"title":"Acceleration and its Limits in Gaussian Variational Inference","domain":"stat.ML","source":"arxiv","authors":["Jaesung R. Park","Uijeong Jang","Yifan Chen"],"reviews":0,"subject":"stat.ML","summary":"We study whether the classical momentum-based acceleration that improves the condition-number dependence of gradient descent from $κ$ to $\\sqrtκ$ for strongly convex, smooth objectives extends to Gaussian variational inference (GVI) for strongly log-concave, log-smooth target distributions. With exact Gaussian expectations, a convex composite formulation of GVI yields the classical accelerated $\\sqrtκ$ convergence rate. However, when only pointwise derivatives are available, we construct a family of strongly log-concave targets for which any randomized algorithm requires $κ^{1-o(1)}$ queries…","category":"research","comments":0,"disputed":false,"division":"stat","mentions":0,"discussed":0,"published":"2026-10-14","reactions":{}}