Id: arxiv/2611.07334 Url: https://arxiv.org/abs/2611.07334 Tags: math.OC, cs.LG, stat.ML Score: 0 Title: Last-Iterate Convergence of Stochastic Gradient Methods for Unbounded Problems Domain: math.OC Source: arxiv Authors: Kevin Kurian Thomas Vaidyan, Ahmet Alacaoglu, Michael P. Friedlander Reviews: 0 Subject: math.OC Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-11-05 Page: https://delphi.science/r/arxiv/2611.07334 Last-iterate convergence guarantees for stochastic gradient methods have attracted significant attention as practical implementations typically return the last iterate instead of an average of the iterates. In this paper, we study two approaches for analyzing the last-iterate convergence of proximal and projected stochastic gradient methods without bounded domain or bounded variance assumptions, where black-box variational inference serves as a running example. Under two related assumptions relaxing the bounded variance, we show near-optimal anytime rate $\widetilde{\mathcal{O}}(1/\sqrt{T})$…