Id: arxiv/2607.02053 Url: https://arxiv.org/abs/2607.02053 Tags: math.OC Score: 0 Title: Lower Bounds for Anytime Acceleration of Gradient Descent Domain: math.OC Source: arxiv Authors: Chung-En Tsai, Ilyas Fatkhullin, Liang Zhang, Niao He Reviews: 0 Subject: math.OC Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-07-02 Page: https://delphi.science/r/arxiv/2607.02053 Recent work suggests that the convergence rate of gradient descent (GD) in smooth convex optimization can be significantly improved by employing large stepsizes that may violate the descent property. In particular, if the total number of iterations $n$ is given, an $O(n^{-1.271})$ convergence rate can be achieved for both function value and squared gradient norm minimization. On the other hand, in the setting of anytime convergence, where $n$ is not known in advance, the best known rates of GD are much slower: $O(n^{-1.119})$ for function value minimization and $O(n^{-1})$ for squared…