Id: arxiv/2607.26032 Url: https://arxiv.org/abs/2607.26032 Tags: math.OC Score: 0 Title: Optimization under Persistent State-Dependent Bias: Gradient-based Method and Complexity Analysis Domain: math.OC Source: arxiv Authors: Zhaoxian Wu, Quan Xiao, Tayfun Gokmen, Tianyi Chen Reviews: 0 Subject: math.OC Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-07-28 Page: https://delphi.science/r/arxiv/2607.26032 This paper studies the convergence of stochastic gradient descent (SGD) when the implemented updates are subject to a persistent and state-dependent bias, in which the desired update is scaled by response functions component-wise. Our first contribution is to demonstrate that SGD in this setting implicitly optimizes a penalized problem whose minimizer does not coincide with the true minimizer. To mitigate this convergence failure, we reformulate the original task as an equivalent bilevel optimization problem and propose a gradient-based algorithm, termed Residual Learning. Theoretical…