{"id":"arxiv/2609.13040","url":"https://arxiv.org/abs/2609.13040","tags":["cs.LG","math.NA"],"score":0,"title":"Quantile-based Loss Filtering for Outlier-Robust Stochastic Gradient Descent","domain":"cs.LG","source":"arxiv","authors":["Jamie Haddock","Anna Ma","Elizaveta Rebrova"],"reviews":0,"subject":"cs.LG","summary":"We study loss-based filtering for finite-sum optimization with a subset of corrupted component functions whose gradients may be highly unreliable. Motivated by minimum-loss-based SGD (min-$k$-loss) and quantile-based methods for corrupted linear systems, we propose and analyze a general loss-filtering framework -- Quantile-\\(k\\)-Loss SGD (Q\\(k\\)L-SGD) -- that samples \\(k\\) component losses at each iteration and updates using an index chosen uniformly from the lower empirical \\(q\\)-quantile. We prove linear convergence of this family of methods under standard convexity assumptions, requiring…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-09-11","reactions":{}}