{"id":"arxiv/2605.10288","url":"https://arxiv.org/abs/2605.10288","tags":["cs.LG","math.OC"],"score":0,"title":"BROS: Bias-Corrected Randomized Subspaces for Memory-Efficient Single-Loop Bilevel Optimization","domain":"cs.LG","source":"arxiv","authors":["Hengrui Zhang","Boao Kong","Engao Zhang","Kun Yuan"],"reviews":0,"subject":"cs.LG","summary":"Stochastic bilevel optimization (SBO) has become a standard framework for hyperparameter learning, data reweighting, representation learning, and data-mixture optimization in deep learning. Existing exact single-loop SBO methods and memory-efficient surrogate SBO methods either create severe memory pressure for large lower-level neural networks or lack competitive convergence guarantees under standard assumptions. In this paper, we propose BROS, a memory-efficient single-loop SBO method with the same convergence rate order as exact single-loop SBO methods. BROS performs lower and auxiliary…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-05-11","reactions":{}}