{"id":"arxiv/2605.19291","url":"https://arxiv.org/abs/2605.19291","tags":["stat.ML","cs.LG","math.ST"],"score":0,"title":"Factor Augmented High-Dimensional SGD","domain":"stat.ML","source":"arxiv","authors":["Shubo Li","Yuefeng Han","Xiufan Yu"],"reviews":0,"subject":"stat.ML","summary":"Stochastic gradient descent (SGD) is a fundamental optimization algorithm widely used in modern machine learning. In this paper, we propose Factor-Augmented SGD (FSGD), a new optimization method that leverages latent factor representations in high-dimensional learning tasks. Unlike standard two-stage dimension reduction approaches that rely on offline representation learning and full data storage, a key novelty of FSGD is that it operates purely on streaming data, making it scalable to large-scale and high-dimensional problems. Furthermore, we establish the first theoretical framework that…","category":"research","comments":0,"disputed":false,"division":"stat","mentions":0,"discussed":0,"published":"2026-05-19","reactions":{}}