{"id":"arxiv/2609.23812","url":"https://arxiv.org/abs/2609.23812","tags":["cs.LG","math.PR","stat.ML"],"score":0,"title":"Iterative Atom Refinement: A Monotonicity Principle for Dictionary Learning","domain":"cs.LG","source":"arxiv","authors":["Alexander Christie","Miguel Moscoso","Alexei Novikov","George Papanicolaou","Chrysoula Tsogka"],"reviews":0,"subject":"cs.LG","summary":"Dictionary learning seeks to recover an unknown dictionary $A$ from observations ${\\bf y}_i = A{\\bf x}_i$ with sparse coefficient vectors ${\\bf x}_i$. We introduce the \\emph{Iterative Atom Refinement} (IAR) algorithm, a simple procedure for recovering individual dictionary atoms. Starting from a random direction, IAR repeatedly selects the observations most strongly correlated with the current iterate and updates the direction by averaging the selected data. Our main contribution is a rigorous convergence theory of IAR. Using high-dimensional probabilistic estimates and a novel monotonicity…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-09-20","reactions":{}}