{"id":"arxiv/2609.10980","url":"https://arxiv.org/abs/2609.10980","tags":["cs.LG","cs.AI","math.OC"],"score":0,"title":"EGGROLL, Unrolled: Understanding and Improving Low-Rank Evolution Strategies at Scale","domain":"cs.LG","source":"arxiv","authors":["Ege C. Kaya","Abolfazl Hashemi"],"reviews":0,"subject":"cs.LG","summary":"EGGROLL (Sarkar et al., 2026) makes evolution strategies (ES) practical for LLMs by replacing dense Gaussian weight perturbations with low-rank Gaussian products, often of rank one. This choice is computationally attractive but geometrically severe: Each rank-one perturbation lies in a zero-volume subset of the ambient matrix space, despite having identity covariance. We characterize the EGGROLL update mean field at finite rank and nonzero perturbation radius as a resolvent applied to the gradient of the perturbation-smoothed objective. This transformation can make the mean field…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-09-10","reactions":{}}