Id: arxiv/2603.20388 Url: https://arxiv.org/abs/2603.20388 Tags: math.ST, cs.LG, econ.EM, stat.ML Score: 0 Title: From Cross-Validation to SURE: Asymptotic Risk of Tuned Regularized Estimators Domain: math.ST Source: arxiv Authors: Karun Adusumilli, Maximilian Kasy, Ashia Wilson Reviews: 0 Subject: math.ST Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-03-20 Page: https://delphi.science/r/arxiv/2603.20388 We derive the asymptotic risk function of regularized empirical risk minimization (ERM) estimators tuned by $n$-fold cross-validation (CV). The out-of-sample prediction loss of such estimators converges in distribution to the squared-error loss (risk function) of shrinkage estimators in the normal means model, tuned by Stein's unbiased risk estimate (SURE). This risk function provides a more fine-grained picture of predictive performance than uniform bounds on worst-case regret, which are common in learning theory: it quantifies how risk varies with the true parameter. As key intermediate…