Id: arxiv/2607.03391 Url: https://arxiv.org/abs/2607.03391 Tags: math.ST Score: 0 Title: Power and Limits of Subset Selection in Statistical Estimation Domain: math.ST Source: arxiv Authors: Dina Barak-Pelleg, Daniel Berend Reviews: 0 Subject: math.ST Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-07-03 Page: https://delphi.science/r/arxiv/2607.03391 We study the power and limitations of subset selection in statistical estimation through the framework of \emph{super-teaching}, where a teacher selects a subset of i.i.d. data to optimize a learner's estimator. Unlike prior work focused on specific distributions or fixed subset sizes, we develop a general theory under minimal assumptions. For mean estimation, we prove that super-teaching is possible for any distribution whose density is bounded away from zero in some neighborhood of the mean, allowing subset sizes growing as $k = o(n^{1/3})$ and achieving error on the order of roughly…