{"id":"arxiv/2608.25745","url":"https://arxiv.org/abs/2608.25745","tags":["cs.LG","math.ST","stat.ML"],"score":0,"title":"Comparing Corrupted Constrained Learning Problems","domain":"cs.LG","source":"arxiv","authors":["Laura Iacovissi","Rabanus Derr","Robert C. Williamson"],"reviews":0,"subject":"cs.LG","summary":"A key result in statistics is the data processing inequality, originally proved by Blackwell (1951) and later refined by DeGroot (1962) in terms of statistical uncertainty. The latter statement claims that the Bayes risk achieved on raw data always undercuts the Bayes risk on a processed version of the same data. This seemingly contradicts empirical findings in machine learning: pre-training, representation learning, feature learning, data augmentation are techniques used to improve performance of machine learning models. We reconcile both worlds by simply accepting that machine learning…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-08-26","reactions":{}}