{"id":"arxiv/2605.00298","url":"https://arxiv.org/abs/2605.00298","tags":["cs.LG","math.OC"],"score":0,"title":"Data Deletion Can Help in Adaptive RL","domain":"cs.LG","source":"arxiv","authors":["Param Budhraja","Aditya Gangrade","Alex Olshevsky","Venkatesh Saligrama"],"reviews":0,"subject":"cs.LG","summary":"Deploying reinforcement learning policies in the real world requires adapting to time-varying environments. We study this problem in the contextual Markov Decision Process (cMDP) framework, where a family of environments is indexed by a low-dimensional context unknown at test time. The standard approach decomposes the problem: train a so-called \"universal policy\" which assumes knowledge of the true context, then pair it with a context estimator which approximates context using the observed trajectory. We identify a simple, counterintuitive trick that substantially improves the estimator:…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-04-30","reactions":{}}