{"id":"arxiv/2605.13287","url":"https://arxiv.org/abs/2605.13287","tags":["cs.LG","cs.AI","math.OC","stat.ML"],"score":0,"title":"Delightful Exploration","domain":"cs.LG","source":"arxiv","authors":["Ian Osband"],"reviews":0,"subject":"cs.LG","summary":"Most exploration algorithms search broadly until uncertainty is resolved. When the action space is too large to resolve within budget, practitioners default to $\\varepsilon$-greedy, which bounds disruption but spends its override blindly. We introduce \\textit{Delight-gated exploration} (DE), a host--override rule that spends exploratory actions only when their prospective delight (expected improvement times surprisal) exceeds a gate price. This practical heuristic recovers a classical result: Pandora's reservation-value rule for costly search, with surprisal setting the effective inspection…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-05-13","reactions":{}}