{"id":"arxiv/2603.14608","url":"https://arxiv.org/abs/2603.14608","tags":["cs.LG","cs.AI","math.OC","stat.ML"],"score":0,"title":"Delightful Policy Gradient","domain":"cs.LG","source":"arxiv","authors":["Ian Osband"],"reviews":0,"subject":"cs.LG","summary":"Standard policy gradients weight each sampled action by advantage alone, regardless of how likely that action was under the current policy. This creates two pathologies: within a single decision context (e.g. one image or prompt), a rare negative-advantage action can disproportionately distort the update direction; across many such contexts in a batch, the expected gradient over-allocates budget to contexts the policy already handles well. We introduce the \\textit{Delightful Policy Gradient} (DG), which gates each term with a sigmoid of \\emph{delight}, the product of advantage and action…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-03-15","reactions":{}}