{"id":"arxiv/2610.03667","url":"https://arxiv.org/abs/2610.03667","tags":["cs.LG","math.OC","stat.ML"],"score":0,"title":"Planning to Learn","domain":"cs.LG","source":"arxiv","authors":["Ian Osband"],"reviews":0,"subject":"cs.LG","summary":"Policy-gradient methods are central to modern reinforcement learning, including LLM post-training. When they struggle, the usual suspects are exploration, credit assignment and action-sampling noise. Classification has none of them. A classifier is a policy whose expected reward, its \\emph{expected accuracy}, is the probability it assigns to the correct label, and because that label is known, the policy gradient is exact and smooth. Yet exact policy gradient loses to cross-entropy, even on expected accuracy. The exact gradient is myopic: it values an update only by what it buys now, but each…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-10-02","reactions":{}}