{"id":"arxiv/2608.07228","url":"https://arxiv.org/abs/2608.07228","tags":["cs.LG","math.OC"],"score":0,"title":"Learning Suffers More Than the Policy Class Under Partial Observability: A Closed-Form Analysis","domain":"cs.LG","source":"arxiv","authors":["Idil Gözel"],"reviews":0,"subject":"cs.LG","summary":"When a reinforcement learning agent cannot observe the full state, we usually blame its policies: it cannot see enough to represent a good one. We show that in a solvable case the bigger problem lies elsewhere. Even when a good policy is available and the agent's value function is expressive enough to describe it exactly, learning still ends up somewhere far worse. We study a partially observed linear-quadratic problem in which a standard actor-critic learner can be solved in closed form. At our default setting the best policy the agent can represent is already close to optimal, costing…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-08-07","reactions":{}}