{"id":"arxiv/2607.28408","url":"https://arxiv.org/abs/2607.28408","tags":["cs.LG","cs.AI","math.ST","stat.ML"],"score":0,"title":"On-Policy and Off-Policy Learning for Large Action Spaces","domain":"cs.LG","source":"arxiv","authors":["Imad Aouali"],"reviews":0,"subject":"cs.LG","summary":"This thesis studies policy learning in interactive systems where an agent observes a context, selects an action from a very large set, and receives partial feedback. The main framework is contextual bandits, with two paradigms: on-policy learning, where the agent interacts sequentially with the environment and minimizes regret, and off-policy learning, where it learns from logged data collected by a logging policy. In large action spaces, both settings face major challenges: inefficient exploration, sparse data coverage, high-variance importance weights, extrapolation bias, and difficult…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-07-30","reactions":{}}