{"id":"arxiv/2606.05606","url":"https://arxiv.org/abs/2606.05606","tags":["cs.LG","cs.AI","math.OC"],"score":0,"title":"Cross-Epoch Adaptive Rollout Optimization for RL Post-Training","domain":"cs.LG","source":"arxiv","authors":["Yiming Zong","Yige Wang","Jiashuo Jiang"],"reviews":0,"subject":"cs.LG","summary":"LLM post-training often relies on reinforcement learning methods that sample multiple rollouts per prompt, yet most existing approaches use a fixed rollout budget for every prompt, despite large differences in the training signal different prompts provide. In this paper, we study adaptive rollout allocation under a fixed global budget and formulate the problem as online resource allocation with prompt-level diminishing returns. Our method, CERO, maintains a Beta posterior over each prompt's success probability and uses the posterior expected Bernoulli variance as a Bayesian estimate of the…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-06-04","reactions":{}}