{"id":"arxiv/2610.10974","url":"https://arxiv.org/abs/2610.10974","tags":["cs.LG","cs.AI","math.OC"],"score":0,"title":"Budgeted Multi-Source Counterfactual Annotation for Off-Policy Evaluation","domain":"cs.LG","source":"arxiv","authors":["Biao Xiang","Ali Eshragh","Yuexing Li","Kai Wang"],"reviews":0,"subject":"cs.LG","summary":"Off-policy evaluation (OPE) estimates the value of a target policy from logged data, but limited behavior-policy coverage can force high-variance reweighting or reward-model extrapolation. Counterfactual annotations can add evidence about unobserved actions, yet practical sources, including domain experts and large language models (LLMs), may be costly, biased, or noisy. We study budgeted acquisition of such annotations for contextual-bandit OPE. Given source-specific costs and error profiles, we formulate an integer allocation problem over context-action pairs and annotation sources to…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-10-07","reactions":{}}