{"id":"arxiv/2602.17086","url":"https://arxiv.org/abs/2602.17086","tags":["econ.TH","cs.LG","math.ST"],"score":0,"title":"Dynamic Decision-Making under Model Misspecification: A Stochastic Stability Approach","domain":"econ.TH","source":"arxiv","authors":["Xinyu Dai","Daniel Chen","Yian Qian"],"reviews":0,"subject":"econ.TH","summary":"Dynamic decision-making under model uncertainty is central to many economic environments, yet existing bandit and reinforcement learning algorithms rely on the assumption of correct model specification. This paper studies the behavior and performance of one of the most commonly used Bayesian reinforcement learning algorithms, Thompson Sampling (TS), when the model class is misspecified. We first provide a complete dynamic classification of posterior evolution in a misspecified two-armed Gaussian bandit, identifying distinct regimes: correct model concentration, incorrect model concentration,…","category":"research","comments":0,"disputed":false,"division":"econ","mentions":0,"discussed":0,"published":"2026-02-19","reactions":{}}