{"id":"arxiv/2609.12486","url":"https://arxiv.org/abs/2609.12486","tags":["eess.SY","cs.AI","cs.GT","math.OC"],"score":0,"title":"Adaptive Agent Design","domain":"eess.SY","source":"arxiv","authors":["Raj Kiriti Velicheti","Subhonmesh Bose","Tamer Başar"],"reviews":0,"subject":"eess.SY","summary":"We consider an agent acting against a general non-Markovian environment. The agent maintains its agent states, but is free to choose a transition kernel across those states and optimize its state-feedback control policies. We study the bi-level agent design problem that optimizes the transition kernel and the policy it induces, given said kernel with offline data of observations and actions obtained via a behavioral policy. For general environments, we show that a soft $Q$-learning algorithm converges almost surely to the fixed point of a soft Bellman equation defined by the stationary…","category":"research","comments":0,"disputed":false,"division":"eess","mentions":0,"discussed":0,"published":"2026-09-11","reactions":{}}