{"id":"arxiv/2604.19018","url":"https://arxiv.org/abs/2604.19018","tags":["cs.LG","cs.AI","eess.SY","math.OC","stat.ML"],"score":0,"title":"Local Linearity of LLMs Enables Activation Steering via Model-Based Linear Optimal Control","domain":"cs.LG","source":"arxiv","authors":["Julian Skifstad","Xinyue Annie Yang","Glen Chou"],"reviews":0,"subject":"cs.LG","summary":"Inference-time LLM alignment methods, particularly activation steering, offer an alternative to fine-tuning by directly modifying activations during generation. Existing methods, however, often rely on non-anticipative interventions that ignore how perturbations propagate through transformer layers and lack online error feedback, resulting in suboptimal, open-loop control. To address this, we show empirically that, despite the nonlinear structure of transformer blocks, layer-wise dynamics across multiple LLM architectures and scales are well-approximated by locally-linear models. Exploiting…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-04-21","reactions":{}}