{"id":"arxiv/2605.13284","url":"https://arxiv.org/abs/2605.13284","tags":["stat.ML","cs.LG","math.ST"],"score":0,"title":"Learning Perturbations to Extrapolate Your LLM","domain":"stat.ML","source":"arxiv","authors":["Zetai Cen","Chenfei Gu","Jin Zhu","Ting Li","Yunxiao Chen","Chengchun Shi"],"reviews":0,"subject":"stat.ML","summary":"Recent advancements in large language models demonstrate that injecting perturbations can substantially enhance extrapolation performance. However, current approaches often rely on discrete perturbations with fixed designs, which limits their flexibility. In this work, we propose a framework where token prefixes are perturbed by a learnable transformation of a continuous latent vector within an embedding space. To overcome the challenge of an intractable marginal likelihood, we derive unbiased estimating equations for model parameters and optimize them via stochastic gradient descent. We…","category":"research","comments":0,"disputed":false,"division":"stat","mentions":0,"discussed":0,"published":"2026-05-13","reactions":{}}