{"id":"arxiv/2610.24441","url":"https://arxiv.org/abs/2610.24441","tags":["cs.LG","math.NA","math.ST"],"score":0,"title":"Transformers as Adaptive Kernel Learners across Tasks for In-Context Learning","domain":"cs.LG","source":"arxiv","authors":["Zhaiming Shen","Alexander Cloninger","Rongjie Lai","Wenjing Liao"],"reviews":0,"subject":"cs.LG","summary":"Transformers have emerged as a dominant architecture in modern machine learning, with in-context learning (ICL) enabling models to adapt to new tasks by conditioning on prompts, without any parameter updates. To understand the attention mechanism in transformer blocks, a growing line of theoretical work interprets ICL through the lens of classical statistical estimators. Recent works have established a connection between the attention mechanism and kernel methods, while the kernel function is usually assumed to be fixed. In practice, the query and key matrices in the attention mechanism are…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-10-17","reactions":{}}