{"id":"arxiv/2609.31458","url":"https://arxiv.org/abs/2609.31458","tags":["stat.ML","cs.LG","math.ST"],"score":0,"title":"Nonparametric In-Context Learning under Growing Geometric Complexity: Minimax Optimality and Local Geometry-Adaptivity of Transformers","domain":"stat.ML","source":"arxiv","authors":["Jaehee Seo","Jisu Kim"],"reviews":0,"subject":"stat.ML","summary":"Transformers have become a central architecture for in-context learning (ICL), particularly through their state-of-the-art performance in large language models. This success motivates understanding how transformers exploit task-relevant structure in geometrically heterogeneous data. However, existing nonparametric ICL theory has largely focused on Euclidean domains or single-manifold models. To address this gap, we study the prediction problem under unknown local geometry, modeled by sample size-dependent mixtures of manifolds with heterogeneous dimensions, smoothness, and sampling masses.…","category":"research","comments":0,"disputed":false,"division":"stat","mentions":0,"discussed":0,"published":"2026-09-25","reactions":{}}