{"id":"arxiv/2604.20915","url":"https://arxiv.org/abs/2604.20915","tags":["cs.LG","cs.AI","cs.CL","cs.SE","math.OC"],"score":0,"title":"Absorber LLM: Harnessing Causal Synchronization for Test-Time Training","domain":"cs.LG","source":"arxiv","authors":["Zhixin Zhang","Shabo Zhang","Chengcan Wu","Zeming Wei","Meng Sun"],"reviews":0,"subject":"cs.LG","summary":"Transformers suffer from a high computational cost that grows with sequence length for self-attention, making inference in long streams prohibited by memory consumption. Constant-memory alternatives such as RNNs and SSMs compress history into states with fixed size and thus lose long-tail dependencies, while methods that memorize contexts into parameters, such as Test-Time Training (TTT), are prone to overfitting token-level projection and fail to preserve the causal effect of context in pretrained LLMs. We propose Absorber LLM, which formulates long-context retention as a self-supervised…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-04-22","reactions":{}}