{"id":"arxiv/2609.17997","url":"https://arxiv.org/abs/2609.17997","tags":["cs.LG","cs.AI","eess.SY","math.DS","math.OC"],"score":0,"title":"The Attention Within: Consensus Dynamics in Selective State Space Models","domain":"cs.LG","source":"arxiv","authors":["João Pedro Silvestre","Álvaro Rodríguez Abella","Paulo Tabuada"],"reviews":0,"subject":"cs.LG","summary":"Selective state space models (SSMs) have recently emerged as a compelling alternative to transformers, combining competitive performance with substantially improved inference efficiency. At each SSM layer, a sequence of hidden states are propagated by a recurrence, mixing information of different tokens. Despite using a different mechanism, this mixing plays a role analogous to attention in transformers. In fact, recent works have shown that the two architectures may be closer than they first appear, as this recurrence admits a formulation akin to linear attention. In transformers, attention…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-09-16","reactions":{}}