{"id":"arxiv/2606.12478","url":"https://arxiv.org/abs/2606.12478","tags":["cs.LG","cond-mat.stat-mech","quant-ph"],"score":0,"title":"Boltzmann Attention: Learnable Ising Couplings for Cooperative Attention","domain":"cs.LG","source":"arxiv","authors":["Gilhan Kim","Daniel K. Park"],"reviews":0,"subject":"cs.LG","summary":"Attention mechanisms are central to modern sequence models, yet standard attention computes relevance primarily through individual query--key similarities. Although softmax normalization introduces competition among positions, a standard attention layer does not explicitly parameterize learnable interactions between attention decisions. This limits its ability to directly model cooperative or antagonistic co-attention structure within the attention mechanism itself. We propose Boltzmann attention, an energy-based generalization in which attention patterns are governed by an interacting Ising…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-06-10","reactions":{}}