{"id":"arxiv/2605.17811","url":"https://arxiv.org/abs/2605.17811","tags":["cs.LG","cs.AI","math.OC"],"score":0,"title":"One Model, Two Roles: Emergent Specialization in a Shared Recurrent Transformer","domain":"cs.LG","source":"arxiv","authors":["Jucheng Shen","Barbara Su","Anastasios Kyrillidis"],"reviews":0,"subject":"cs.LG","summary":"Can a shared-weight recurrent Transformer develop distinct internal roles without being partitioned into separate modules? We study this in Asymmetric Input Recurrence (AIR), a minimal two-state reasoning architecture in which the same Transformer model is reused for both updates (per literature, L and H) and the only built-in difference in the update rule is that the encoded input is injected during L-updates but not H-updates. Across Sudoku-Extreme and Maze, decoded rollouts reveal a consistent split: $\\zH$ behaves like a fully committed proposal state, whereas $\\zL$ retains local…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-05-18","reactions":{}}