{"id":"arxiv/2607.07066","url":"https://arxiv.org/abs/2607.07066","tags":["cs.LG","cs.AI","math.NT","math.RT"],"score":0,"title":"Multiplication Beyond Groups: Stratified Fourier Mechanisms in Transformer Circuits","domain":"cs.LG","source":"arxiv","authors":["Zitong Andrew Chen","Junaid Hasan","Akhil Srinivasan","Hemkesh Bandi","Jarod Alper"],"reviews":0,"subject":"cs.LG","summary":"Transformers have demonstrated a remarkable ability to learn algorithmic reasoning, yet mechanistic analyses have mostly focused on globally invertible operations such as cyclic addition and group composition. In this work, we investigate how small transformers learn modular integer multiplication over composite moduli, a fundamentally non-invertible operation due to the presence of zero-divisors. We propose the monoid extension: a localized generalization of Group Composition via Representation (GCR) that suggests the learned computation does not rely on a single global representation…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-07-08","reactions":{}}