{"id":"arxiv/2606.31856","url":"https://arxiv.org/abs/2606.31856","tags":["cs.LG","math.GT"],"score":0,"title":"Low-dimensional topology of deep neural networks","domain":"cs.LG","source":"arxiv","authors":["Junyu Ren","Lek-Heng Lim"],"reviews":0,"subject":"cs.LG","summary":"We study layered models, including feedforward networks, ResNets, and transformers, by limiting each layer to a width of $d = 3$, i.e., $\\mathbb{R}^3$ as representation space. This allows us to track how a neural network changes low-dimensional topological invariants through its layers. Just about any topological structure may be simplified or even trivialized by simply increasing dimension; e.g., any knot is equivalent to an unknot in $\\mathbb{R}^4$. By restricting to $\\mathbb{R}^3$, we not only isolate the effects of activation and depth from that of width, we work in a space that lends…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-06-30","reactions":{}}