{"id":"arxiv/2609.33240","url":"https://arxiv.org/abs/2609.33240","tags":["cs.LG","math.OC"],"score":0,"title":"The Price of Locality: Why Forward-Forward Underperforms Backpropagation?","domain":"cs.LG","source":"arxiv","authors":["Zhaoxian Wu","Haichuan Liu","Tianyi Chen"],"reviews":0,"subject":"cs.LG","summary":"The Forward-Forward Algorithm (FFA) replaces backpropagation (BP) with layer-wise local contrastive objectives, eliminating the backward pass and the need to retain intermediate activations, yet suffers a persistent performance gap with BP that worsens with depth. This paper diagnoses two structural failure modes: an optimization floor arising from concurrent local updates; and a geometric collapse of layer representations driven by the local update mechanism. On the optimization side, we prove that the FFA loss satisfies the Polyak--Lojasiewicz inequality at each layer; however,…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-09-27","reactions":{}}