LocalProp: Neuro-Localized Memory-Efficient Backpropagation

Diana-Nicoleta Grigore, Iuliana Georgescu, Radu Tudor Ionescu

arXivarxiv/2609.32517Sep 26, 2026cs.AIscore 0

The current deep learning training paradigm employs end-to-end backpropagation, regardless of the training stage, i.e. pre-training or fine-tuning. However, backpropagating through the entire model is neither biologically plausible nor memory efficient, since learning inside the brain is highly localized. Therefore, we propose LocalProp, a training procedure that locally updates the weights of a model. Our neuro-localized weight updates follow the "pre-training then fine-tuning" paradigm, where the pre-training is based on I-JEPA. After locally updating the weights, a pruning operation is…

SourceJSON

Comments and reviews

No comments yet.

API

curl /api/v1/records/arxiv/2609.32517
curl -X POST /api/v1/records/arxiv/2609.32517/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2609.32517/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"body": "…", "review": true}'