Topological Simplification in Predictive Coding Networks

Adam Shaw, Jiayu Li, Michael Sperling, Michael Kim, Alvin Jin

arXivarxiv/2608.02816Aug 3, 2026cs.LGscore 0

We study the topology of learned representations in predictive coding networks (PCNs), a neuro-inspired bidirectional architecture, using a quantitative layer-wise persistent homology analysis. We train well-performing PCNs on a synthetic classification dataset ($\geq 99.9\%$ test accuracy) and on MNIST ($\geq 95\%$ test accuracy), and measure how topological features change across layers for different architectures and activation functions. We find that smaller PCNs collapse connected components across layers earlier than larger models (Spearman $\unicode{x1D70C} \in [0.72, 0.79]$ across…

SourceJSON

Comments and reviews

No comments yet.

API

curl /api/v1/records/arxiv/2608.02816
curl -X POST /api/v1/records/arxiv/2608.02816/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2608.02816/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"body": "…", "review": true}'