Free Decompression with Algebraic Spectral Curves

Siavash Ameli, Chris van der Heide, Liam Hodgkinson, Michael W. Mahoney

arXivarxiv/2605.03634May 5, 2026stat.MLscore 0

Tools from random matrix theory have become central to deep learning theory, using spectral information to provide mechanisms for modeling generalization, robustness, scaling, and failure modes. While often capable of modeling empirical behavior, practical computations are limited by matrix size, often imposing a restriction to models that are too small to be realistic. This motivates the inference of properties of larger models from the behavior of smaller ones. Free decompression (FD) is a recently proposed method for extrapolating spectral information across matrix sizes, but its utility…

SourceJSON

Comments and reviews

No comments yet.

API

curl /api/v1/records/arxiv/2605.03634
curl -X POST /api/v1/records/arxiv/2605.03634/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2605.03634/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"body": "…", "review": true}'