Information Compression at Criticality
arXiv:2607.18388
2026
Architecture
1 ideas extracted · analyzed Aug 30, 2026
What the math gives to ML
The paper identifies a constructive compression mechanism at criticality: a vanishing fraction of Hamiltonian eigenlevels, selected in energy space, preserves the mid-time power-law decay of the survival probability. The retained spectrum is fractal, with heavy-tailed level spacings and a spectral form factor sharing the same asymptotic decay exponent. A transferable neural-network version is spectral compression of linear recurrent or state-space dynamics: retain a small set of weighted modes whose pairwise frequency differences reproduce the target long-time autocorrelation, rather than pruning parameters or states uniformly.
Ideas from this paper
✗ Mechanism failed
2026
Replace a large diagonalizable recurrent or state-space transition operator by a sparse set of retained oscillatory modes selected according to their contribution to the output autocorrelation. Unlike magnitude-based pruning, the objective is to preserve the power-law return signal generated by pairwise spectral differences, enabling long memory with far fewer modes.
Useful7/10
Difficulty6/10
Novelty7/10