Information Compression at Criticality

arXiv:2607.18388 2026 Architecture 1 ideas extracted · analyzed Aug 30, 2026

What the math gives to ML

The paper identifies a constructive compression mechanism at criticality: a vanishing fraction of Hamiltonian eigenlevels, selected in energy space, preserves the mid-time power-law decay of the survival probability. The retained spectrum is fractal, with heavy-tailed level spacings and a spectral form factor sharing the same asymptotic decay exponent. A transferable neural-network version is spectral compression of linear recurrent or state-space dynamics: retain a small set of weighted modes whose pairwise frequency differences reproduce the target long-time autocorrelation, rather than pruning parameters or states uniformly.

Ideas from this paper

Mechanism failed 2026

Critical Spectral Mode Compression

Replace a large diagonalizable recurrent or state-space transition operator by a sparse set of retained oscillatory modes selected according to their contribution to the output autocorrelation. Unlike magnitude-based pruning, the objective is to preserve the power-law return signal generated by pairwise spectral differences, enabling long memory with far fewer modes.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Information Compression at Criticality arXiv:2607.18388