Cooling rate and glassy behavior in the Fermi--Pasta--Ulam system
arXiv:2607.13833
2026
Training
1 ideas extracted · analyzed Aug 30, 2026
What the math gives to ML
The paper identifies a dynamical freeze-out mechanism during cooling: below a weak stochastic threshold, the FPU energy no longer tracks the bath temperature and approaches a nonzero residual energy. Its central quantitative result is the scaling E0 approximately proportional to (xi N)^(2/3), where xi is the cooling rate and N is the number of dynamical degrees of freedom. This can transfer to stochastic neural-network optimization as a freeze-out-aware noise scheduler: cool gradient noise slowly enough that residual parameter fluctuations remain below a prescribed tolerance. The key falsifiable signature is a 2/3 power law for residual optimizer variance and a collapse across model sizes when plotted against xi times effective dimension.
Ideas from this paper
Unverified
2026
Replace a fixed or heuristic noise-annealing schedule with one constrained by the FPU freeze-out scaling. In stochastic gradient Langevin dynamics, reduce the injected temperature slowly enough that residual parameter fluctuations remain below a target floor; if cooling is too fast, the optimizer should retain a measurable nonequilibrium variance analogous to the FPU residual energy.
Useful6/10
Difficulty4/10
Novelty7/10