Thermodynamic formalism for intermittent maps with multiple neutral fixed points and phase transitions
arXiv:2608.12784
2026
Architecture
1 ideas extracted · analyzed Sep 1, 2026
What the math gives to ML
The paper provides a constructive mechanism for systems with several intermittently neutral fixed points: trajectories can spend power-law residence times near different fixed points, while a pressure variational principle selects between entropy-rich and low-entropy phases. Near a neutral point, the local displacement scales as |f(x)-x| approximately b_k|x-xi_k|^(1+alpha_k), producing polynomial rather than exponential escape. A transferable neural-network construction is an intermittent multi-mode residual or routing state whose neutral modes preserve information for long periods, with a temperature-like parameter controlling an entropy-versus-preference phase transition. The key falsifiable signatures are power-law residence-time tails and a sharp change in mode occupancy or entropy when competing pressure branches cross.
Ideas from this paper
Unverified
2026
Add a bounded routing state to an RNN, state-space model, or mixture-of-experts layer, with several neutral fixed points representing persistent modes. The state moves between modes when far from a fixed point but escapes each mode only polynomially when close to it, creating controllable long memory without setting a linear eigenvalue arbitrarily close to one. A temperature parameter selects between an entropy-rich phase using many modes and a low-entropy phase concentrated near one preferred…
Useful6/10
Difficulty5/10
Novelty8/10