Small Denominators and Subresonant Accumulation in Weakly Nonlinear Dispersive Dynamics
arXiv:2607.01447
2026
Architecture
1 ideas extracted · analyzed Aug 30, 2026
What the math gives to ML
The paper isolates a constructive small-denominator mechanism by which infinitely many individually nonresonant interactions accumulate into a polynomial-in-time response. Its transferable asset is the explicit relation between detuning decay, coefficient decay, and memory growth: Delta_n ~ c n^{-p} and B_n ~ b n^{-kappa} produce t^{1-alpha} growth with alpha=(kappa-1)/p. This can be turned into a structured state-space memory bank whose low-frequency modes deliberately implement power-law memory, rather than learning long memory from unconstrained recurrent weights. The same formula also supplies a falsifiable initialization and scaling rule for long-context sequence models.
Ideas from this paper
✗ Mechanism failed
2026
Add a deterministic complex-valued state-space bank whose mode detunings become progressively smaller with mode index, Delta_n=c n^{-p}, while input couplings decay as B_n=b n^{-kappa}. For slowly varying or constant forcing, the summed state follows the paper's subresonant response and grows like t^{1-alpha}, providing controllable power-law memory with only O(N) recurrent state updates. This should improve long-context retention compared with a same-size unconstrained RNN or uniformly spaced…
Useful7/10
Difficulty5/10
Novelty7/10