Small Denominators and Subresonant Accumulation in Weakly Nonlinear Dispersive Dynamics

arXiv:2607.01447 2026 Architecture 1 ideas extracted · analyzed Aug 30, 2026

What the math gives to ML

The paper isolates a constructive small-denominator mechanism by which infinitely many individually nonresonant interactions accumulate into a polynomial-in-time response. Its transferable asset is the explicit relation between detuning decay, coefficient decay, and memory growth: Delta_n ~ c n^{-p} and B_n ~ b n^{-kappa} produce t^{1-alpha} growth with alpha=(kappa-1)/p. This can be turned into a structured state-space memory bank whose low-frequency modes deliberately implement power-law memory, rather than learning long memory from unconstrained recurrent weights. The same formula also supplies a falsifiable initialization and scaling rule for long-context sequence models.

Ideas from this paper

Mechanism failed 2026

Subresonant Power-Law Memory Bank

Add a deterministic complex-valued state-space bank whose mode detunings become progressively smaller with mode index, Delta_n=c n^{-p}, while input couplings decay as B_n=b n^{-kappa}. For slowly varying or constant forcing, the summed state follows the paper's subresonant response and grows like t^{1-alpha}, providing controllable power-law memory with only O(N) recurrent state updates. This should improve long-context retention compared with a same-size unconstrained RNN or uniformly spaced…

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Small Denominators and Subresonant Accumulation in Weakly Nonlinear Dispersive Dynamics arXiv:2607.01447