Long-range interactions and Anderson localisation for one-dimensional high-contrast resonator chain

arXiv:2607.04971 2026 Architecture 1 ideas extracted · analyzed Aug 30, 2026

What the math gives to ML

The paper identifies a concrete borderline interaction law, \(\mathcal{C}(n,m)\sim 1/(|n-m|\log^2|n-m|)\), which is absolutely summable but has a much heavier tail than the short-range kernels usually used in neural sequence mixers. This suggests a multiscale neural mixing operator whose distant interactions are retained through logarithmically decaying dyadic scales rather than discarded by a finite receptive field. The key engineering opportunity is to approximate this kernel with range-sum or FFT operations in \(O(L\log L)\) time and \(O(L)\) memory, while obtaining an explicit truncation-error estimate. This is most promising for long-context sequence models, graph networks on chain-like graphs, and lightweight replacements for attention when tasks require long-range but structured interactions.

Ideas from this paper

Unverified 2026

Critical-Tail Multiscale Mixer

Add a fixed or weakly parameterized residual mixer whose interaction between sequence positions at distance \(r\) is proportional to \(1/(r\log^2 r)\). Instead of truncating the kernel at a short radius, represent its heavy tail with dyadic distance bands and compute each band using prefix sums or block pooling, giving every token access to arbitrarily distant context at roughly \(O(L\log L)\) cost.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Long-range interactions and Anderson localisation for one-dimensional high-contrast resonator chain arXiv:2607.04971