On Toeplitz determinants with slow Fourier decay

arXiv:2608.13182 2026 Architecture 1 ideas extracted · analyzed Sep 1, 2026

What the math gives to ML

The paper isolates an explicit finite-size quadratic contribution to the log-determinant of Toeplitz matrices whose log-symbol has only 1/|k| Fourier decay, while showing that each fixed higher-order term remains bounded. This suggests a structured neural operator with deliberately slow spectral decay: it can represent long-range interactions without treating all frequencies as independent, while a computable quadratic spectral budget controls the dominant growth of its log-volume or normalization. The most practical transfer is to use Toeplitz or circulant layers parameterized in the Fourier domain, together with a log-determinant regularizer after subtracting the analytically known quadratic term. The proposal is falsifiable through conditioning, long-context accuracy, and cost comparisons against dense attention and ordinary convolution.

Ideas from this paper

Unverified 2026

Quadratic-budget Toeplitz long-range layer

Replace a dense translation-invariant interaction matrix with a positive-definite Toeplitz kernel K_n(e^f) whose log-spectrum is parameterized by a small number of Fourier coefficients with 1/|k| decay. Use the paper's explicit quadratic term as a spectral-volume budget, allowing long-range structure while discouraging uncontrolled determinant growth and ill-conditioning. Subtracting this term from a log-determinant regularizer leaves a residual intended to capture higher-order deviations from…

Useful6/10
Difficulty6/10
Novelty7/10
Paper: On Toeplitz determinants with slow Fourier decay arXiv:2608.13182