Sets whose differences avoid a bracket quadratic

arXiv:2608.30078 2026 Architecture 1 ideas extracted · analyzed Sep 1, 2026

What the math gives to ML

The paper develops a concrete Heisenberg-nilmanifold representation of bracket-quadratic phases such as $e(-\theta n\lfloor \beta n\rfloor)$ and proves that quantitative equidistribution of the corresponding nilmanifold orbit forces exponential-sum cancellation. This gives a mathematically structured alternative to ordinary sinusoidal positional encodings: positions are mapped through a discontinuous, noncommutative phase whose long-range correlations can be bounded rather than learned from scratch. The most direct transfer is a deterministic bracket-polynomial positional encoding for long-context transformers, optionally combined with several irrational frequencies and a learned projection. The expected benefit is reduced positional aliasing and more uniform position-feature correlations at negligible inference cost.

Ideas from this paper

Unverified 2026

Heisenberg Bracket Positional Encoding

Replace or augment standard sinusoidal or RoPE position features with bracket-quadratic phases $e(-\theta n\lfloor\beta n\rfloor)$ generated by a Heisenberg nilmanifold orbit. Multiple irrational coefficients and output frequencies produce a cheap deterministic encoding whose empirical cross-position correlations should exhibit cancellation instead of the periodic aliasing of rational or finite-frequency encodings.

Useful5/10
Difficulty3/10
Novelty7/10
Paper: Sets whose differences avoid a bracket quadratic arXiv:2608.30078