Sets whose differences avoid a bracket quadratic
arXiv:2608.30078
2026
Architecture
1 ideas extracted · analyzed Sep 1, 2026
What the math gives to ML
The paper develops a concrete Heisenberg-nilmanifold representation of bracket-quadratic phases such as $e(-\theta n\lfloor \beta n\rfloor)$ and proves that quantitative equidistribution of the corresponding nilmanifold orbit forces exponential-sum cancellation. This gives a mathematically structured alternative to ordinary sinusoidal positional encodings: positions are mapped through a discontinuous, noncommutative phase whose long-range correlations can be bounded rather than learned from scratch. The most direct transfer is a deterministic bracket-polynomial positional encoding for long-context transformers, optionally combined with several irrational frequencies and a learned projection. The expected benefit is reduced positional aliasing and more uniform position-feature correlations at negligible inference cost.
Ideas from this paper
Unverified
2026
Replace or augment standard sinusoidal or RoPE position features with bracket-quadratic phases $e(-\theta n\lfloor\beta n\rfloor)$ generated by a Heisenberg nilmanifold orbit. Multiple irrational coefficients and output frequencies produce a cheap deterministic encoding whose empirical cross-position correlations should exhibit cancellation instead of the periodic aliasing of rational or finite-frequency encodings.
Useful5/10
Difficulty3/10
Novelty7/10