Unverified
2026
Log-Rank Fluctuation Channels
Augment a causal sequence model with a small hierarchy of prefix summaries weighted by powers of the logarithmic rank of each preceding token. The summaries retain order-sensitive deviations from a baseline representation while costing O(KNd) for sequence length N, hierarchy width K, and hidden dimension d, instead of O(N^2d) dense attention.
Paper: A Logarithmic Fluctuation Hierarchy for Sequential Interacting Diffusions
arXiv:2607.22470