On polynomial expanders with many variables
arXiv:2608.26349
2026
Architecture
1 ideas extracted · analyzed Aug 29, 2026
What the math gives to ML
The paper proves a concrete anti-collision property for a structured homogeneous polynomial: although it maps n+2 variables to one scalar, its image on any finite alphabet A has cardinality at least a constant times |A|^n. This is a combinatorial expansion guarantee rather than a numerical approximation result, so its most plausible ML use is a fixed polynomial mixing or hashing layer for discrete feature tuples, where preserving many distinct codes can reduce representation collisions. The main engineering risk is that high-degree monomials can create severe scale and gradient problems on continuous inputs; the first test should therefore use bounded categorical embeddings and compare collision rates and downstream accuracy against standard learned projections and random hashing.
Ideas from this paper
Unverified
2026
Insert a fixed polynomial mixer before an MLP or retrieval index for tuples of discrete features. The mixer maps n+2 bounded scalar feature codes to one or several expanded scalar codes, and the paper's theorem guarantees that its image cannot collapse below order |A|^n when all coordinates come from a finite alphabet A. Use multiple independent permutations or coefficient choices to obtain a vector representation while retaining the deterministic algebraic structure.
Useful4/10
Difficulty4/10
Novelty7/10