Hilbertian Kahane--Salem--Zygmund Inequalities: Extremizers and Quantitative Gaps

arXiv:2608.08246 2026 Architecture 1 ideas extracted · analyzed Sep 1, 2026

What the math gives to ML

The paper identifies signed multilinear tensors whose operator norm is essentially minimal, with exact equality governed by Hadamard matrices and Hurwitz–Radon families of pairwise anticommuting orthogonal matrices. This gives a directly implementable way to build parameter-free or low-parameter bilinear layers whose induced norm is exactly controlled, rather than relying on spectral normalization or repeated power iterations. The most promising transfer is a norm-preserving signed bilinear feature mixer: precompute a family of structured sign matrices, use them to map two feature vectors to a third, and learn only scalar gains or surrounding projections. Such layers could improve stability in deep multiplicative networks while requiring only fast Hadamard-like matrix-vector products.

Ideas from this paper

Unverified 2026

Hurwitz–Radon signed bilinear mixer

Replace a learned dense bilinear map with a structured family of signed orthogonal matrices. Given feature vectors y,z in R^n, produce r interaction features h_a = y^T H_a z / sqrt(n), where the H_a form a Hadamard/Clifford-like family; the resulting bilinear map has operator norm at most one when r is within the Hurwitz–Radon limit. Learn only channel projections and optional scalar gates around this fixed mixer.

Useful6/10
Difficulty6/10
Novelty7/10
Paper: Hilbertian Kahane--Salem--Zygmund Inequalities: Extremizers and Quantitative Gaps arXiv:2608.08246