A Sharp Small-Coefficient Variant of Khintchine's Inequality and the Sharp $π/2$ Theorem

arXiv:2608.29703 2026 Regularization 1 ideas extracted · analyzed Sep 1, 2026

What the math gives to ML

The paper gives a quantitative Gaussianization guarantee for signed sums that improves the classical linear-in-the-largest-coefficient estimate to a quadratic O(β²) error after unit-ℓ2 normalization. This is transferable to binary or sign-noised neural layers, whose preactivations are weighted Rademacher sums when inputs or injected noise are signs. The practical use is a coefficient-spreading regularizer and moment-calibration mechanism that makes binary-layer activation scales more predictable without relying entirely on batch normalization. The theorem provides a clear falsifiable prediction: absolute-moment error should scale like the square of the largest normalized coefficient.

Ideas from this paper

Unverified 2026

Quadratic Gaussianization for Sign Layers

Add coefficient-spreading and moment-calibration mechanisms to binary or sign-noised linear layers. For each output neuron, normalize its real-valued weights and penalize large normalized coordinates, so its signed preactivation obeys the paper's quadratic Gaussian approximation rather than the weaker linear bound. This should make activation scales more predictable and reduce training instability caused by highly concentrated binary projections.

Useful5/10
Difficulty3/10
Novelty4/10
Paper: A Sharp Small-Coefficient Variant of Khintchine's Inequality and the Sharp $π/2$ Theorem arXiv:2608.29703