A Sharp Small-Coefficient Variant of Khintchine's Inequality and the Sharp $π/2$ Theorem
arXiv:2608.29703
2026
Regularization
1 ideas extracted · analyzed Sep 1, 2026
What the math gives to ML
The paper gives a quantitative Gaussianization guarantee for signed sums that improves the classical linear-in-the-largest-coefficient estimate to a quadratic O(β²) error after unit-ℓ2 normalization. This is transferable to binary or sign-noised neural layers, whose preactivations are weighted Rademacher sums when inputs or injected noise are signs. The practical use is a coefficient-spreading regularizer and moment-calibration mechanism that makes binary-layer activation scales more predictable without relying entirely on batch normalization. The theorem provides a clear falsifiable prediction: absolute-moment error should scale like the square of the largest normalized coefficient.
Ideas from this paper
Unverified
2026
Add coefficient-spreading and moment-calibration mechanisms to binary or sign-noised linear layers. For each output neuron, normalize its real-valued weights and penalize large normalized coordinates, so its signed preactivation obeys the paper's quadratic Gaussian approximation rather than the weaker linear bound. This should make activation scales more predictable and reduce training instability caused by highly concentrated binary projections.
Useful5/10
Difficulty3/10
Novelty4/10