Cubic-Root Gaussian Approximation under Unrestricted Covariance

arXiv:2608.30221 2026 Training 1 ideas extracted · analyzed Sep 1, 2026

What the math gives to ML

The paper gives a sharper high-dimensional Gaussian approximation for maxima of sums of independent, coordinatewise subexponential variables under completely unrestricted covariance, improving the dominant rate from roughly n^{-1/4} to n^{-1/3} up to logarithmic factors. The transferable asset is a covariance-aware approximation for correlated coordinatewise extremes that does not require a low-rank or well-conditioned covariance matrix. A practical neural-network use is to calibrate simultaneous gradient or activation clipping thresholds from a correlated Gaussian surrogate instead of noisy empirical quantiles or independence-based approximations.

Ideas from this paper

Unverified 2026

Covariance-aware Gaussian clipping calibration

Use the Gaussian approximation of a high-dimensional maximum to set a simultaneous coordinate-clipping threshold for minibatch gradients or activations. The threshold is sampled from a correlated Gaussian with the observed batch covariance, rather than treating coordinates as independent or estimating an unstable extreme quantile directly.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Cubic-Root Gaussian Approximation under Unrestricted Covariance arXiv:2608.30221