Multiplier Bootstrap and Edge Phase Transitions of High-Dimensional Covariance Matrices
arXiv:2608.15053
2026
Training
1 ideas extracted · analyzed Sep 1, 2026
What the math gives to ML
The paper identifies a nonstandard failure mode of multiplier bootstrap for extreme eigenvalues in high-dimensional covariance problems: the bootstrap law can switch between Tracy–Widom, Gaussian, Weibull, Fréchet, and Gumbel regimes depending on multiplier tails, aspect ratio, and population spikes. The transferable asset is a phase-aware spectral diagnostic that separates genuine low-rank spikes from bulk fluctuations in finite-width neural representations. A practical neural-network use is to apply bounded multiplier resampling to activation or gradient covariance matrices, estimate whether leading eigenvalues are statistically exceptional, and activate low-rank preconditioning or representation regularization only when supported by the diagnostic. The paper’s resolvent sign-change construction also suggests a computational outlier detector based on a scalar secular equation rather than repeatedly computing every eigenvalue.
Ideas from this paper
Unverified
2026
Use multiplier bootstrap on minibatch activation covariances to determine whether a large top eigenvalue is a genuine representation direction or merely a high-dimensional bulk fluctuation. When a spike is repeatedly significant, apply a low-rank whitening or shrinkage correction to that activation subspace; otherwise leave the layer unchanged, avoiding destructive whitening of ordinary bulk variation.
Useful5/10
Difficulty5/10
Novelty7/10