Sharp Convex Concentration for Symmetric Random Tensors with Subgaussian Coordinates
arXiv:2608.19832
2026
Regularization
1 ideas extracted · analyzed Sep 1, 2026
What the math gives to ML
The paper proves a sharp, degree-aware concentration law for convex Lipschitz functions of symmetric tensor features X^{\otimes d}, separating radial fluctuations from nearly norm-preserving directional fluctuations. The transferable asset is an explicit tail scale of L n^{(d-1)/2} with both a d^2 penalty and a logarithmic directional penalty, rather than treating the tensor slots as independent. This can calibrate robust loss or gradient clipping for polynomial and tensorized neural layers, particularly when latent coordinates are whitened and approximately independent. The key experiment is whether theorem-based thresholds reduce gradient outliers without harming accuracy compared with generic clipping.
Ideas from this paper
Unverified
2026
Add a calibrated robustification rule after a symmetric polynomial feature map z(x)=vec(x^{\otimes d}). For a convex Lipschitz head or loss applied to z(x), compute a high-probability deviation radius from the paper's concentration rate and clip only examples beyond that radius. This explicitly accounts for the large radial fluctuations created by reusing the same vector in every tensor slot.
Useful5/10
Difficulty5/10
Novelty7/10