Sharp Convex Concentration for Symmetric Random Tensors with Subgaussian Coordinates

arXiv:2608.19832 2026 Regularization 1 ideas extracted · analyzed Sep 1, 2026

What the math gives to ML

The paper proves a sharp, degree-aware concentration law for convex Lipschitz functions of symmetric tensor features X^{\otimes d}, separating radial fluctuations from nearly norm-preserving directional fluctuations. The transferable asset is an explicit tail scale of L n^{(d-1)/2} with both a d^2 penalty and a logarithmic directional penalty, rather than treating the tensor slots as independent. This can calibrate robust loss or gradient clipping for polynomial and tensorized neural layers, particularly when latent coordinates are whitened and approximately independent. The key experiment is whether theorem-based thresholds reduce gradient outliers without harming accuracy compared with generic clipping.

Ideas from this paper

Unverified 2026

Degree-Aware Tensor Concentration Clipper

Add a calibrated robustification rule after a symmetric polynomial feature map z(x)=vec(x^{\otimes d}). For a convex Lipschitz head or loss applied to z(x), compute a high-probability deviation radius from the paper's concentration rate and clip only examples beyond that radius. This explicitly accounts for the large radial fluctuations created by reusing the same vector in every tensor slot.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Sharp Convex Concentration for Symmetric Random Tensors with Subgaussian Coordinates arXiv:2608.19832