Stability for the Affine Sobolev Inequality and its Critical Points for $p\ge 2$

arXiv:2607.06415 2026 Regularization 1 ideas extracted · analyzed Aug 30, 2026

What the math gives to ML

The paper introduces an affine Sobolev energy that aggregates directional derivatives through a negative-power average over the unit sphere, rather than using only the ordinary Euclidean gradient norm. This construction is sensitive to all directions and is designed to respect affine changes of coordinates, making it a plausible regularizer for neural functions whose input geometry is anisotropic or poorly conditioned. The most direct transfer is a stochastic directional-Jacobian penalty, tested against standard isotropic input-gradient regularization on small vision and tabular models.

Ideas from this paper

Unverified 2026

Affine directional Sobolev regularizer

Replace the usual squared input-Jacobian penalty with a stochastic approximation of the affine Sobolev energy, which computes an inverse-power spherical average of directional derivative norms. The negative exponent emphasizes directions with unusually small sensitivity and prevents the regularizer from being represented only by the largest-gradient direction.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Stability for the Affine Sobolev Inequality and its Critical Points for $p\ge 2$ arXiv:2607.06415