Sharp $L^2$-Caffarelli--Kohn--Nirenberg and weighted Poincaré inequalities on half-spaces and orthants and their stability

arXiv:2608.16803 2026 Regularization 1 ideas extracted · analyzed Sep 1, 2026

What the math gives to ML

The paper derives sharp weighted Caffarelli–Kohn–Nirenberg inequalities and stability deficits on half-spaces and orthants. Their transferable asset is a scale-aware relation between weighted feature magnitude and weighted input sensitivity, with explicit extremal structure and deficit measurements. A neural-network adaptation is to regularize intermediate features whose responses are excessively concentrated in input space or require large Jacobians. The resulting penalty is distinct from ordinary weight decay because it controls the joint geometry of activations and input derivatives.

Ideas from this paper

Unverified 2026

Weighted CKN feature-stability regularizer

Apply a weighted Caffarelli–Kohn–Nirenberg deficit to selected intermediate feature channels. The penalty discourages features that obtain large weighted responses only by becoming sharply localized or highly sensitive to small input perturbations. It can be evaluated with input-Jacobian estimates and added to the ordinary task loss.

Useful5/10
Difficulty5/10
Novelty5/10
Paper: Sharp $L^2$-Caffarelli--Kohn--Nirenberg and weighted Poincaré inequalities on half-spaces and orthants and their stability arXiv:2608.16803