Estimates of the total variation distance between laws of Sobolev mappings on Gaussian spaces
arXiv:2607.25645
2026
Regularization
1 ideas extracted · analyzed Aug 31, 2026
What the math gives to ML
The paper supplies a quantitative bridge from weak distributional distance to total variation when random mappings of a Gaussian input have sufficiently nondegenerate Malliavin derivatives. The transferable asset is the explicit fractional-regularity exponent s = \varkappa/[1+(2k-1)\varkappa/p], which approaches the small-ball exponent \varkappa as the Sobolev integrability p grows. In neural generative models, the Malliavin matrix becomes the output-Jacobian Gram matrix, so its determinant can be regularized directly to prevent locally collapsed latent directions. This suggests a principled generator regularizer and a diagnostic for whether Wasserstein or MMD improvements are likely to imply stronger density-level improvements.
Ideas from this paper
Unverified
2026
Regularize a generator so that the Gram determinant of its Jacobian with respect to Gaussian latent noise rarely becomes very small. This should reduce latent-space collapse and make the generated distribution more regular, improving the chance that small Wasserstein or MMD errors correspond to small density-level errors rather than narrow singular spikes.
Useful6/10
Difficulty6/10
Novelty7/10