Absolute continuity of two-dimensional polynomial random vectors
arXiv:2608.03922
2026
Regularization
1 ideas extracted · analyzed Aug 31, 2026
What the math gives to ML
The paper gives a quantitative anti-concentration principle for two-dimensional polynomial maps of independent random inputs: if the highest-degree components of the two outputs are not proportional, the joint law cannot place excessive probability on sets of very small area. Its transferable asset is the connection between algebraic non-degeneracy of top-order coefficient tensors and a lower bound on the expected determinant of the two-output Jacobian Gram matrix. This suggests a regularizer for low-dimensional continuous output heads that discourages local functional dependence and output-collapse onto curves. The idea is most relevant for VAE decoders, diffusion output heads, and learned two-dimensional coordinate maps.
Ideas from this paper
Unverified
2026
Add a two-output anti-collapse regularizer based on the determinant of the Jacobian Gram matrix, together with a penalty against proportional highest-degree coefficient tensors. The paper's inequality predicts that preserving coefficient non-proportionality prevents the output distribution from concentrating on thin curves or tiny regions, potentially improving coverage of a two-dimensional latent or generative output.
Useful4/10
Difficulty5/10
Novelty6/10