Self-Normalizing Denominators in Rational Causal Estimation
arXiv:2608.20223
2026
Regularization
1 ideas extracted · analyzed Sep 1, 2026
What the math gives to ML
The paper identifies covariance-polynomial denominators whose sampling noise is exactly multiplicative: their relative uncertainty is constant rather than increasing when the denominator becomes small. For the front-door covariance minor, this yields the exact Gaussian variance relation \(\operatorname{avar}(\sqrt{n}(\hat D-D))=10D^2\), so an apparent denominator-strength diagnostic is identically uninformative. The transferable asset is a scale-free treatment of positive covariance determinants and ratios: neural causal or covariance-prediction modules should model log-denominators and relative error, not penalize small raw denominators. This is most useful as a stability and uncertainty-calibration layer for neural estimators that compute ratios of learned covariance statistics.
Ideas from this paper
Unverified
2026
For a neural module that forms causal or statistical ratios from minibatch covariances, replace raw denominator penalties and raw-scale uncertainty weights with a log-denominator or relative-error objective. The front-door covariance minor has variance proportional to its squared magnitude, so a small denominator is not intrinsically evidence of poor estimation under the Gaussian model. This should prevent the network from spuriously avoiding valid representations merely because their…
Useful5/10
Difficulty4/10
Novelty7/10