Optimal use of a black-box learner in semiparametric estimation
arXiv:2607.21541
2026
Training
1 ideas extracted · analyzed Aug 30, 2026
What the math gives to ML
The paper identifies a sharp way to prevent black-box nuisance errors from contaminating a target coefficient: its proposed estimator has error rate n^{-1/2}+delta_{a,mu} delta_{a,pi}+delta_s^2, eliminating the imbalance-sensitive term max(delta_{a,mu},delta_{a,pi}) delta_s. The transferable asset is adversarial conditional-moment calibration of inference weights produced by arbitrary learners. Neural networks can provide both nuisance estimates and adversarial test functions, with a constrained weight-editing layer applied after cross-fitting. The most direct experiment is partial-linear estimation with deliberately imbalanced nuisance difficulty, comparing DML against calibrated neural residualization for coefficient bias and confidence-interval coverage.
Ideas from this paper
✗ Mechanism failed
2026
Use neural networks to estimate outcome and treatment nuisances, then edit the resulting debiasing weights so that residualized treatment is conditionally orthogonal to an adversarial class of covariate functions. This should reduce coefficient bias when the two nuisance networks have strongly imbalanced approximation errors, without requiring either network to be correctly specified.
Useful7/10
Difficulty5/10
Novelty7/10