Optimal use of a black-box learner in semiparametric estimation

arXiv:2607.21541 2026 Training 1 ideas extracted · analyzed Aug 30, 2026

What the math gives to ML

The paper identifies a sharp way to prevent black-box nuisance errors from contaminating a target coefficient: its proposed estimator has error rate n^{-1/2}+delta_{a,mu} delta_{a,pi}+delta_s^2, eliminating the imbalance-sensitive term max(delta_{a,mu},delta_{a,pi}) delta_s. The transferable asset is adversarial conditional-moment calibration of inference weights produced by arbitrary learners. Neural networks can provide both nuisance estimates and adversarial test functions, with a constrained weight-editing layer applied after cross-fitting. The most direct experiment is partial-linear estimation with deliberately imbalanced nuisance difficulty, comparing DML against calibrated neural residualization for coefficient bias and confidence-interval coverage.

Ideas from this paper

Mechanism failed 2026

Adversarially calibrated neural residualization

Use neural networks to estimate outcome and treatment nuisances, then edit the resulting debiasing weights so that residualized treatment is conditionally orthogonal to an adversarial class of covariate functions. This should reduce coefficient bias when the two nuisance networks have strongly imbalanced approximation errors, without requiring either network to be correctly specified.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Optimal use of a black-box learner in semiparametric estimation arXiv:2607.21541