The Limits of Experimental Design: Covariate Balance Beyond Low Dimension
arXiv:2608.18057
2026
Training
1 ideas extracted · analyzed Sep 1, 2026
What the math gives to ML
The paper gives a direct identity linking estimator variance to the squared imbalance of a covariate-dependent outcome function under signed assignments. Its transferable asset is discrepancy minimization as a principled way to construct low-variance finite-sample averages over a restricted function class, together with an explicit warning that unrestricted high-dimensional balance is impossible. A practical neural-network adaptation is to select minibatches whose learned feature statistics have low discrepancy from the candidate-pool statistics, reducing stochastic gradient noise without requiring a larger batch.
Ideas from this paper
Unverified
2026
Replace uniformly sampled minibatches with batches selected from a small IID candidate pool to match the pool's statistics in a restricted learned feature space. The selection objective is the neural-training analogue of minimizing treatment-assignment imbalance, so the batch should produce a lower-variance estimate of the population gradient for functions represented by those features.
Useful5/10
Difficulty4/10
Novelty5/10