Central limit theorem for Wasserstein projection - the case of convex order

arXiv:2608.29565 2026 Regularization 1 ideas extracted · analyzed Sep 1, 2026

What the math gives to ML

The paper provides a constructive statistical geometry for projecting a distribution onto the cone of measures below a reference distribution in convex order, using an optimal-transport cost. The transferable asset is that convex order simultaneously controls expectations of every convex test function, so one projection can replace manually chosen variance, tail, and risk penalties. A practical neural-network use is a differentiable distributional-output layer that projects student predictions onto the convex-order cone of teacher predictions or calibrated target distributions. This is most plausible for distributional regression and uncertainty-aware distillation, where controlling spread without selecting many separate convex penalties may improve calibration and robustness.

Ideas from this paper

Unverified 2026

Convex-Order Distributional Distillation

Represent each neural prediction as a finite probability distribution and project it, under an optimal-transport cost, onto the set of distributions dominated by a teacher or target distribution in convex order. This enforces a global spread and risk relationship across all convex observables rather than adding separate variance, tail, and calibration penalties. Use a periodically refreshed projection during training and test whether it improves uncertainty calibration and robustness at equal…

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Central limit theorem for Wasserstein projection - the case of convex order arXiv:2608.29565