Sharp Metric $X_p$ Inequalities via Martingales

arXiv:2608.29367 2026 Regularization 1 ideas extracted · analyzed Sep 1, 2026

What the math gives to ML

The paper proves a sharp higher-order inequality on the Hamming cube: the average L^p magnitude of a conditional projection onto a random k-coordinate subset is controlled by coordinate-wise discrete derivatives and the global centered L^p norm, with the sharp factor p/log p. This suggests a robustness regularizer for neural networks whose inputs contain binary nuisance or augmentation variables, suppressing predictable responses to randomly revealed nuisance coordinates while explicitly controlling coordinate sensitivity. The random-reveal martingale construction gives an efficient unbiased estimator based on random permutations and partial masking rather than enumerating all subsets. The most direct test is on nuisance-invariance benchmarks, measuring robustness at matched clean accuracy and training cost.

Ideas from this paper

Unverified 2026

Sharp random-reveal nuisance regularizer

Represent binary nuisance variables or augmentation bits as coordinates of a Hamming cube and penalize the model response that remains predictable from a random k-coordinate subset. Use the theorem's derivative-plus-global-norm certificate as the regularizer, retaining its p/log p dependence instead of using an arbitrary masking penalty. Random coordinate permutations provide a cheap stochastic approximation to the subset average.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Sharp Metric $X_p$ Inequalities via Martingales arXiv:2608.29367