Convex Order Comparisons for Sub-Gamma Random Variables

arXiv:2609.02398 2026 Regularization 1 ideas extracted · analyzed Sep 3, 2026

What the math gives to ML

The paper develops sharp convex-order majorants for centered random variables whose moment generating functions satisfy finite-range Bernstein/sub-Gamma bounds. Its transferable asset is not Laplace noise itself, which is standard, but a principled calibration constant that guarantees every convex test loss under an admissible perturbation is bounded by the corresponding loss under a scaled Laplace perturbation; the extremal law is an asymmetric two-point distribution. A practical neural-network use is certified scalar perturbation regularization: estimate local sub-Gamma parameters of activations, gradients, or logit noise, compute the sharp majorant scale numerically from the convex-order condition, and train with the resulting scaled Laplace perturbation as a distributionally robust surrogate.

Ideas from this paper

Unverified 2026

Sharp Sub-Gamma Laplace Regularization

Replace ad hoc Gaussian or Laplace noise injection with a Laplace majorant calibrated to the observed finite-range sub-Gamma parameters of a neural perturbation. For convex perturbation losses, the calibration guarantees that the expected loss under the scaled Laplace noise upper-bounds the expected loss under every centered random perturbation satisfying the same Bernstein-type MGF constraint.

Useful5/10
Difficulty6/10
Novelty6/10
Paper: Convex Order Comparisons for Sub-Gamma Random Variables arXiv:2609.02398