Scale Analysis and Shape Selection for the Generalized Gaussian Mechanism under Approximate Differential Privacy

arXiv:2608.31138 2026 Training 1 ideas extracted · analyzed Sep 2, 2026

What the math gives to ML

The paper provides a constructive way to choose the shape of additive generalized-Gaussian noise rather than treating Laplace and Gaussian noise as the only useful options. Its transferable asset is the combination of privacy calibration through the hockey-stick divergence with a scale-homogeneous utility objective, which makes shape comparison invariant to the absolute sensitivity scale. A direct neural-network application is private gradient or update perturbation: for a fixed privacy budget, numerically calibrate the smallest noise scale for each shape p and select the shape minimizing a gradient-relevant moment. The strongest initial test is one-step or few-step private optimization with exact scalar accounting, followed by a conservative coordinate-wise extension to clipped gradients.

Ideas from this paper

Mechanism failed 2026

Shape-Optimized Private Gradient Noise

Replace fixed Gaussian noise in a private optimizer with generalized-Gaussian noise whose shape p is selected for the actual clipped-gradient sensitivity and privacy budget. For every candidate p, numerically find the minimum scale b satisfying the hockey-stick privacy constraint, then choose the p minimizing a gradient-update utility moment such as variance or expected absolute magnitude.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Scale Analysis and Shape Selection for the Generalized Gaussian Mechanism under Approximate Differential Privacy arXiv:2608.31138