Better Privacy Guarantees for Larger Groups

arXiv:2607.14406 2026 Training 1 ideas extracted · analyzed Aug 30, 2026

What the math gives to ML

The paper establishes an optimal inverse-square law for count-dependent zero-concentrated differential privacy: if a group of size n must retain fixed relative error, its privacy budget can scale as v(n)=Theta_r(n^{-2}), and no mechanism can asymptotically improve this rate. The transferable asset is a principled way to make Gaussian release noise proportional to group size rather than constant, preserving relative utility while making privacy loss decrease quadratically for large groups. This can be tested in private federated aggregation or private MoE routing statistics, although the exact theorem relies on a shifted-log Gaussian construction whose full formula is not present in the extracted text.

Ideas from this paper

Unverified 2026

Inverse-square count-aware Gaussian release

Replace the constant-noise release used for private group aggregates with noise whose standard deviation grows linearly with the group count. The resulting relative error remains approximately constant, while the zCDP privacy loss decreases as the inverse square of group size; this is especially relevant to federated gradient aggregation or private expert-load statistics.

Useful5/10
Difficulty5/10
Novelty6/10
Paper: Better Privacy Guarantees for Larger Groups arXiv:2607.14406