Gaussian Minkowski Concavity Regularizer
Implementation & benchmark of arXiv:2608.05390 — The Brunn--Minkowski inequality for the Gaussian measure
Source paper: The Brunn--Minkowski inequality for the Gaussian measure arXiv:2608.05390 ⓘ · analyzed Aug 31, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Represent each class or concept by a convex latent body containing the origin, and penalize violations of the paper's sharp Gaussian Brunn–Minkowski inequality when two bodies are interpolated by Minkowski addition. This regularizes latent supports toward geometries whose Gaussian probability mass remains predictable under interpolation, potentially improving interpolation robustness and out-of-distribution behavior.
Formulas
Mathematical statement
For the standard Gaussian measure \(\gamma_n\) on \(\mathbb{R}^n\), and convex bodies \(K,L\subset\mathbb{R}^n\) containing the origin, the paper proves that \(\gamma_n(\lambda K+(1-\lambda)L)^{\alpha_\gamma(n)}\geq \lambda\gamma_n(K)^{\alpha_\gamma(n)}+(1-\lambda)\gamma_n(L)^{\alpha_\gamma(n)}\) for every \(\lambda\in[0,1]\). Here \(\lambda K+(1-\lambda)L=\{\lambda x+(1-\lambda)y:x\in K,y\in L\}\), \(\gamma_n(A)=\Pr_{z\sim\mathcal{N}(0,I_n)}[z\in A]\), and \(\alpha_\gamma(n)=1-\frac{2}{n-1}\frac{\Gamma(n/2)^2}{\Gamma((n-1)/2)^2}\). The exponent is sharp: no larger exponent works for all such \(K,L\). Use the violation of this inequality as a loss. Since exact convex-body Gaussian volumes are unavailable for neural representations, approximate each body by the convex hull of normalized latent codes and estimate its Gaussian mass using reparameterized soft membership or Monte Carlo membership tests.
Implementation notes
Integrate the regularizer after an encoder, before the classifier or decoder. For every minibatch, select two examples or two class-specific latent supports, producing latent point sets \(Z_K=\{z_i^K\}\) and \(Z_L=\{z_i^L\}\) in dimension \(d\). Force the support to contain the origin by using \(K=\operatorname{conv}(\{0\}\cup Z_K)\) and \(L=\operatorname{conv}(\{0\}\cup Z_L)\); in an MVP, avoid a full differentiable convex-hull implementation and use a fixed-size set of barycentric combinations of support points. Draw \(M\) Gaussian probes \(\epsilon_j\sim\mathcal N(0,I_d)\). Define a soft membership score \(s_K(\epsilon)=\exp[-\tau\,\operatorname{dist}(\epsilon,K)^2]\), where distance is computed by differentiable quadratic-program projection onto the convex hull; use the analogous scores for \(L\) and the interpolated set. Estimate masses with \(\widehat p_K=M^{-1}\sum_j s_K(\epsilon_j)\), then compute \(\mathcal L_{\mathrm{GMB}}\) from the displayed formula and add \(\beta\mathcal L_{\mathrm{GMB}}\) to cross-entropy or VAE reconstruction/KL loss. Pseudocode: encode -> choose \(K,L\) -> sample probes -> project probes to each hull -> estimate three masses -> hinge-square inequality violation -> backpropagate. The paper supplies the exponent and inequality; projection, soft membership temperature \(\tau\), probe count \(M\), and \(\beta\) are empirical design choices. Start with a 2D or 8D MLP on two-moons, CIFAR-10 embeddings, or MNIST, comparing ordinary cross-entropy against cross-entropy plus this loss. Measure interpolation accuracy between class-support mixtures, test accuracy under Gaussian latent perturbations, OOD confidence, and the fraction of minibatches violating the inequality. A successful result is lower violation rate and better midpoint/interpolation accuracy without degrading standard accuracy; also report sensitivity to \(M\), \(\tau\), and support size.
Verification
This idea has not been verified yet.
Verification happens in two stages: Stage 1 — a mechanism check on a toy system confirms the claimed mathematical phenomenon reproduces; Stage 2 — a benchmark implements the idea on a real (small) neural network task and compares it against a tuned baseline over 8 paired seeds with a permutation test.
Artifacts
Artifacts unavailable.