Volume and Projection Inequalities I: Zonoids and Courtade's Conjecture

arXiv:2608.12681 2026 Regularization 1 ideas extracted · analyzed Sep 1, 2026

What the math gives to ML

The paper develops a determinant-based volume polynomial for zonotopes, where each coefficient measures the geometric diversity of a subset of generating vectors. Its central structural result identifies log-submodularity with the Rayleigh inequality for this multiaffine polynomial, with guarantees in low degree or codegree and counterexamples in higher dimensions. This machinery can be transferred into neural networks as a diversity regularizer for attention heads, MoE experts, or embedding prototypes whose directions should span complementary subspaces. Because the paper exhibits failures in dimensions at least four, an implementation should optimize the volume objective directly and measure Rayleigh defects empirically rather than assume universal submodularity.

Ideas from this paper

Unverified 2026

Zonotope Volume Diversity Regularizer

Represent a collection of neural directions as generators of a zonotope and reward the volume spanned by their subsets. The objective favors complementary, non-collapsed vectors rather than merely pairwise-separated vectors, making it suitable for attention heads, MoE expert signatures, or embedding prototypes. Use normalized generators and positive gates so the regularizer cannot be increased trivially by scaling.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Volume and Projection Inequalities I: Zonoids and Courtade's Conjecture arXiv:2608.12681