Volume and Projection Inequalities I: Zonoids and Courtade's Conjecture
arXiv:2608.12681
2026
Regularization
1 ideas extracted · analyzed Sep 1, 2026
What the math gives to ML
The paper develops a determinant-based volume polynomial for zonotopes, where each coefficient measures the geometric diversity of a subset of generating vectors. Its central structural result identifies log-submodularity with the Rayleigh inequality for this multiaffine polynomial, with guarantees in low degree or codegree and counterexamples in higher dimensions. This machinery can be transferred into neural networks as a diversity regularizer for attention heads, MoE experts, or embedding prototypes whose directions should span complementary subspaces. Because the paper exhibits failures in dimensions at least four, an implementation should optimize the volume objective directly and measure Rayleigh defects empirically rather than assume universal submodularity.
Ideas from this paper
Unverified
2026
Represent a collection of neural directions as generators of a zonotope and reward the volume spanned by their subsets. The objective favors complementary, non-collapsed vectors rather than merely pairwise-separated vectors, making it suitable for attention heads, MoE expert signatures, or embedding prototypes. Use normalized generators and positive gates so the regularizer cannot be increased trivially by scaling.
Useful6/10
Difficulty5/10
Novelty7/10