Value distributions for read-once polynomials on finite fields
arXiv:2608.00081
2026
Regularization
1 ideas extracted · analyzed Aug 31, 2026
What the math gives to ML
The paper identifies a nonstandard feasible body for categorical distributions that is preserved when independent random variables are combined by group or quasigroup convolution. The transferable asset is a compositional guarantee: distributions satisfying a lower-tail constraint remain non-collapsed after repeated algebraic composition. This suggests a regularizer for categorical latent variables or MoE routing distributions, especially when several independently predicted categorical states are combined through a finite-group operation. The strongest first test is a differentiable barrier on categorical probabilities, followed by repeated group-convolution composition and measurement of collapse, calibration, and task accuracy.
Ideas from this paper
Unverified
2026
Constrain categorical distributions used by a neural module to lie in the paper's body \(\mathcal{B}_k\), which imposes a lower bound on the smallest probability based on the second-largest probability. Apply the constraint to finite-group-valued latent variables or MoE routing distributions, particularly when independently predicted categorical states are combined by group addition.
Useful5/10
Difficulty4/10
Novelty7/10