Ideal Bose-Einstein condensation in the canonical ensemble: exact asymptotic estimates from large deviations
arXiv:2608.24625
2026
Regularization
1 ideas extracted · analyzed Sep 1, 2026
What the math gives to ML
The paper provides a constructive large-deviations description of Bose-Einstein condensation in the canonical ensemble: a fixed total mass is distributed among modes, and above a critical density the excess mass concentrates into one ground-state mode while the remaining modes remain at a saturated normal density. The transferable mechanism is a sharp competition between an entropic distributed phase and a condensed phase, with a computable threshold and finite-size fluctuation law. A direct neural analogue is expert routing or memory allocation, where token assignments are constrained by a fixed batch and a controllable Gibbs energy; the BEC asymptotics predict when routing remains distributed and when one expert absorbs excess load. This yields a measurable phase diagram and a principled regularizer or capacity schedule rather than an ad hoc anti-collapse penalty.
Ideas from this paper
Unverified
2026
Model the integer token loads of a mixture-of-experts layer as a canonical occupancy system with a fixed total number of tokens. A distributed routing phase persists while the normalized load is below a critical value; beyond that point, the excess load is either allowed to condense into a designated overflow expert or penalized if expert collapse is undesirable. The key benefit is an explicit transition criterion and finite-batch fluctuation diagnostic for routing collapse.
Useful6/10
Difficulty5/10
Novelty7/10