Macroscopic Feynman Cycles and Poisson--Kingman Universality in Bose Condensation
arXiv:2607.04264
2026
Regularization
1 ideas extracted · analyzed Aug 29, 2026
What the math gives to ML
The paper provides a constructive family of conditioned completely random measures whose ranked atom masses are Poisson–Dirichlet only in the constant-profile case, while a visible low-energy spectrum changes the mass profile and therefore the partition law. This is transferable as a principled heavy-tailed capacity prior for sparse mixture-of-experts routing: instead of forcing equal expert loads or using an unstructured Dirichlet target, route toward a sampled Poisson–Kingman allocation with controllable numbers of large and small experts. The nonconstant profile offers a knob for preventing both expert collapse and artificial uniformity, while conditioning on total mass directly matches the fixed token-budget constraint. The initial implementation should use the sampled partition only as a detached load-balancing target, making the method easy to compare against Switch-style auxiliary losses.
Ideas from this paper
Unverified
2026
Replace the usual uniform expert-load target in sparse MoE training with a random, heavy-tailed capacity allocation generated by a conditioned Poisson point process. The constant profile reproduces a Poisson–Dirichlet-like allocation, while a profile such as \(\phi_\gamma(x)=1+e^{-\beta\gamma x}\) deliberately changes the frequency of large versus small expert allocations.
Useful5/10
Difficulty5/10
Novelty7/10