Quantitative mean-field limits for repulsive Coulomb flows at bounded density and Riesz weak--strong stability
arXiv:2608.16655
2026
Regularization
1 ideas extracted · analyzed Sep 1, 2026
What the math gives to ML
The paper develops a quantitatively controlled repulsive particle flow whose useful transferable ingredients are singular repulsion, a density-dependent interaction scale, and an explicit decay envelope for effective density. These ingredients can be transplanted into neural prototype or embedding training to prevent collapse without keeping repulsion unnecessarily strong late in optimization. The practical adaptation is to add a mollified Coulomb force to embedding updates, decay its coefficient according to the paper's envelope, and enlarge the mollification radius as the estimated density falls. This provides a falsifiable alternative to fixed-distance repulsion for metric learning, prototype learning, vector quantization, and mixture-of-experts router embeddings.
Ideas from this paper
Unverified
2026
Treat trainable prototypes, class centers, codebook entries, or router expert embeddings as interacting particles and add a mollified repulsive Coulomb force to their task-gradient update. Unlike a fixed repulsion coefficient, use the paper's explicit density envelope to reduce repulsion over training and use the associated density-dependent mollification radius, so early training prevents collapse while late training permits precise cluster formation.
Useful6/10
Difficulty4/10
Novelty5/10