Wasserstein gradient flows of Maximum Mean Discrepancy with energy kernels
arXiv:2608.01182
2026
Optimization
1 ideas extracted · analyzed Aug 31, 2026
What the math gives to ML
The paper gives a concrete particle gradient flow for the nonsmooth negative-distance kernel K(z)=-|z|^q, together with the essential prescription of removing self-interactions. Its transferable asset is a repulsive-attractive dynamics: particles are attracted toward a target distribution while pairwise interactions spread them apart and can prevent prototype collapse. A practical neural-network use is to maintain trainable latent prototypes or synthetic embeddings and update them with this flow against minibatch feature distributions. The theory supports testing collision avoidance and coverage, but it also warns that global convergence rates and Polyak–Łojasiewicz guarantees should not be assumed.
Ideas from this paper
Unverified
2026
Replace ordinary codebook or prototype updates with the paper's diagonal-free particle dynamics in feature space. Each prototype is attracted toward the current minibatch feature distribution, while pairwise negative-distance interactions spread prototypes apart and suppress codebook collapse. The exponent q in (0,2) controls the interaction profile, with q less than 1 producing a stronger near-collision force but requiring numerical regularization.
Useful6/10
Difficulty4/10
Novelty6/10