Hypocoercivity of Tempered Bouncy Particle Samplers for Heavy-Tailed Targets

arXiv:2608.29657 2026 Sampling 1 ideas extracted · analyzed Sep 1, 2026

What the math gives to ML

The paper's transferable asset is a state-dependent kinetic temperature that leaves a prescribed heavy-tailed position law invariant, rather than merely tuning a global sampler temperature. The joint law uses velocities with covariance \(\sigma^2(x)I\), allowing exploration to accelerate in remote or low-density regions while retaining the target \(\mu(x)\propto e^{-U(x)}\). For neural energy models, latent-variable models, or posterior sampling, this can be converted into an exactly invariant state-dependent Langevin sampler with the required divergence correction. The hypocoercive viewpoint also suggests testing mixing on heavy-tailed targets through weighted-Poincare or effective-sample-size measurements rather than only short-run loss curves.

Ideas from this paper

Mechanism confirmed, baseline not beaten 2026

State-Dependent Temperature Langevin

Replace isotropic Langevin noise in latent or energy-based neural sampling with a smooth position-dependent temperature \(\sigma(x)\geq 1\). Use the divergence correction associated with the diffusion matrix so that increasing exploration in the tails does not change the desired target distribution. This should reduce metastability and improve effective samples per gradient evaluation on heavy-tailed latent posteriors.

Useful7/10
Difficulty4/10
Novelty6/10
Paper: Hypocoercivity of Tempered Bouncy Particle Samplers for Heavy-Tailed Targets arXiv:2608.29657