ML: Sampling

Machine-learning ideas tagged Sampling in the ML taxonomy of the Math2NN corpus.

✗ Failed on benchmark 2026

Persistent Hamiltonian categorical sampler

Replace independent categorical proposals or reversible Metropolis updates for discrete latent variables with a lifted sampler carrying persistent continuous edge momenta. Neighbor transitions are biased by the momentum and use a symmetric energy factor, so momentum reversal gives the required balance relation for the target Gibbs distribution while ordinary dynamics remain non-reversible. This should reduce random-walk behavior when sampling multimodal categorical latents or token sequences.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Hamiltonian dynamics for sampling on discrete spaces arXiv:2608.17961
✗ Failed on benchmark 2026

Cubic-Rate Third-Order Langevin Optimizer

Replace the usual parameter-plus-momentum Langevin state with a three-level chain consisting of parameters, velocity, and acceleration, while injecting Gaussian noise only into the highest auxiliary state. At a saddle, the escaping direction has a positive rate given by a cubic characteristic equation; use this rate to choose damping or adapt the temperature so that basin escape is accelerated without making the dynamics unstable.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: An Eyring--Kramers Law for the Hypoelliptic Third-Order Langevin Diffusion arXiv:2607.20882
Unverified 2026

Dual-Gibbs Gaussian latent layer

Replace slow primal-coordinate Gibbs sampling of a graph-structured Gaussian latent feature field with Gibbs sampling in the Fourier-dual factor graph. Use the primal convergence formula to determine when dual sampling is worthwhile, and map dual samples back to neural features through the graph incidence operator.

Useful6/10
Difficulty7/10
Novelty7/10
Paper: Accelerated Random-Sweep Gibbs Sampling for Gaussian Graphical Models via Dual Normal Factor Graphs arXiv:2607.28706
Unverified 2026

Windowed Bouncy Particle Weight Sampler

Replace stepwise gradient evaluation in a Bouncy Particle sampler over neural-network parameters with deterministic windows. At the start of each window, compute one gradient and use smoothness to upper-bound the event intensity along the ballistic trajectory; candidate events are generated analytically from the integrated envelope and accepted using a gradient evaluation only at candidate locations. This gives an exact sampler under a certified global smoothness bound and a controllable…

Useful6/10
Difficulty6/10
Novelty7/10
Paper: Windowed thinning and query complexity for the bouncy particle and Zigzag samplers arXiv:2607.28413
✗ Mechanism failed 2026

KL-Budgeted Poisson-Race Sampling

Replace repeated rejection sampling from a neural proposal P with a Poisson race that selects one proposal candidate with exactly the target distribution Q. Candidate i receives a Poisson arrival time A_i and race score A_i divided by Q(X_i)/P(X_i); the smallest score wins. When Q is close to P in KL divergence, the selected index has low expected logarithmic rank, providing an adaptive compute budget instead of a fixed number of candidates.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: A note on shifting distributions via Poisson races arXiv:2608.26996