ML: Sampling

Machine-learning ideas tagged Sampling in the ML taxonomy of the Math2NN corpus.

✗ Mechanism failed 2026

ESS-Controlled Autoregressive CTMC Sampler

Generate discrete configurations globally with an autoregressive model and then refine them using a continuous-time Markov chain of local single-site replacement moves. Use importance weights and the paper's normalized ESS to adapt the CTMC refinement budget and to reject training batches in which the proposal has collapsed onto a few modes.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: FrOGS: Discrete Neural Sampler for Independent Alloy Configurations Across Chemical Conditions arXiv:2609.02948
✗ Failed on benchmark 2026

Persistent Hamiltonian categorical sampler

Replace independent categorical proposals or reversible Metropolis updates for discrete latent variables with a lifted sampler carrying persistent continuous edge momenta. Neighbor transitions are biased by the momentum and use a symmetric energy factor, so momentum reversal gives the required balance relation for the target Gibbs distribution while ordinary dynamics remain non-reversible. This should reduce random-walk behavior when sampling multimodal categorical latents or token sequences.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Hamiltonian dynamics for sampling on discrete spaces arXiv:2608.17961
✗ Failed on benchmark 2026

Cubic-Rate Third-Order Langevin Optimizer

Replace the usual parameter-plus-momentum Langevin state with a three-level chain consisting of parameters, velocity, and acceleration, while injecting Gaussian noise only into the highest auxiliary state. At a saddle, the escaping direction has a positive rate given by a cubic characteristic equation; use this rate to choose damping or adapt the temperature so that basin escape is accelerated without making the dynamics unstable.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: An Eyring--Kramers Law for the Hypoelliptic Third-Order Langevin Diffusion arXiv:2607.20882
△ Mechanism confirmed, baseline not beaten 2026

Coordinate Path-Integral Joint Gibbs Policy

Construct a joint exploratory policy directly from the players' learned q-functions even when their Gibbs conditionals are incompatible. Integrate the players' own-action gradients along a fixed coordinate path to obtain a scalar joint energy, then sample all actions from one tempered Gibbs distribution; this supplies a coherent correlated exploration mechanism rather than independently sampling contradictory policies.

Useful7/10
Difficulty6/10
Novelty8/10
Paper: Continuous-Time Reinforcement Learning for $N$-Player Stochastic Differential Games with Exploratory Policies arXiv:2607.19928
Unverified 2026

Critical-Coupling Noise Controller

Add calibrated multiplicative noise to a binary energy-based model, Hopfield network, or discrete recurrent attractor system so that its effective coupling follows a chosen distance from the collective critical point. Unlike ordinary temperature annealing, the controller distinguishes microscopic channel noise from Gibbs or sampling noise and predicts when ordered attractors should disappear through a measurable susceptibility peak.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Decoherence-controlled collective criticality in a two-dimensional quantum Stag Hunt arXiv:2609.02957
Unverified 2026

Entropy-dissipating Stein-Langevin particle optimizer

Train multiple neural-network parameter particles with a deterministic Stein interaction plus Langevin noise instead of using independent SGD or SGLD chains. The Stein term repels nearby particles while moving the ensemble toward high target probability, and the Langevin term supplies diffusion that improves exploration and prevents particle collapse.

Useful6/10
Difficulty6/10
Novelty5/10
Paper: Quantitative Target Convergence and Uniform-in-Time Propagation of Chaos for Langevin-Regularized SVGD arXiv:2608.28827
Unverified 2026

Isoperimetric Coordinate Hit-and-Run Negatives

Use coordinate hit-and-run rather than isotropic Gaussian random walks to generate latent negatives or augmentation trajectories inside a convex latent domain K. At each step, select one coordinate and resample the entire feasible chord along that coordinate; the paper's l0-isoperimetric theorem predicts that sets of non-negligible mass cannot be separated by severe coordinate-only bottlenecks when K is well-conditioned relative to an unconditional body Q.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Improved $\ell_0$-Isoperimetry for Convex Bodies via Mass Transport arXiv:2608.27854
Unverified 2026

Radial singularity-aware collocation

Use the scaled-boundary radial coordinate to control collocation density near a known point singularity or sharp source located at the scaling center. Instead of sampling \(\rho\) uniformly, choose a transformed or Gauss-Jacobi radial rule whose weights analytically cancel the geometric factor \(\rho^{d-1}\), reducing gradient variance and resolving singular fields with fewer points.

Useful6/10
Difficulty5/10
Novelty8/10
Paper: Scaled boundary cubature scheme in higher dimensions: integration over polytopes and curved regions arXiv:2608.15563
Unverified 2026

Scaled-boundary quadrature loss

Replace random interior collocation points in domain-integrated neural losses with deterministic points generated by scaling oriented boundary patches toward an interior center. The resulting quadrature exactly integrates low-degree polynomial integrands on affine polytopes and gives a mesh-free, geometry-aware loss for PINNs and neural fields.

Useful6/10
Difficulty4/10
Novelty7/10
Paper: Scaled boundary cubature scheme in higher dimensions: integration over polytopes and curved regions arXiv:2608.15563
Unverified 2026

Ball-Coordinate MCMC for Heavy-Tailed Bayesian Networks

Reparameterize all Bayesian neural-network weights by a bounded latent vector in the unit ball and use a simple ball-constrained MCMC kernel instead of unconstrained HMC or random-walk sampling. A radial diffeomorphism expands points near the ball boundary into arbitrarily large weights, preserving heavy-tailed posterior mass while preventing the sampler from numerically wandering through an unbounded parameter space.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Diffeomorphic Markov Chain Monte Carlo: fast mixing for heavy-tailed distributions arXiv:2608.04284
Unverified 2026

Dual-Gibbs Gaussian latent layer

Replace slow primal-coordinate Gibbs sampling of a graph-structured Gaussian latent feature field with Gibbs sampling in the Fourier-dual factor graph. Use the primal convergence formula to determine when dual sampling is worthwhile, and map dual samples back to neural features through the graph incidence operator.

Useful6/10
Difficulty7/10
Novelty7/10
Paper: Accelerated Random-Sweep Gibbs Sampling for Gaussian Graphical Models via Dual Normal Factor Graphs arXiv:2607.28706
Unverified 2026

Windowed Bouncy Particle Weight Sampler

Replace stepwise gradient evaluation in a Bouncy Particle sampler over neural-network parameters with deterministic windows. At the start of each window, compute one gradient and use smoothness to upper-bound the event intensity along the ballistic trajectory; candidate events are generated analytically from the integrated envelope and accepted using a gradient evaluation only at candidate locations. This gives an exact sampler under a certified global smoothness bound and a controllable…

Useful6/10
Difficulty6/10
Novelty7/10
Paper: Windowed thinning and query complexity for the bouncy particle and Zigzag samplers arXiv:2607.28413
Unverified 2026

Accelerated randomized Hamiltonian posterior sampler

Replace Langevin or random-walk sampling for a strongly log-concave neural subproblem with randomized Hamiltonian trajectories. Each iteration draws a fresh Gaussian velocity, integrates position and velocity for a random triangular or exponential duration, and discards the terminal velocity before the next refresh. The target is a regularized posterior over a convex neural-network head, where the paper's accelerated dependence on the strong-convexity parameter is applicable.

Useful6/10
Difficulty5/10
Novelty5/10
Paper: Accelerated Mixing Time of Randomized Hamiltonian Monte Carlo arXiv:2607.12902
✗ Failed on benchmark 2026

Uniformly Mixing Coulomb Particle Bank

Represent a set of neural prototypes, mixture components, or latent particles by N points in R^2, and initialize or refresh them with Langevin dynamics targeting a quadratically confined logarithmic Coulomb gas. The logarithmic repulsion prevents particle collapse, while the paper's N-uniform logarithmic Sobolev inequality predicts that mixing need not degrade as the particle bank grows.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Uniform logarithmic Sobolev inequalities for the 2D Coulomb gas at the diffusive temperature scale arXiv:2608.24863
Unverified 2026

Even-Norm Group Diffusion Augmentation

Replace a fixed discrete augmentation distribution over a finite symmetry group by a continuous-time random walk driven by learnable symmetric Poisson jump rates. Use the resulting transformed-example distribution as a symmetry regularizer, with an even ℓ^{2m} distance to uniformity whose behavior is guaranteed to improve monotonically as the symmetric rates increase for the group families covered by the paper.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Proof of the Lyons--White Conjecture arXiv:2608.27708
Unverified 2026

Convex-mixture graph Langevin optimizer

Put a gradient-Gibbs prior on differences between connected neural parameters rather than on individual parameters, and evolve the parameters with Langevin steps generated from randomly selected strictly convex component energies. The aggregate regularizer may be non-convex, but every sampled component has controlled curvature and outward drift, providing a practical stability mechanism for noisy training.

Useful5/10
Difficulty5/10
Novelty6/10
Paper: Gradient Gibbs measures with non-convex potentials and the universality class of the Gaussian Free Field arXiv:2608.14526
Unverified 2026

Cycle-Basis Flip Sampler for Matching Latents

Replace single-edge or arbitrary alternating-cycle proposals in a neural matching sampler with flips restricted to a precomputed bounded set of alternating cycles induced by a cycle basis of the underlying graph. For clique-decorated graphs whose underlying graph has all vertex degrees of the same parity, the paper guarantees that these bounded-length flips connect every perfect matching, preventing disconnected proposal components even when decorations are large. A neural energy or policy…

Useful5/10
Difficulty5/10
Novelty8/10
Paper: Flip dynamics on perfect matchings beyond bipartite and planar graphs arXiv:2607.16101
Unverified 2026

Certified partition-function reranking

Replace MAP scoring of discrete latent configurations by comparison of the total energy-model mass assigned to each candidate class. Estimate each class partition function with annealed importance sampling driven by identical random seeds, then return a prediction only when a paired bootstrap confidence interval certifies that its log-partition score exceeds every competitor.

Useful5/10
Difficulty6/10
Novelty6/10
Paper: Certified decoding of quantum LDPC codes arXiv:2608.25545
Unverified 2026

Conservative amortized collision layer

Add a learned stochastic pair-interaction layer to a particle graph neural network, with a conditional normalizing flow generating the post-interaction relative state. Parameterize the update in center-of-mass and invariant relative coordinates so every sampled interaction preserves pair momentum and kinetic energy exactly. The flow learns the transition law directly from observed scattering or trajectory data, replacing repeated numerical collision solves or unconstrained message-passing…

Useful5/10
Difficulty6/10
Novelty6/10
Paper: A particle method for the Boltzmann equation via amortized sampling from Green's function of the lifted linear operator arXiv:2608.22880