ML: Sampling

Machine-learning ideas tagged Sampling in the ML taxonomy of the Math2NN corpus.

Unverified 2026

Critical-Coupling Noise Controller

Add calibrated multiplicative noise to a binary energy-based model, Hopfield network, or discrete recurrent attractor system so that its effective coupling follows a chosen distance from the collective critical point. Unlike ordinary temperature annealing, the controller distinguishes microscopic channel noise from Gibbs or sampling noise and predicts when ordered attractors should disappear through a measurable susceptibility peak.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Decoherence-controlled collective criticality in a two-dimensional quantum Stag Hunt arXiv:2609.02957
Unverified 2026

Resolution-Invariant Hilbert-Space CNF Prior

Replace a finite-dimensional latent prior for fields or trajectories with a continuous flow acting on function coefficients in a separable Hilbert space. A Gaussian reference with an explicit covariance spectrum is transformed by a learned vector field, so the model can represent smooth, non-isotropic function distributions while sharing parameters across discretization resolutions.

Useful6/10
Difficulty6/10
Novelty6/10
Paper: Learning Informative Prior with Infinite-Dimensional Continuous Normalizing Flow for Bayesian Inverse Problem arXiv:2609.03343
Unverified 2026

Entropy-dissipating Stein-Langevin particle optimizer

Train multiple neural-network parameter particles with a deterministic Stein interaction plus Langevin noise instead of using independent SGD or SGLD chains. The Stein term repels nearby particles while moving the ensemble toward high target probability, and the Langevin term supplies diffusion that improves exploration and prevents particle collapse.

Useful6/10
Difficulty6/10
Novelty5/10
Paper: Quantitative Target Convergence and Uniform-in-Time Propagation of Chaos for Langevin-Regularized SVGD arXiv:2608.28827
Unverified 2026

Isoperimetric Coordinate Hit-and-Run Negatives

Use coordinate hit-and-run rather than isotropic Gaussian random walks to generate latent negatives or augmentation trajectories inside a convex latent domain K. At each step, select one coordinate and resample the entire feasible chord along that coordinate; the paper's l0-isoperimetric theorem predicts that sets of non-negligible mass cannot be separated by severe coordinate-only bottlenecks when K is well-conditioned relative to an unconditional body Q.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Improved $\ell_0$-Isoperimetry for Convex Bodies via Mass Transport arXiv:2608.27854
Unverified 2026

Best-of-N Certification Width

Attach an exact structural uncertainty report to any best-of-N evaluation: after measuring reliability only for budgets n = 1,...,m, report that deployment reliability at budget N is unresolved by at least B_{m,N}. Use this width to select the smallest audit budget that makes a claimed reliability gap meaningful, or reject model comparisons whose validation budget lies below the square-root-of-N threshold.

Useful6/10
Difficulty3/10
Novelty8/10
Paper: The geometry of AI validation: Exact certification limits for iid best-of-N search arXiv:2608.21496
Unverified 2026

Radial singularity-aware collocation

Use the scaled-boundary radial coordinate to control collocation density near a known point singularity or sharp source located at the scaling center. Instead of sampling \(\rho\) uniformly, choose a transformed or Gauss-Jacobi radial rule whose weights analytically cancel the geometric factor \(\rho^{d-1}\), reducing gradient variance and resolving singular fields with fewer points.

Useful6/10
Difficulty5/10
Novelty8/10
Paper: Scaled boundary cubature scheme in higher dimensions: integration over polytopes and curved regions arXiv:2608.15563
Unverified 2026

Scaled-boundary quadrature loss

Replace random interior collocation points in domain-integrated neural losses with deterministic points generated by scaling oriented boundary patches toward an interior center. The resulting quadrature exactly integrates low-degree polynomial integrands on affine polytopes and gives a mesh-free, geometry-aware loss for PINNs and neural fields.

Useful6/10
Difficulty4/10
Novelty7/10
Paper: Scaled boundary cubature scheme in higher dimensions: integration over polytopes and curved regions arXiv:2608.15563
Unverified 2026

Automorphism-corrected architecture MCMC

Run Metropolis-Hastings directly on neural architectures modulo permutations of structurally exchangeable hidden units, channels, or experts rather than treating every labelled representation as a distinct architecture. Correct the proposal ratio using representation-orbit sizes, so architectures with many internal symmetries receive the intended posterior mass.

Useful6/10
Difficulty6/10
Novelty5/10
Paper: Metropolis-Hastings Sampling of Phylogenetic Networks: Correcting for Symmetries arXiv:2608.12430
Unverified 2026

Ball-Coordinate MCMC for Heavy-Tailed Bayesian Networks

Reparameterize all Bayesian neural-network weights by a bounded latent vector in the unit ball and use a simple ball-constrained MCMC kernel instead of unconstrained HMC or random-walk sampling. A radial diffeomorphism expands points near the ball boundary into arbitrarily large weights, preserving heavy-tailed posterior mass while preventing the sampler from numerically wandering through an unbounded parameter space.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Diffeomorphic Markov Chain Monte Carlo: fast mixing for heavy-tailed distributions arXiv:2608.04284
Unverified 2026

Algebraically Scrambled Augmentation Batches

Generate augmentation parameters from a binary digital net with matrix or linear scrambling instead of independently sampled uniforms or fully Owen-scrambled points. The construction should cover the augmentation hypercube while avoiding the severe local clustering predicted for random and locally independent scrambling, giving each training window a more uniform set of transformation strengths.

Useful6/10
Difficulty4/10
Novelty7/10
Paper: Separation properties of scrambled digital nets and related random point sets arXiv:2607.29063
Unverified 2026

Dual-Gibbs Gaussian latent layer

Replace slow primal-coordinate Gibbs sampling of a graph-structured Gaussian latent feature field with Gibbs sampling in the Fourier-dual factor graph. Use the primal convergence formula to determine when dual sampling is worthwhile, and map dual samples back to neural features through the graph incidence operator.

Useful6/10
Difficulty7/10
Novelty7/10
Paper: Accelerated Random-Sweep Gibbs Sampling for Gaussian Graphical Models via Dual Normal Factor Graphs arXiv:2607.28706
Unverified 2026

Windowed Bouncy Particle Weight Sampler

Replace stepwise gradient evaluation in a Bouncy Particle sampler over neural-network parameters with deterministic windows. At the start of each window, compute one gradient and use smoothness to upper-bound the event intensity along the ballistic trajectory; candidate events are generated analytically from the integrated envelope and accepted using a gradient evaluation only at candidate locations. This gives an exact sampler under a certified global smoothness bound and a controllable…

Useful6/10
Difficulty6/10
Novelty7/10
Paper: Windowed thinning and query complexity for the bouncy particle and Zigzag samplers arXiv:2607.28413
Unverified 2026

Exact nondecreasing-subsequence constrained decoder

Equip an autoregressive model with a hard constraint that generated token ranks cannot contain a nondecreasing subsequence of length k. Maintain a patience-sorting-style state representing the smallest ending token rank achievable by subsequences of lengths 1 through k-1, mask tokens that would create a length-k subsequence, and optionally sample uniformly among valid continuations using exact suffix counts. This provides a mathematically controlled data-augmentation or decoding regime for…

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Counting words without non-decreasing subwords of fixed length arXiv:2607.19410
Unverified 2026

Accelerated randomized Hamiltonian posterior sampler

Replace Langevin or random-walk sampling for a strongly log-concave neural subproblem with randomized Hamiltonian trajectories. Each iteration draws a fresh Gaussian velocity, integrates position and velocity for a random triangular or exponential duration, and discards the terminal velocity before the next refresh. The target is a regularized posterior over a convex neural-network head, where the paper's accelerated dependence on the strong-convexity parameter is applicable.

Useful6/10
Difficulty5/10
Novelty5/10
Paper: Accelerated Mixing Time of Randomized Hamiltonian Monte Carlo arXiv:2607.12902
Unverified 2026

Even-Norm Group Diffusion Augmentation

Replace a fixed discrete augmentation distribution over a finite symmetry group by a continuous-time random walk driven by learnable symmetric Poisson jump rates. Use the resulting transformed-example distribution as a symmetry regularizer, with an even ℓ^{2m} distance to uniformity whose behavior is guaranteed to improve monotonically as the symmetric rates increase for the group families covered by the paper.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Proof of the Lyons--White Conjecture arXiv:2608.27708
Unverified 2026

Convex-mixture graph Langevin optimizer

Put a gradient-Gibbs prior on differences between connected neural parameters rather than on individual parameters, and evolve the parameters with Langevin steps generated from randomly selected strictly convex component energies. The aggregate regularizer may be non-convex, but every sampled component has controlled curvature and outward drift, providing a practical stability mechanism for noisy training.

Useful5/10
Difficulty5/10
Novelty6/10
Paper: Gradient Gibbs measures with non-convex potentials and the universality class of the Gaussian Free Field arXiv:2608.14526
Unverified 2026

Warm-start hit-and-run augmentation

Replace rejection sampling or short biased random walks inside a convex latent constraint set with hit-and-run. At each step, choose a uniformly random direction and sample uniformly along the entire chord through the current point; the paper's mixing result predicts that a chain initialized by a crude approximate sampler becomes close to uniform with only logarithmic dependence on initialization bias and target error.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Hit-and-Run Mixes as Fast as the Ball Walk arXiv:2608.13487
Unverified 2026

Cycle-Basis Flip Sampler for Matching Latents

Replace single-edge or arbitrary alternating-cycle proposals in a neural matching sampler with flips restricted to a precomputed bounded set of alternating cycles induced by a cycle basis of the underlying graph. For clique-decorated graphs whose underlying graph has all vertex degrees of the same parity, the paper guarantees that these bounded-length flips connect every perfect matching, preventing disconnected proposal components even when decorations are large. A neural energy or policy…

Useful5/10
Difficulty5/10
Novelty8/10
Paper: Flip dynamics on perfect matchings beyond bipartite and planar graphs arXiv:2607.16101
Unverified 2026

Certified partition-function reranking

Replace MAP scoring of discrete latent configurations by comparison of the total energy-model mass assigned to each candidate class. Estimate each class partition function with annealed importance sampling driven by identical random seeds, then return a prediction only when a paired bootstrap confidence interval certifies that its log-partition score exceeds every competitor.

Useful5/10
Difficulty6/10
Novelty6/10
Paper: Certified decoding of quantum LDPC codes arXiv:2608.25545
Unverified 2026

Conservative amortized collision layer

Add a learned stochastic pair-interaction layer to a particle graph neural network, with a conditional normalizing flow generating the post-interaction relative state. Parameterize the update in center-of-mass and invariant relative coordinates so every sampled interaction preserves pair momentum and kinetic energy exactly. The flow learns the transition law directly from observed scattering or trajectory data, replacing repeated numerical collision solves or unconstrained message-passing…

Useful5/10
Difficulty6/10
Novelty6/10
Paper: A particle method for the Boltzmann equation via amortized sampling from Green's function of the lifted linear operator arXiv:2608.22880