ML: Diffusion sampling

Machine-learning ideas tagged Diffusion sampling in the ML taxonomy of the Math2NN corpus.

Unverified 2026

Spectral-Gap Convex Perturbation Sampler

Replace rejection sampling or coordinate random walks for adversarial and augmentation perturbations in a convex feasible set with Hit-and-Run: choose a random direction through the current perturbation, compute the exact feasible chord, and sample uniformly on that chord. The paper's spectral-gap result predicts faster global exploration when the perturbation polytope is rounded or whitened, while preserving feasibility at every step.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Spectral Gaps of Hit-and-Run and Coordinate Hit-and-Run arXiv:2608.16878
Unverified 2026

Resolvent response basis for conditioned modules

Compress a module whose output changes with a scalar condition such as diffusion time, temperature, or compute budget by representing its response in a low-rank basis generated by resolvent-like functions. Distinct spectral modes produce rational factors \((1-\tau\lambda_k)^{-1}\), allowing a small number of learned components to approximate a large hypernetwork or condition-dependent parameter table.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Spectral duality structures and the Fisher--Rao geometry of reset distributions arXiv:2608.15805
Unverified 2026

Warm-start hit-and-run augmentation

Replace rejection sampling or short biased random walks inside a convex latent constraint set with hit-and-run. At each step, choose a uniformly random direction and sample uniformly along the entire chord through the current point; the paper's mixing result predicts that a chain initialized by a crude approximate sampler becomes close to uniform with only logarithmic dependence on initialization bias and target error.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Hit-and-Run Mixes as Fast as the Ball Walk arXiv:2608.13487
Unverified 2026

Fluctuation-Floor Regularizer for Learned Samplers

Add a trajectory-level consistency constraint to a diffusion or Markov generative model by comparing the likelihood of each sampled path with the likelihood of its reversed path. The constraint uses the paper's sharp fluctuation floor to detect when a model produces too many strongly backward-looking trajectories or hides directional mismatch in a small number of extreme events. This is a regularizer and diagnostic for learned stochastic dynamics, not a replacement for the generative likelihood…

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Bounds for Apparent Second-Law Violations in Quantum Trajectories arXiv:2608.10118
Unverified 2026

Spectral-Gap Count Augmentation

Replace independent perturbations of a bag-of-events or histogram input by a Markov augmentation that resamples overlapping-window count vectors according to a stationary conditional kernel. The augmentation preserves realistic correlations induced by a learned reversible transition matrix and has a measurable mixing-rate guarantee, preventing an arbitrary augmentation chain from producing highly correlated or unstable samples.

Useful5/10
Difficulty7/10
Novelty8/10
Paper: Conditionally Resampled Sliding-Window Count Kernels: Spectral-Gap Bounds and Poincaré Inequalities arXiv:2608.08678
Unverified 2026

Mobility-matched entropy sampler

Build a neural sampler whose deterministic probability-flow dynamics implement the nonlinear Fokker–Planck equation rather than the usual linear Langevin flow. For a selected monotone diffusion law \(P\), use the associated entropy derivative \(\phi'(r)=P'(r)/r\) to define the chemical potential and train a neural velocity field to approximate its descent direction.

Useful5/10
Difficulty6/10
Novelty6/10
Paper: Nonlinear Diffusion Equations: Full characterization of Entropies arXiv:2608.07129
Unverified 2026

Noise-aware randomized Milstein sampler

Replace an Euler-Maruyama reverse-diffusion sampler with a scalar or coordinatewise randomized Milstein step that uses an autodifferentiated score or drift derivative and explicitly tolerates noisy coefficient and Brownian evaluations. Use the paper's additive error law to stop refining the time grid when discretization error falls below the neural-oracle noise floor.

Useful5/10
Difficulty5/10
Novelty6/10
Paper: Error of randomized Milstein scheme for scalar SDEs with noisy information about coefficients and Wiener process arXiv:2607.29578
Unverified 2026

Shifted-Hermite Gaussian-tail primitive

Replace repeated evaluations of a Gaussian tail or Mills ratio in a neural loss or sampler with a short shifted-Hermite expansion. Choose a positive reference threshold x and represent the actual threshold as x+t; the same expansion then handles a whole batch of different shifts t using recursively generated Hermite coefficients.

Useful5/10
Difficulty3/10
Novelty6/10
Paper: Appell Polynomials in Shifted Asymptotic Expansions: the Mills ratio, Hermite polynomials, and Stieltjes bounds arXiv:2607.26636
Unverified 2026

Spectrum-preserving conditional binary graph sampler

Build a graph-structured binary latent layer whose local heat-bath probabilities are predicted by a neural network, while particle-exchange and refresh rates remain fixed. The learned probabilities change the stationary distribution and encode input-dependent conditioning, but the spectral invariance result predicts that they do not change the Markov-chain eigenvalues or relaxation modes. This provides a conditional sampler with a fixed, calibratable mixing budget instead of requiring a new…

Useful5/10
Difficulty5/10
Novelty8/10
Paper: Mixing times and spectra of non-equilibrium symmetric exclusion processes on general graphs arXiv:2607.22991
Unverified 2026

Entropy-Recycling Categorical Sampler

Replace independent categorical sampling calls with a shared exact sampler carrying a reusable uniform integer state. After sampling category X from a distribution with CDF F, retain the unused portion of the underlying random interval as a new state (Z', M'), so later samples consume residual randomness instead of requesting fresh random bits. The expected random-bit cost should approach the sequence entropy rather than paying a fixed word or byte cost per sample.

Useful5/10
Difficulty6/10
Novelty8/10
Paper: Online Random Sampling with Real Probabilities arXiv:2607.13828
Unverified 2026

High-precision accumulation with low-precision ODE stages

Use low precision only for repeated neural-function evaluations and intermediate stage vectors of an explicit ODE solver, while keeping the current state, timestep scaling, and final weighted accumulation in higher precision. This targets neural ODEs and diffusion probability-flow samplers, where function evaluations dominate runtime but accumulated integration error can destabilize long trajectories.

Useful5/10
Difficulty4/10
Novelty3/10
Paper: Mixed precision explicit numerical methods for ordinary differential equations arXiv:2607.07080