Sampling ideas

Diffusion step schedules, solvers, guidance and stopping rules that cut function evaluations or improve sample quality.

Unverified 2026

KL-optimal joint rare-event tilting

Modify a diffusion sampler over a complete scenario trajectory z by exponentially tilting its prior toward a learned failure score s(z), rather than conditioning independently on environment and execution variables. The resulting sampler spends more evaluations in rare failure regions while preserving an explicit importance weight for estimating probabilities under the original distribution.

Useful6/10
Difficulty5/10
Novelty4/10
Paper: Diffusion-Guided Search via Exponential Tilting (DiffTilt): An Application to Falsification of Safety-Critical Systems arXiv:2607.23134
Unverified 2026

Compact-Support Telegraph Latent Sampler

Use the OU process driven by multiple dichotomous noises as a bounded colored-noise module for latent-variable or diffusion sampling. Its stationary forcing is compactly supported for fixed amplitudes, while heterogeneous amplitudes and switching rates create controllable non-Gaussian structure before the large-K Gaussian limit.

Useful6/10
Difficulty5/10
Novelty8/10
Paper: Ornstein-Uhlenbeck Process Driven by Multiple Dichotomous Noises arXiv:2608.29226
Unverified 2026

Dissipation-Constrained Fast Inference

Use a fixed learned energy or score network but search over inference protocols with different mobility, temperature, and duration. Select the shortest protocol that reaches a target accuracy without exceeding a prescribed entropy-production budget, exploiting the paper's observation that computational accuracy does not uniquely determine the thermodynamic path.

Useful6/10
Difficulty6/10
Novelty8/10
Paper: The thermodynamic freedom of a thermodynamic computer arXiv:2608.27938
Unverified 2026

Specular hypocoercive Langevin optimizer

Replace projected overdamped Langevin updates for constrained neural-network parameters with underdamped Langevin dynamics carrying an explicit momentum variable and specular reflection at the boundary of a convex parameter domain. The paper's hypocoercive result predicts a convergence rate proportional to the square root of the Poincare constant of the target position distribution, potentially giving substantially faster mixing in poorly conditioned constrained problems than overdamped…

Useful6/10
Difficulty6/10
Novelty6/10
Paper: Sharp hypocoercive convergence estimates for underdamped Langevin dynamics with specular reflection arXiv:2608.17022
Unverified 2026

Self-occupancy fictitious-play sampler

Turn the paper's self-fictitious-play process into a learned sampler for latent training examples or diffusion states. A controller network generates trajectories using a best response to a slowly updated occupancy belief, and the belief is updated from the controller's own states with an exponential occupation-measure update. The slow update prevents abrupt feedback loops while the controller continually adapts toward underrepresented regions.

Useful6/10
Difficulty6/10
Novelty7/10
Paper: Self-fictitious-play for Potential Monotone Ergodic Mean-field Games arXiv:2608.15258
Unverified 2026

Two-query SPSA Langevin sampler for black-box neural energies

Replace backpropagated gradients in a Langevin sampler with a simultaneous-perturbation estimate obtained from two noisy evaluations of a neural energy or simulator-defined negative log-density. This enables posterior or latent-space sampling when the energy contains nondifferentiable code, stochastic simulation, discrete operations, or an inaccessible neural-network gradient.

Useful6/10
Difficulty5/10
Novelty8/10
Paper: Zeroth-Order Langevin Monte Carlo via SPSA under Noisy Function Measurements arXiv:2608.07837
Unverified 2026

Windowed Bouncy Particle Weight Sampler

Replace stepwise gradient evaluation in a Bouncy Particle sampler over neural-network parameters with deterministic windows. At the start of each window, compute one gradient and use smoothness to upper-bound the event intensity along the ballistic trajectory; candidate events are generated analytically from the integrated envelope and accepted using a gradient evaluation only at candidate locations. This gives an exact sampler under a certified global smoothness bound and a controllable…

Useful6/10
Difficulty6/10
Novelty7/10
Paper: Windowed thinning and query complexity for the bouncy particle and Zigzag samplers arXiv:2607.28413
Unverified 2026

Tangential probability-flow sampler

Modify the probability-flow ODE of a reflected diffusion so that its learned velocity is tangent to the constraint boundary. Use an exact tangent projection for box or sphere constraints, or a smooth boundary-collar correction for general domains, and train with an additional penalty on the predicted normal flux. This prevents numerical trajectories from leaving the domain and targets the no-flux structure directly instead of clipping samples after each solver step.

Useful6/10
Difficulty4/10
Novelty5/10
Paper: Reflected diffusion, no-flux continuity equations and confined Lagrangian flows in bounded domains arXiv:2607.28344
Unverified 2026

Robin-Boundary Diffusion Sampler

Train a score-based diffusion model on a domain with partially reactive constraints, replacing hard rejection or large boundary penalties by a Robin boundary condition. Samples approaching the constraint boundary acquire a hazard proportional to accumulated boundary local time, giving a continuous interpolation between reflection and absorption.

Useful5/10
Difficulty6/10
Novelty8/10
Paper: Survival in a partially reactive wedge arXiv:2609.02665
Unverified 2026

Warm-start hit-and-run augmentation

Replace rejection sampling or short biased random walks inside a convex latent constraint set with hit-and-run. At each step, choose a uniformly random direction and sample uniformly along the entire chord through the current point; the paper's mixing result predicts that a chain initialized by a crude approximate sampler becomes close to uniform with only logarithmic dependence on initialization bias and target error.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Hit-and-Run Mixes as Fast as the Ball Walk arXiv:2608.13487
Unverified 2026

Spectral-Gap Count Augmentation

Replace independent perturbations of a bag-of-events or histogram input by a Markov augmentation that resamples overlapping-window count vectors according to a stationary conditional kernel. The augmentation preserves realistic correlations induced by a learned reversible transition matrix and has a measurable mixing-rate guarantee, preventing an arbitrary augmentation chain from producing highly correlated or unstable samples.

Useful5/10
Difficulty7/10
Novelty8/10
Paper: Conditionally Resampled Sliding-Window Count Kernels: Spectral-Gap Bounds and Poincaré Inequalities arXiv:2608.08678
Unverified 2026

Noise-aware randomized Milstein sampler

Replace an Euler-Maruyama reverse-diffusion sampler with a scalar or coordinatewise randomized Milstein step that uses an autodifferentiated score or drift derivative and explicitly tolerates noisy coefficient and Brownian evaluations. Use the paper's additive error law to stop refining the time grid when discretization error falls below the neural-oracle noise floor.

Useful5/10
Difficulty5/10
Novelty6/10
Paper: Error of randomized Milstein scheme for scalar SDEs with noisy information about coefficients and Wiener process arXiv:2607.29578
Unverified 2026

Spectrum-preserving conditional binary graph sampler

Build a graph-structured binary latent layer whose local heat-bath probabilities are predicted by a neural network, while particle-exchange and refresh rates remain fixed. The learned probabilities change the stationary distribution and encode input-dependent conditioning, but the spectral invariance result predicts that they do not change the Markov-chain eigenvalues or relaxation modes. This provides a conditional sampler with a fixed, calibratable mixing budget instead of requiring a new…

Useful5/10
Difficulty5/10
Novelty8/10
Paper: Mixing times and spectra of non-equilibrium symmetric exclusion processes on general graphs arXiv:2607.22991
Unverified 2026

Large-Deviation Rare-Event Augmentation

Train a neural queue or event-sequence predictor using trajectories generated under an exponentially tilted scheduled-arrival law that makes rare overloads common. Reweight each tilted trajectory by its likelihood ratio, while optionally oversampling the rare-event subset to improve prediction of tail behavior.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Sample-path Large deviations for Scheduled Arrival Processes with Unpunctuality arXiv:2607.12666
Unverified 2026

Certified partition-function reranking

Replace MAP scoring of discrete latent configurations by comparison of the total energy-model mass assigned to each candidate class. Estimate each class partition function with annealed importance sampling driven by identical random seeds, then return a prediction only when a paired bootstrap confidence interval certifies that its log-partition score exceeds every competitor.

Useful5/10
Difficulty6/10
Novelty6/10
Paper: Certified decoding of quantum LDPC codes arXiv:2608.25545