Sampling ideas

Diffusion step schedules, solvers, guidance and stopping rules that cut function evaluations or improve sample quality.

△ Mechanism confirmed, baseline not beaten 2026

Intrinsic Schrödinger Bridge Diffusion

Replace an unconstrained Euclidean diffusion sampler plus projection with a controlled diffusion whose state always lies on an embedded manifold \(\mathcal M\). The neural controller predicts a tangent vector, while the stochastic forcing is also tangent; this preserves constraints during every intermediate denoising step and avoids the bias caused by repeatedly projecting off-manifold states.

Useful8/10
Difficulty6/10
Novelty7/10
Paper: Hard-Constrained Sampling on Embedded Riemannian Manifolds via Adjoint Schrödinger Bridges arXiv:2608.25838
✗ Failed on benchmark 2026

Cluster MCMC for rare neural trajectories

Train or sample a neural state-space model in trajectory space rather than drawing complete rollouts independently. Construct a space-time path graph whose vertices are latent states and local transition events, then update connected clusters of the entire trajectory using conditional Gibbs or Swendsen-Wang-like moves while preserving fixed initial, terminal, or event-count constraints. This should replace exponentially small forward-rollout success probabilities with local conditional updates…

Useful8/10
Difficulty7/10
Novelty7/10
Paper: Conditional-path Monte Carlo for rare stochastic dynamics on networks: Details and derivations arXiv:2608.17511
✗ Failed on benchmark 2026

Exact Linear-Drift Posterior-Mean Sampler

Replace Euler-Maruyama in a reverse diffusion sampler with an interval transition that freezes the neural posterior-mean prediction but integrates the known linear drift and Gaussian noise exactly. The resulting exponential integrator should tolerate larger timesteps, particularly when the reverse dynamics are stiff in high-noise or strongly anisotropic directions.

Useful8/10
Difficulty5/10
Novelty5/10
Paper: Forward-Evolution Error Analysis and Adaptive Design for Matrix-Valued Diffusion Models arXiv:2608.15103
✓✓ Beats tuned baseline 2026

Conditional-Transport Discrete Reverse Diffusion

Replace the standard Gaussian affine reverse step with a conditional transport kernel learned from the forward transition. Given a noisy state x_{k+1}, the model predicts a full conditional distribution for x_k using a monotone conditional CDF or an autoregressive normalizing flow. This represents multimodal and state-dependent reverse transitions that cannot be captured by a single Gaussian mean and variance.

Useful8/10
Difficulty6/10
Novelty5/10
Paper: Reverse-Time Diffusion Processes for Discrete Time Linear and Nonlinear Systems with non-Gaussian Noise arXiv:2607.23947
✓✓ Beats tuned baseline 2026

Path-work correction for exact neural proposals

Use the learned path only as a global proposal, then correct complete trajectories rather than endpoints. Exponentiated negative work gives self-normalized importance weights, while the same path ratio gives an independent Metropolis acceptance probability. This turns an imperfect neural sampler into an asymptotically exact sampler whenever forward and reverse path laws overlap.

Useful8/10
Difficulty4/10
Novelty6/10
Paper: Neural Non-Equilibrium Hamiltonian Monte Carlo for Corrected Boltzmann Sampling arXiv:2607.15682
△ Mechanism confirmed, baseline not beaten 2026

Convex-Projected Diffusion Sampler

For additive-noise diffusion, train or interpret the network as a denoiser and project its predicted clean sample onto a known bounded closed convex set containing the data support. Convert the projected denoiser back into a score before each Euler-Maruyama or probability-flow ODE step. The projection is nonexpansive relative to the true denoiser, so it cannot increase pointwise denoising error when the true conditional mean belongs to the set, while it imposes a hard bound that suppresses rare…

Useful8/10
Difficulty3/10
Novelty7/10
Paper: Score Accuracy Along the Forward Diffusion Does Not Certify Numerical Stability in Diffusion Sampling arXiv:2607.08757
✓ Mechanism works 2026

Leave-One-Out Corrective Parallel Sampler

Replace standard tau-leaping in discrete diffusion generation with a first-order sampler whose per-coordinate transition is conditioned on all other current coordinates and excludes the coordinate being updated. After a parallel proposal, use the same leave-one-out conditionals to correct coordinates whose newly sampled values are inconsistent with the rest of the state, allowing large timesteps without permanently propagating simultaneous denoising errors.

Useful8/10
Difficulty5/10
Novelty7/10
Paper: Provably adaptive sampling with uniform and remasking discrete diffusion models arXiv:2608.23554
△ Mechanism confirmed, baseline not beaten 2026

Dissipation-Budgeted Nonreversible Sampling

Add a controlled nonreversible drift to a Langevin or score-based diffusion sampler so trajectories reach a target high-probability region faster, while constraining pathwise entropy production or excess heat. The paper predicts that hazard-rate improvement has a thermodynamic ceiling: general time-dependent survival acceleration is at most linear in perturbation strength and prior entropy production, while rare-event acceleration is bounded exponentially by excess heat.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Accelerating stochastic processes through nonequilibrium driving: Thermodynamic constraints on the maximum speed-up arXiv:2609.03179
✗ Mechanism failed 2026

ESS-Controlled Autoregressive CTMC Sampler

Generate discrete configurations globally with an autoregressive model and then refine them using a continuous-time Markov chain of local single-site replacement moves. Use importance weights and the paper's normalized ESS to adapt the CTMC refinement budget and to reject training batches in which the proposal has collapsed onto a few modes.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: FrOGS: Discrete Neural Sampler for Independent Alloy Configurations Across Chemical Conditions arXiv:2609.02948
✗ Failed on benchmark 2026

Wavelet Conditional Sampler for Neural EBMs

Represent an image or spatial latent state in an orthogonal multiresolution wavelet basis and learn the conditional distribution of detail coefficients at each scale given all coarser coefficients. At inference time, sample coarse coefficients first and recursively sample finer coefficients, using a small conditional network or a few local Langevin steps at each level instead of running a long pixel-space Markov chain. The mechanism should remove critical slowing down caused by long-range…

Useful7/10
Difficulty6/10
Novelty6/10
Paper: Overcoming critical slowing down in frustrated spin systems by learned multiscale sampling arXiv:2608.31114
△ Mechanism confirmed, baseline not beaten 2026

State-Dependent Temperature Langevin

Replace isotropic Langevin noise in latent or energy-based neural sampling with a smooth position-dependent temperature \(\sigma(x)\geq 1\). Use the divergence correction associated with the diffusion matrix so that increasing exploration in the tails does not change the desired target distribution. This should reduce metastability and improve effective samples per gradient evaluation on heavy-tailed latent posteriors.

Useful7/10
Difficulty4/10
Novelty6/10
Paper: Hypocoercivity of Tempered Bouncy Particle Samplers for Heavy-Tailed Targets arXiv:2608.29657
△ Mechanism confirmed, baseline not beaten 2026

Fisher-Geodesic Finite-Step Annealing

Replace uniformly spaced diffusion or energy annealing schedules by a finite sequence of quench-relax stages whose intermediary distributions are approximately equally spaced in Fisher-Rao distance. Each stage abruptly changes the model energy or noise level and then runs a short relaxation phase; the schedule concentrates stages where the distribution changes most sharply. This should reduce nonequilibrium mismatch at a fixed number of sampler evaluations and avoid large distributional jumps…

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Finite relaxation protocols with minimal dissipation arXiv:2608.25207
✗ Failed on benchmark 2026

Target-Law Neural Stopping

Learn a path-dependent stopping policy for a stochastic neural trajectory so that the state at stopping time matches a prescribed target distribution, instead of optimizing only a scalar terminal reward. This can turn a fixed-length diffusion sampler or iterative latent refinement process into an adaptive sampler that stops early when its sample distribution is already sufficiently close to the target.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: When to Sell an Asset? - A Distribution Builder Approach arXiv:2608.18783
✗ Failed on benchmark 2026

Persistent Hamiltonian categorical sampler

Replace independent categorical proposals or reversible Metropolis updates for discrete latent variables with a lifted sampler carrying persistent continuous edge momenta. Neighbor transitions are biased by the momentum and use a symmetric energy factor, so momentum reversal gives the required balance relation for the target Gibbs distribution while ordinary dynamics remain non-reversible. This should reduce random-walk behavior when sampling multimodal categorical latents or token sequences.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Hamiltonian dynamics for sampling on discrete spaces arXiv:2608.17961
✗ Failed on benchmark 2026

Dynamic-programming Doob sampler for exact rare-event conditioning

Add an exact backward-conditioning module to a neural state-space model so trajectories satisfy a terminal label, target set, initial-state restriction, or prescribed event count without rejection. The module computes a backward feasibility message and reweights each neural transition toward states that can still satisfy the constraint, producing a conditioned process equivalent to a Doob transform. For large latent spaces, the exact message can be approximated by a value network and its…

Useful7/10
Difficulty6/10
Novelty5/10
Paper: Conditional-path Monte Carlo for rare stochastic dynamics on networks: Details and derivations arXiv:2608.17511
✓✓ Beats tuned baseline 2026

Latent-Component Schrödinger Bridge

Represent both endpoint distributions as Gaussian mixtures and explicitly transport their component labels along with continuous states. Use an entropic coupling between source and target components, then run a separate Gaussian bridge for every selected component pair, with covariance inflation preventing unstable Riccati or Cholesky computations.

Useful7/10
Difficulty6/10
Novelty6/10
Paper: On Bridging Mixture Distributions arXiv:2608.13383
✗ Mechanism failed 2026

Killed-Brownian diffusion score

Replace the standard Gaussian perturbation kernel in a diffusion model for nonnegative or half-space data with the exact Dirichlet heat kernel obtained by subtracting the reflected Gaussian. Train the score network against the analytic boundary-corrected score, preserving absorbing-boundary behavior without clipping, reflection heuristics, or an unconstrained coordinate transform.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: A Heat Kernel Expectation Approach to Boundary-Corrected Li--Yau Estimates for the Dirichlet Heat Equation arXiv:2608.12376
✗ Mechanism failed 2026

Controlled Stationary Hyperparameter Sweep

Replace many independently equilibrated SGLD runs at different hyperparameters with one controlled sweep in which an auxiliary drift transports particles through the stationary distributions indexed by the swept parameter. Estimate the response of loss, predictions, uncertainty, or weight observables using covariance with the stationary generalized-potential derivative instead of finite differences between separate runs.

Useful7/10
Difficulty7/10
Novelty7/10
Paper: Shortcuts to Parameter Sweeps arXiv:2608.12154
△ Mechanism confirmed, baseline not beaten 2026

Unbiased Path-Rejection Langevin Corrector

Replace a discretized Langevin sampler used with a neural energy model by a short underdamped diffusion proposal followed by exact path-space rejection correction. The correction uses a Girsanov likelihood ratio and an unbiased randomized estimator, so accepted samples target the continuous-time diffusion rather than a biased Euler chain.

Useful7/10
Difficulty8/10
Novelty8/10
Paper: Exact simulation of diffusions and improved algorithms for log-concave sampling arXiv:2608.05022
✓✓ Beats tuned baseline 2026

Entropy-production adaptive diffusion sampler

Use an entropy-production-inspired local discrepancy between full-step and coupled half-step reverse diffusion trajectories as an adaptive error signal. The sampler takes large Euler steps where the estimated marginal mismatch is small and refines only where score variation or reverse-flow mismatch is high, targeting terminal KL rather than path-space error.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: A Unified Kullback--Leibler Divergence Analysis of Generative Diffusion Models via Entropy Production Rate arXiv:2608.02406
✗ Failed on benchmark 2026

Gaussian-compensated Levy neural noise

Replace the unresolved small jumps of an infinite-activity stable Levy noise source in a neural SDE or stochastic optimizer with one Gaussian increment whose variance equals the discarded jump variance. Simulate only jumps above the cutoff exactly or by Poisson sampling, retaining the large-jump distribution while obtaining the paper's O(\varepsilon) Wasserstein error instead of the naive O(\varepsilon^{1-\alpha/2}) error.

Useful7/10
Difficulty5/10
Novelty8/10
Paper: A spectral-compensated scheme for space-parameter Poisson noise functionals: error bounds and complexity estimates arXiv:2607.27657
△ Mechanism confirmed, baseline not beaten 2026

PDE Sinkhorn with asymmetric geometric boundaries

Build a Schrödinger-bridge solver that represents the two Sinkhorn scaling factors as solutions of forward and backward Kolmogorov PDEs, rather than requiring explicit transition-density evaluation. Enforce an oblique Neumann condition on the backward factor and a normal no-flux condition on the forward factor, allowing degenerate diffusion and hard domain boundaries to be handled directly.

Useful7/10
Difficulty7/10
Novelty8/10
Paper: Reflected Schrodinger Bridge Problem over Sub-Riemannian Manifold arXiv:2607.17904
△ Mechanism confirmed, baseline not beaten 2026

Work-trained neural Hamiltonian bridge

Train a neural finite-time Hamiltonian-style path from an easy base density to a Boltzmann target by minimizing its generalized nonequilibrium work. The work is a path-space log-density ratio, so its mean is a forward KL divergence up to a constant and the endpoint marginal mismatch is bounded by the same quantity. Unlike an uncorrected neural sampler, this produces a global proposal whose bias and overlap can be measured quantitatively.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Neural Non-Equilibrium Hamiltonian Monte Carlo for Corrected Boltzmann Sampling arXiv:2607.15682
Unverified 2026

Compact-Support Telegraph Latent Sampler

Use the OU process driven by multiple dichotomous noises as a bounded colored-noise module for latent-variable or diffusion sampling. Its stationary forcing is compactly supported for fixed amplitudes, while heterogeneous amplitudes and switching rates create controllable non-Gaussian structure before the large-K Gaussian limit.

Useful6/10
Difficulty5/10
Novelty8/10
Paper: Ornstein-Uhlenbeck Process Driven by Multiple Dichotomous Noises arXiv:2608.29226