Sampling ideas

Diffusion step schedules, solvers, guidance and stopping rules that cut function evaluations or improve sample quality.

✗ Mechanism failed 2026

ESS-Controlled Autoregressive CTMC Sampler

Generate discrete configurations globally with an autoregressive model and then refine them using a continuous-time Markov chain of local single-site replacement moves. Use importance weights and the paper's normalized ESS to adapt the CTMC refinement budget and to reject training batches in which the proposal has collapsed onto a few modes.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: FrOGS: Discrete Neural Sampler for Independent Alloy Configurations Across Chemical Conditions arXiv:2609.02948
✗ Mechanism failed 2026

Killed-Brownian diffusion score

Replace the standard Gaussian perturbation kernel in a diffusion model for nonnegative or half-space data with the exact Dirichlet heat kernel obtained by subtracting the reflected Gaussian. Train the score network against the analytic boundary-corrected score, preserving absorbing-boundary behavior without clipping, reflection heuristics, or an unconstrained coordinate transform.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: A Heat Kernel Expectation Approach to Boundary-Corrected Li--Yau Estimates for the Dirichlet Heat Equation arXiv:2608.12376
✗ Mechanism failed 2026

Controlled Stationary Hyperparameter Sweep

Replace many independently equilibrated SGLD runs at different hyperparameters with one controlled sweep in which an auxiliary drift transports particles through the stationary distributions indexed by the swept parameter. Estimate the response of loss, predictions, uncertainty, or weight observables using covariance with the stationary generalized-potential derivative instead of finite differences between separate runs.

Useful7/10
Difficulty7/10
Novelty7/10
Paper: Shortcuts to Parameter Sweeps arXiv:2608.12154
✗ Mechanism failed 2026

Dependence-Adaptive Timestep Controller

Use an online estimate of the target distribution's remaining coordinate dependence to choose diffusion step sizes instead of using a uniform timestep grid. Take large jumps when the current state is nearly coordinate-factorized and shorten the step when the denoiser detects strong cross-coordinate dependence, targeting the paper's dependence-adaptive discretization scaling.

Useful7/10
Difficulty4/10
Novelty8/10
Paper: Provably adaptive sampling with uniform and remasking discrete diffusion models arXiv:2608.23554
✗ Mechanism failed 2026

KL-Budgeted Poisson-Race Sampling

Replace repeated rejection sampling from a neural proposal P with a Poisson race that selects one proposal candidate with exactly the target distribution Q. Candidate i receives a Poisson arrival time A_i and race score A_i divided by Q(X_i)/P(X_i); the smallest score wins. When Q is close to P in KL divergence, the selected index has low expected logarithmic rank, providing an adaptive compute budget instead of a fixed number of candidates.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: A note on shifting distributions via Poisson races arXiv:2608.26996