Sampling ideas

Diffusion step schedules, solvers, guidance and stopping rules that cut function evaluations or improve sample quality.

✗ Mechanism failed 2026

Conditional-Flow Nested Sampling for Neural Energy Landscapes

Use a conditional normalizing flow to replace inner-loop MCMC when sampling states or parameters under progressively tighter neural energy or likelihood constraints. The flow is trained online from recent live sets, and proposals are corrected by importance weighting and resampling, so flow bias does not directly corrupt the nested estimate.

Useful8/10
Difficulty6/10
Novelty6/10
Paper: Generative Nested Sampling of Atomistic Thermodynamic Landscapes arXiv:2609.03193
✗ Failed on benchmark 2026

Cramer-Rao Temperature Controller

Use the generalized Cramér–Rao relation to adapt the inverse-temperature or noise schedule of an energy-based sampler, diffusion sampler, or stochastic optimizer. The controller limits each temperature change according to the measured energy variance and Fisher information, preventing uncontrolled changes in the sampled energy distribution while allowing larger steps in insensitive regions.

Useful8/10
Difficulty4/10
Novelty7/10
Paper: Cramer-Rao Inequality Generalizes the Equilibrium Energy Fluctuation-Response Relation to Nonequilibrium Steady States arXiv:2608.23455
✓✓ Beats tuned baseline 2026

Conditional-Transport Discrete Reverse Diffusion

Replace the standard Gaussian affine reverse step with a conditional transport kernel learned from the forward transition. Given a noisy state x_{k+1}, the model predicts a full conditional distribution for x_k using a monotone conditional CDF or an autoregressive normalizing flow. This represents multimodal and state-dependent reverse transitions that cannot be captured by a single Gaussian mean and variance.

Useful8/10
Difficulty6/10
Novelty5/10
Paper: Reverse-Time Diffusion Processes for Discrete Time Linear and Nonlinear Systems with non-Gaussian Noise arXiv:2607.23947
✗ Mechanism failed 2026

ESS-Controlled Autoregressive CTMC Sampler

Generate discrete configurations globally with an autoregressive model and then refine them using a continuous-time Markov chain of local single-site replacement moves. Use importance weights and the paper's normalized ESS to adapt the CTMC refinement budget and to reject training batches in which the proposal has collapsed onto a few modes.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: FrOGS: Discrete Neural Sampler for Independent Alloy Configurations Across Chemical Conditions arXiv:2609.02948
△ Mechanism confirmed, baseline not beaten 2026

CVaR-tail active residual correction

Train a cheap neural surrogate globally, then use an ensemble or bootstrap covariance to identify inputs near the estimated upper-tail boundary and inputs where high-fidelity correction is uncertain. Fit a Tikhonov-regularized residual model on the acquired expensive labels and use the corrected predictor for CVaR estimation or risk-constrained optimization. The acquisition policy deliberately ignores easy central-region samples unless they influence the tail threshold.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: Risk-averse design optimization with CVaR constraints via multifidelity tail-region correction arXiv:2608.29222
✗ Mechanism failed 2026

Controlled Stationary Hyperparameter Sweep

Replace many independently equilibrated SGLD runs at different hyperparameters with one controlled sweep in which an auxiliary drift transports particles through the stationary distributions indexed by the swept parameter. Estimate the response of loss, predictions, uncertainty, or weight observables using covariance with the stationary generalized-potential derivative instead of finite differences between separate runs.

Useful7/10
Difficulty7/10
Novelty7/10
Paper: Shortcuts to Parameter Sweeps arXiv:2608.12154
✗ Failed on benchmark 2026

Tempered-Stable Volatility Clock for Sequence Diffusion

Replace independent Gaussian diffusion noise across sequence positions with a positive, persistent variance chain and conditionally Gaussian perturbations. This gives the denoiser exposure to heavy tails and volatility clustering without requiring a more expressive neural architecture; keep the denoiser blind to the realized variance when the goal is for generated samples to retain this structure.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Denoising Subordinated Probabilistic Models: Diffusion with a Tempered-Stable Volatility Clock, and What the Noise Mechanism Actually Controls arXiv:2607.19218
✓ Mechanism works 2026

Conditional-TC Reveal Scheduler

Replace confidence-only masked diffusion decoding with an adaptive scheduler that chooses batches whose unrevealed tokens have low conditional total correlation given the already revealed context. The scheduler should preserve large parallel batches when token predictions are conditionally independent, but split highly dependent tokens into separate rounds to reduce forward-KL error.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Conditional Total Correlation and the Serial Depth of Adaptive Parallel Sampling arXiv:2608.25505
✗ Mechanism failed 2026

Dependence-Adaptive Timestep Controller

Use an online estimate of the target distribution's remaining coordinate dependence to choose diffusion step sizes instead of using a uniform timestep grid. Take large jumps when the current state is nearly coordinate-factorized and shorten the step when the denoiser detects strong cross-coordinate dependence, targeting the paper's dependence-adaptive discretization scaling.

Useful7/10
Difficulty4/10
Novelty8/10
Paper: Provably adaptive sampling with uniform and remasking discrete diffusion models arXiv:2608.23554
✗ Failed on benchmark 2026

Second-order fusion prior for point-set diffusion

Add the paper's local Sine_beta fusion law as an analytic score prior for diffusion models that generate unordered point configurations. The model is trained to match both the usual diffusion score and an explicit short-range repulsion score, including the second-order correction that describes finite-scale fused configurations.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Second-order Fusion Asymptotics for Sine\b{eta} Correlation Functions arXiv:2608.23742
Unverified 2026

Dominance-aware mode extraction for binary neural samplers

Replace nearest-center or k-modes assignment on a pool of binary neural-network samples with responsibility thresholding followed by a coordinate-wise dominance screen. Only retain a candidate mode when its assigned samples are sufficiently explained by that mode and, at every bit position, the responsibility-weighted majority agrees with the proposed center; otherwise mark the mode unreliable or discard it.

Useful5/10
Difficulty4/10
Novelty7/10
Paper: Reliable Sample-Level Quantum Error Mitigation via Dominance-Aware Clustering arXiv:2609.01744