Sampling ideas

Diffusion step schedules, solvers, guidance and stopping rules that cut function evaluations or improve sample quality.

✗ Failed on benchmark 2026

Cluster MCMC for rare neural trajectories

Train or sample a neural state-space model in trajectory space rather than drawing complete rollouts independently. Construct a space-time path graph whose vertices are latent states and local transition events, then update connected clusters of the entire trajectory using conditional Gibbs or Swendsen-Wang-like moves while preserving fixed initial, terminal, or event-count constraints. This should replace exponentially small forward-rollout success probabilities with local conditional updates…

Useful8/10
Difficulty7/10
Novelty7/10
Paper: Conditional-path Monte Carlo for rare stochastic dynamics on networks: Details and derivations arXiv:2608.17511
△ Mechanism confirmed, baseline not beaten 2026

State-Dependent Temperature Langevin

Replace isotropic Langevin noise in latent or energy-based neural sampling with a smooth position-dependent temperature \(\sigma(x)\geq 1\). Use the divergence correction associated with the diffusion matrix so that increasing exploration in the tails does not change the desired target distribution. This should reduce metastability and improve effective samples per gradient evaluation on heavy-tailed latent posteriors.

Useful7/10
Difficulty4/10
Novelty6/10
Paper: Hypocoercivity of Tempered Bouncy Particle Samplers for Heavy-Tailed Targets arXiv:2608.29657
✗ Failed on benchmark 2026

Dynamic-programming Doob sampler for exact rare-event conditioning

Add an exact backward-conditioning module to a neural state-space model so trajectories satisfy a terminal label, target set, initial-state restriction, or prescribed event count without rejection. The module computes a backward feasibility message and reweights each neural transition toward states that can still satisfy the constraint, producing a conditioned process equivalent to a Doob transform. For large latent spaces, the exact message can be approximated by a value network and its…

Useful7/10
Difficulty6/10
Novelty5/10
Paper: Conditional-path Monte Carlo for rare stochastic dynamics on networks: Details and derivations arXiv:2608.17511
✗ Failed on benchmark 2026

Conditional spacetime-cluster sampler for rare neural trajectories

Represent a stochastic recurrent or state-space model as an event trajectory and train it with trajectories conditioned on a rare terminal event, such as a catastrophic state, a constraint violation, or an unusually large prediction error. Instead of simulating forward until the event occurs, update connected spacetime clusters while holding the initial state and terminal event boundary fixed, so every retained trajectory is useful for rare-event learning. This provides a principled alternative…

Useful7/10
Difficulty7/10
Novelty8/10
Paper: Rare-event sampling for stochastic dynamics in network systems using cluster updates arXiv:2608.16171
✗ Mechanism failed 2026

Killed-Brownian diffusion score

Replace the standard Gaussian perturbation kernel in a diffusion model for nonnegative or half-space data with the exact Dirichlet heat kernel obtained by subtracting the reflected Gaussian. Train the score network against the analytic boundary-corrected score, preserving absorbing-boundary behavior without clipping, reflection heuristics, or an unconstrained coordinate transform.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: A Heat Kernel Expectation Approach to Boundary-Corrected Li--Yau Estimates for the Dirichlet Heat Equation arXiv:2608.12376
✓✓ Beats tuned baseline 2026

Context-free denoiser with analytic quadratic score injection

Train one denoiser only for the nonquadratic residual distribution, then modify the diffusion sampler using an analytically computed quadratic Gaussian context. Changing $K$ at inference changes the target distribution without retraining the denoiser, enabling transfer across temperatures, masses, coupling strengths, and boundary conditions whenever those changes remain quadratic.

Useful7/10
Difficulty6/10
Novelty6/10
Paper: Nuclear Quantum Effects as a Denoising Problem arXiv:2607.19680
✗ Failed on benchmark 2026

Tempered-Stable Volatility Clock for Sequence Diffusion

Replace independent Gaussian diffusion noise across sequence positions with a positive, persistent variance chain and conditionally Gaussian perturbations. This gives the denoiser exposure to heavy tails and volatility clustering without requiring a more expressive neural architecture; keep the denoiser blind to the realized variance when the goal is for generated samples to retain this structure.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Denoising Subordinated Probabilistic Models: Diffusion with a Tempered-Stable Volatility Clock, and What the Noise Mechanism Actually Controls arXiv:2607.19218
Unverified 2026

KL-optimal joint rare-event tilting

Modify a diffusion sampler over a complete scenario trajectory z by exponentially tilting its prior toward a learned failure score s(z), rather than conditioning independently on environment and execution variables. The resulting sampler spends more evaluations in rare failure regions while preserving an explicit importance weight for estimating probabilities under the original distribution.

Useful6/10
Difficulty5/10
Novelty4/10
Paper: Diffusion-Guided Search via Exponential Tilting (DiffTilt): An Application to Falsification of Safety-Critical Systems arXiv:2607.23134
Unverified 2026

Two-query SPSA Langevin sampler for black-box neural energies

Replace backpropagated gradients in a Langevin sampler with a simultaneous-perturbation estimate obtained from two noisy evaluations of a neural energy or simulator-defined negative log-density. This enables posterior or latent-space sampling when the energy contains nondifferentiable code, stochastic simulation, discrete operations, or an inaccessible neural-network gradient.

Useful6/10
Difficulty5/10
Novelty8/10
Paper: Zeroth-Order Langevin Monte Carlo via SPSA under Noisy Function Measurements arXiv:2608.07837
△ Mechanism confirmed, baseline not beaten 2026

Nonreversible latent instanton sampler

Represent a rare transition in a neural latent space by a controlled path whose drift is optimized directly, instead of obtaining it by reversing the relaxation dynamics. Learn a state-dependent mobility or diffusion matrix so that the sampler allocates noise and control effort according to the local stochastic geometry. This should improve generation of low-probability transitions in nonequilibrium world models and reduce the number of failed trajectories.

Useful6/10
Difficulty6/10
Novelty5/10
Paper: Nucleation and time-reversal symmetry breaking in nonconserved scalar field theories arXiv:2607.05194
Unverified 2026

Spectrum-preserving conditional binary graph sampler

Build a graph-structured binary latent layer whose local heat-bath probabilities are predicted by a neural network, while particle-exchange and refresh rates remain fixed. The learned probabilities change the stationary distribution and encode input-dependent conditioning, but the spectral invariance result predicts that they do not change the Markov-chain eigenvalues or relaxation modes. This provides a conditional sampler with a fixed, calibratable mixing budget instead of requiring a new…

Useful5/10
Difficulty5/10
Novelty8/10
Paper: Mixing times and spectra of non-equilibrium symmetric exclusion processes on general graphs arXiv:2607.22991
Unverified 2026

Large-Deviation Rare-Event Augmentation

Train a neural queue or event-sequence predictor using trajectories generated under an exponentially tilted scheduled-arrival law that makes rare overloads common. Reweight each tilted trajectory by its likelihood ratio, while optionally oversampling the rare-event subset to improve prediction of tail behavior.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Sample-path Large deviations for Scheduled Arrival Processes with Unpunctuality arXiv:2607.12666