△ Mechanism confirmed, baseline not beaten 2026

Unbiased Path-Rejection Langevin Corrector

Implementation & benchmark of arXiv:2608.05022 — Exact simulation of diffusions and improved algorithms for log-concave sampling

Usefulness7/10
Difficulty8/10
Novelty8/10

Source paper: Exact simulation of diffusions and improved algorithms for log-concave sampling arXiv:2608.05022 ⓘ · analyzed Aug 31, 2026

AI-generated research hypothesis, automatically tested. Not peer-reviewed.

Idea description

Replace a discretized Langevin sampler used with a neural energy model by a short underdamped diffusion proposal followed by exact path-space rejection correction. The correction uses a Girsanov likelihood ratio and an unbiased randomized estimator, so accepted samples target the continuous-time diffusion rather than a biased Euler chain.

Formulas

$$\mathrm{d}X_t=P_t\,\mathrm{d}t,\qquad \mathrm{d}P_t=\bigl(-\gamma P_t-\nabla V(X_t)\bigr)\,\mathrm{d}t+\sqrt{2\gamma}\,\mathrm{d}B_t.$$
$$R_T=\exp\left\{\int_0^T\frac{\Delta(X_t,P_t)^\top}{\sqrt{2\gamma}}\,\mathrm{d}B_t-\frac12\int_0^T\frac{\|\Delta(X_t,P_t)\|^2}{2\gamma}\,\mathrm{d}t\right\},\qquad \Delta(x,p)=(-\gamma p-\nabla V(x))-\widetilde b_p(x,p).$$
$$N\sim\operatorname{Poisson}(\lambda T),\quad U_i\stackrel{\mathrm{iid}}\sim\operatorname{Uniform}[0,T],\quad \widehat E=\prod_{i=1}^{N}\left(1-\frac{g(U_i)}{\lambda}\right),\quad \mathbb{E}[\widehat E]=\exp\left(-\int_0^T g(t)\,\mathrm{d}t\right),\quad 0\le g(t)\le\lambda.$$
$$\text{Accept the proposed path with probability }\alpha=\frac{\widehat R_T}{M};\qquad \mathbb{E}[\widehat R_T\mid\text{path}]=R_T.$$

Mathematical statement

The paper's underdamped Langevin diffusion is the phase-space SDE dX_t=P_t dt and dP_t=(-gamma P_t-nabla V(X_t))dt+sqrt(2 gamma)dB_t, where X_t is position, P_t is momentum, V is the target potential, gamma>0 is friction, and B_t is standard Brownian motion. For a proposal drift with momentum component ilde b_p(x,p), define the drift discrepancy Delta(x,p)=(-gamma p-nabla V(x))- ilde b_p(x,p). Since the diffusion coefficient in momentum is sigma=sqrt(2 gamma)I, Girsanov's path-density ratio over [0,T] is R_T=exp{int_0^T (Delta(X_t,P_t)/sqrt(2 gamma))^T dB_t - (1/2)int_0^T ||Delta(X_t,P_t)||^2/(2 gamma)dt}. The paper's key computational claim is that, for a suitably short T and an appropriate rejection construction, R_T can be replaced by an unbiased estimator using O(1) queries to nabla V. A generic unbiased estimator for an exponential integral used inside this construction is: if 0<=g(t)<=lambda, U_i iid Uniform[0,T], N~Poisson(lambda T), then E[product_{i=1}^N(1-g(U_i)/lambda)]=exp(-int_0^T g(t)dt). Here g(t)=||Delta(X_t,P_t)||^2/(4 gamma), with lambda an upper bound. The accept/reject step requires a nonnegative unbiased ratio estimator and a valid envelope M satisfying R_T<=M almost surely or via the paper's corresponding randomized rejection bound.

Implementation notes

(1) Integration point: modify the inference-time sampler for a neural energy model E_theta(x), where V(x)=E_theta(x) or V is a known data-consistency energy plus a neural prior. Maintain position x and momentum p. Use a cheap proposal drift ilde b_p, for example -gamma p minus a stale, cached, low-rank, or smaller-network gradient, while the target drift uses the current full gradient nabla E_theta(x). Do not alter network weights during the first experiment. (2) Pseudocode: initialize x,p; for each proposal draw Brownian increments and integrate dX=p dt, dP= ilde b_p(x,p)dt+sqrt(2 gamma)dB with a fine internal step; query the full gradient at randomized Poisson times U_i and at the endpoints; compute Delta=(-gamma p-nabla E_theta(x))- ilde b_p; accumulate the stochastic integral Delta^T dB/sqrt(2 gamma) and the quadratic term ||Delta||^2/(4 gamma); form the nonnegative unbiased estimator \hat R_T using the paper's randomized path-ratio estimator, or initially use the Poisson product estimator for the quadratic exponential and a discretized stochastic-integral factor; accept with probability min(1,\hat R_T/M), otherwise restart from the previous state. (3) Compute from the mathematics: the underdamped proposal, Girsanov correction, Poisson randomization, and rejection decision. Estimate empirically: the envelope M, the maximal discrepancy bound lambda, the acceptance rate, gradient queries per accepted sample, and bias from time discretization. Start with bounded-gradient synthetic potentials so that lambda and M are known; then test a neural energy with gradient clipping to enforce a practical bound. (4) Cheap experiment: use 2D and 10D strongly convex quartic potentials and a small MLP energy, comparing corrected proposals against MALA, ULA, and ordinary underdamped Euler using the same number of full energy-gradient calls. Measure target mean and covariance error, KL or Renyi-divergence estimates, acceptance rate, and effective samples per gradient query. Success is lower discretization bias at equal compute, or at least a 2x larger stable integration step than ULA while preserving the same distributional error. First validate unbiasedness by fixing a path and averaging thousands of ratio-estimator repetitions.

Verification

Mechanism confirmed, baseline not beaten

Stage 1 · Toy mechanism gate: Passed ✓

Stage 2 · Mechanism transferred to benchmark: Confirmed ✓

Stage 2 · Practical benchmark result: Significantly worse ✗

Methodology: 8 paired seeds, permutation test (p<0.05) against a learning-rate-tuned baseline. How verification works

Stage 1 — Mechanism check agent confidence 9/10

Built an MVP with underdamped proposal integration, discretized Girsanov diagnostics, and the nonnegative Poisson quadratic-factor estimator. The core mechanism manifested: Poisson estimates were unbiased across lambda, variance matched the predicted scaling, and zero discrepancy produced an exactly-one estimator. The constant-drift Girsanov check also matched E[R]=1; the corrected MH analogue removed Gaussian ULA variance bias, but this is supporting evidence rather than a full exact path-rejection implementation.

Agent confidence
9/10
Baseline
ULA Gaussian-target variance errors were 0.0520, 0.2538, 0.6637, 1.4866, and 8.9813 at steps 0.1, 0.4, 0.8, 1.2, and 1.8.
Idea
Poisson estimator exact mean was 0.571209. At lambda 1, 2, 4, 8, 16, and 32, observed/theoretical relative-variance ratios were 1.0019, 1.0025, 0.9991, 0.9966, 1.0039, and 1.0049. At g=0, mean=1 and std=0. Girsanov constant-discrepancy mean was 0.999752 with standard error 0.000637. The MH correction analogue produced variances 1.0020, 0.9990, 0.9983, 1.0000, and 1.0029 at the same steps.

Limitations: The full exact path-rejection sampler was not implemented: the stochastic-integral factor is only a discretized diagnostic, and no almost-sure finite rejection envelope M was constructed. The sampling comparison uses exact random-walk MH as a correction analogue rather than the complete unbiased underdamped rejection algorithm. No neural energy, high-dimensional target, FLOP-normalized benchmark, or GPU experiment was run.

How to run: python3 verify.py && /home/maxwelhelp/main/bin/python3 -c 'from sampler import constant_delta_check; print(constant_delta_check())'

Stage 2 — Benchmark vs. tuned baseline (arXiv:2608.05022)

Significantly WORSE than the tuned baseline (+386904.4%, p=0.0081, wins 0 / 8 paired seeds).

Benchmark
Bounded_energy_regression
Model
mlp_tiny
Paired seeds
8
Baseline mean
0.0012
Idea mean
4.5421
Effect (Δ)
4.541 (+386904.4%; negative = idea better)
Wins
0 / 8 paired seeds
p-value
0.0081 (permutation test, 20 000 shuffles)
Smallest detectable effect
n/a
Mechanism
Confirmed ✓
Practical effect
Hurts
Baseline tuning
swept over 3 configs
Limitations:

The full stochastic-integral Girsanov estimator and an almost-sure finite rejection envelope were not implemented. The custom track is a small synthetic bounded-energy regression task rather than a large real neural energy model; no built-in track was structurally appropriate for inference-time diffusion sampling.

How to run: python3 bench_run.py

Verdict computed by deterministic test code from paired-seed statistics — not by the language model.

Stage 2 — Benchmark latest Failed ✗

Agent confidence: 10/10

Implemented a custom bounded-energy regression track with a shared mlp_tiny architecture, Adam baseline training, and an underdamped stale-gradient proposal with Poisson quadratic-factor rejection. The trained-model mechanism signature was confirmed quantitatively: predicted acceptance factor 0.98468 versus observed 0.98115, ratio 0.99642. The idea significantly worsened test MSE (paired delta +4.54097, permutation p=0.0081), so it does not transfer as a useful training intervention; the MVP omits the full stochastic-integral Girsanov factor and exact rejection envelope.

Baseline
Best Adam lr=0.01; 8-seed mean test MSE 0.00117367, std 0.00021387.
Idea
Best corrected-proposal lr=0.003, noise=0.01; 8-seed mean test MSE 4.54214, std 7.34186; paired delta +4.54097, p=0.0081; idea worse significantly. Mechanism predicted factor 0.98468, observed acceptance 0.98115, ratio 0.99642, confirmed=true.

Benchmark result

Significantly WORSE than the tuned baseline (+386904.4%, p=0.0081, wins 0 / 8 paired seeds).

Benchmark
Bounded_energy_regression
Model
mlp_tiny
Paired seeds
8
Baseline mean
0.0012
Idea mean
4.5421
Effect (Δ)
4.541 (+386904.4%; negative = idea better)
Wins
0 / 8 paired seeds
p-value
0.0081 (permutation test, 20 000 shuffles)
Smallest detectable effect
n/a
Mechanism
Confirmed ✓
Practical effect
Hurts
Baseline tuning
swept over 3 configs
Limitations:

The full stochastic-integral Girsanov estimator and an almost-sure finite rejection envelope were not implemented. The custom track is a small synthetic bounded-energy regression task rather than a large real neural energy model; no built-in track was structurally appropriate for inference-time diffusion sampling.

How to run: python3 bench_run.py

Artifacts

Implementation overview ⬇ Download all as ZIP 8 files · code, reports and structured results