Unbiased Path-Rejection Langevin Corrector
Implementation & benchmark of arXiv:2608.05022 — Exact simulation of diffusions and improved algorithms for log-concave sampling
Source paper: Exact simulation of diffusions and improved algorithms for log-concave sampling arXiv:2608.05022 ⓘ · analyzed Aug 31, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Replace a discretized Langevin sampler used with a neural energy model by a short underdamped diffusion proposal followed by exact path-space rejection correction. The correction uses a Girsanov likelihood ratio and an unbiased randomized estimator, so accepted samples target the continuous-time diffusion rather than a biased Euler chain.
Formulas
Mathematical statement
The paper's underdamped Langevin diffusion is the phase-space SDE dX_t=P_t dt and dP_t=(-gamma P_t-nabla V(X_t))dt+sqrt(2 gamma)dB_t, where X_t is position, P_t is momentum, V is the target potential, gamma>0 is friction, and B_t is standard Brownian motion. For a proposal drift with momentum component ilde b_p(x,p), define the drift discrepancy Delta(x,p)=(-gamma p-nabla V(x))- ilde b_p(x,p). Since the diffusion coefficient in momentum is sigma=sqrt(2 gamma)I, Girsanov's path-density ratio over [0,T] is R_T=exp{int_0^T (Delta(X_t,P_t)/sqrt(2 gamma))^T dB_t - (1/2)int_0^T ||Delta(X_t,P_t)||^2/(2 gamma)dt}. The paper's key computational claim is that, for a suitably short T and an appropriate rejection construction, R_T can be replaced by an unbiased estimator using O(1) queries to nabla V. A generic unbiased estimator for an exponential integral used inside this construction is: if 0<=g(t)<=lambda, U_i iid Uniform[0,T], N~Poisson(lambda T), then E[product_{i=1}^N(1-g(U_i)/lambda)]=exp(-int_0^T g(t)dt). Here g(t)=||Delta(X_t,P_t)||^2/(4 gamma), with lambda an upper bound. The accept/reject step requires a nonnegative unbiased ratio estimator and a valid envelope M satisfying R_T<=M almost surely or via the paper's corresponding randomized rejection bound.
Implementation notes
(1) Integration point: modify the inference-time sampler for a neural energy model E_theta(x), where V(x)=E_theta(x) or V is a known data-consistency energy plus a neural prior. Maintain position x and momentum p. Use a cheap proposal drift ilde b_p, for example -gamma p minus a stale, cached, low-rank, or smaller-network gradient, while the target drift uses the current full gradient nabla E_theta(x). Do not alter network weights during the first experiment. (2) Pseudocode: initialize x,p; for each proposal draw Brownian increments and integrate dX=p dt, dP= ilde b_p(x,p)dt+sqrt(2 gamma)dB with a fine internal step; query the full gradient at randomized Poisson times U_i and at the endpoints; compute Delta=(-gamma p-nabla E_theta(x))- ilde b_p; accumulate the stochastic integral Delta^T dB/sqrt(2 gamma) and the quadratic term ||Delta||^2/(4 gamma); form the nonnegative unbiased estimator \hat R_T using the paper's randomized path-ratio estimator, or initially use the Poisson product estimator for the quadratic exponential and a discretized stochastic-integral factor; accept with probability min(1,\hat R_T/M), otherwise restart from the previous state. (3) Compute from the mathematics: the underdamped proposal, Girsanov correction, Poisson randomization, and rejection decision. Estimate empirically: the envelope M, the maximal discrepancy bound lambda, the acceptance rate, gradient queries per accepted sample, and bias from time discretization. Start with bounded-gradient synthetic potentials so that lambda and M are known; then test a neural energy with gradient clipping to enforce a practical bound. (4) Cheap experiment: use 2D and 10D strongly convex quartic potentials and a small MLP energy, comparing corrected proposals against MALA, ULA, and ordinary underdamped Euler using the same number of full energy-gradient calls. Measure target mean and covariance error, KL or Renyi-divergence estimates, acceptance rate, and effective samples per gradient query. Success is lower discretization bias at equal compute, or at least a 2x larger stable integration step than ULA while preserving the same distributional error. First validate unbiasedness by fixing a path and averaging thousands of ratio-estimator repetitions.
Verification
Stage 1 · Toy mechanism gate: Passed ✓
Stage 2 · Mechanism transferred to benchmark: Confirmed ✓
Stage 2 · Practical benchmark result: Significantly worse ✗
Methodology: 8 paired seeds, permutation test (p<0.05) against a learning-rate-tuned baseline. How verification works
Stage 1 — Mechanism check agent confidence 9/10
Built an MVP with underdamped proposal integration, discretized Girsanov diagnostics, and the nonnegative Poisson quadratic-factor estimator. The core mechanism manifested: Poisson estimates were unbiased across lambda, variance matched the predicted scaling, and zero discrepancy produced an exactly-one estimator. The constant-drift Girsanov check also matched E[R]=1; the corrected MH analogue removed Gaussian ULA variance bias, but this is supporting evidence rather than a full exact path-rejection implementation.
- Agent confidence
- 9/10
- Baseline
- ULA Gaussian-target variance errors were 0.0520, 0.2538, 0.6637, 1.4866, and 8.9813 at steps 0.1, 0.4, 0.8, 1.2, and 1.8.
- Idea
- Poisson estimator exact mean was 0.571209. At lambda 1, 2, 4, 8, 16, and 32, observed/theoretical relative-variance ratios were 1.0019, 1.0025, 0.9991, 0.9966, 1.0039, and 1.0049. At g=0, mean=1 and std=0. Girsanov constant-discrepancy mean was 0.999752 with standard error 0.000637. The MH correction analogue produced variances 1.0020, 0.9990, 0.9983, 1.0000, and 1.0029 at the same steps.
Limitations: The full exact path-rejection sampler was not implemented: the stochastic-integral factor is only a discretized diagnostic, and no almost-sure finite rejection envelope M was constructed. The sampling comparison uses exact random-walk MH as a correction analogue rather than the complete unbiased underdamped rejection algorithm. No neural energy, high-dimensional target, FLOP-normalized benchmark, or GPU experiment was run.
How to run: python3 verify.py && /home/maxwelhelp/main/bin/python3 -c 'from sampler import constant_delta_check; print(constant_delta_check())'
Stage 2 — Benchmark vs. tuned baseline (arXiv:2608.05022)
Significantly WORSE than the tuned baseline (+386904.4%, p=0.0081, wins 0 / 8 paired seeds).
- Benchmark
- Bounded_energy_regression
- Model
- mlp_tiny
- Paired seeds
- 8
- Baseline mean
- 0.0012
- Idea mean
- 4.5421
- Effect (Δ)
- 4.541 (+386904.4%; negative = idea better)
- Wins
- 0 / 8 paired seeds
- p-value
- 0.0081 (permutation test, 20 000 shuffles)
- Smallest detectable effect
- n/a
- Mechanism
- Confirmed ✓
- Practical effect
- Hurts
- Baseline tuning
- swept over 3 configs
The full stochastic-integral Girsanov estimator and an almost-sure finite rejection envelope were not implemented. The custom track is a small synthetic bounded-energy regression task rather than a large real neural energy model; no built-in track was structurally appropriate for inference-time diffusion sampling.
How to run: python3 bench_run.py
Verdict computed by deterministic test code from paired-seed statistics — not by the language model.
Stage 2 — Benchmark latest Failed ✗
Agent confidence: 10/10
Implemented a custom bounded-energy regression track with a shared mlp_tiny architecture, Adam baseline training, and an underdamped stale-gradient proposal with Poisson quadratic-factor rejection. The trained-model mechanism signature was confirmed quantitatively: predicted acceptance factor 0.98468 versus observed 0.98115, ratio 0.99642. The idea significantly worsened test MSE (paired delta +4.54097, permutation p=0.0081), so it does not transfer as a useful training intervention; the MVP omits the full stochastic-integral Girsanov factor and exact rejection envelope.
- Baseline
- Best Adam lr=0.01; 8-seed mean test MSE 0.00117367, std 0.00021387.
- Idea
- Best corrected-proposal lr=0.003, noise=0.01; 8-seed mean test MSE 4.54214, std 7.34186; paired delta +4.54097, p=0.0081; idea worse significantly. Mechanism predicted factor 0.98468, observed acceptance 0.98115, ratio 0.99642, confirmed=true.
Benchmark result
Significantly WORSE than the tuned baseline (+386904.4%, p=0.0081, wins 0 / 8 paired seeds).
- Benchmark
- Bounded_energy_regression
- Model
- mlp_tiny
- Paired seeds
- 8
- Baseline mean
- 0.0012
- Idea mean
- 4.5421
- Effect (Δ)
- 4.541 (+386904.4%; negative = idea better)
- Wins
- 0 / 8 paired seeds
- p-value
- 0.0081 (permutation test, 20 000 shuffles)
- Smallest detectable effect
- n/a
- Mechanism
- Confirmed ✓
- Practical effect
- Hurts
- Baseline tuning
- swept over 3 configs
The full stochastic-integral Girsanov estimator and an almost-sure finite rejection envelope were not implemented. The custom track is a small synthetic bounded-energy regression task rather than a large real neural energy model; no built-in track was structurally appropriate for inference-time diffusion sampling.
How to run: python3 bench_run.py
Artifacts
- bench_report.json 3.2 KB View Raw
- bench_run.py 5.3 KB View Raw
- energy_track.py 0.7 KB View Raw
- report.md 1.9 KB View
- report_bench_2026-08-31T213902.md 4.3 KB View
- results.json 3.9 KB View Raw
- sampler.py 2.9 KB View Raw
- verify.py 3.4 KB View Raw