Zeroth-Order Langevin Monte Carlo via SPSA under Noisy Function Measurements
arXiv:2608.07837
2026
Sampling
1 ideas extracted · analyzed Sep 1, 2026
What the math gives to ML
The paper provides a practical two-query estimator for Langevin drift when the target potential can only be evaluated through noisy function values. Its transferable asset is the SPSA perturbation identity: a full-dimensional gradient estimate costs only two oracle calls, while paired evaluations reduce the effect of additive measurement noise. The direct neural-network use is sampling latent variables or parameters from an energy-based posterior whose energy is supplied by a simulator, black-box scorer, or nondifferentiable evaluation pipeline. Diminishing perturbation and step-size schedules are useful when stable long-run sampling matters more than rapid transient exploration.
Ideas from this paper
Unverified
2026
Replace backpropagated gradients in a Langevin sampler with a simultaneous-perturbation estimate obtained from two noisy evaluations of a neural energy or simulator-defined negative log-density. This enables posterior or latent-space sampling when the energy contains nondifferentiable code, stochastic simulation, discrete operations, or an inaccessible neural-network gradient.
Useful6/10
Difficulty5/10
Novelty8/10