Zeroth-Order Langevin Monte Carlo via SPSA under Noisy Function Measurements

arXiv:2608.07837 2026 Sampling 1 ideas extracted · analyzed Sep 1, 2026

What the math gives to ML

The paper provides a practical two-query estimator for Langevin drift when the target potential can only be evaluated through noisy function values. Its transferable asset is the SPSA perturbation identity: a full-dimensional gradient estimate costs only two oracle calls, while paired evaluations reduce the effect of additive measurement noise. The direct neural-network use is sampling latent variables or parameters from an energy-based posterior whose energy is supplied by a simulator, black-box scorer, or nondifferentiable evaluation pipeline. Diminishing perturbation and step-size schedules are useful when stable long-run sampling matters more than rapid transient exploration.

Ideas from this paper

Unverified 2026

Two-query SPSA Langevin sampler for black-box neural energies

Replace backpropagated gradients in a Langevin sampler with a simultaneous-perturbation estimate obtained from two noisy evaluations of a neural energy or simulator-defined negative log-density. This enables posterior or latent-space sampling when the energy contains nondifferentiable code, stochastic simulation, discrete operations, or an inaccessible neural-network gradient.

Useful6/10
Difficulty5/10
Novelty8/10
Paper: Zeroth-Order Langevin Monte Carlo via SPSA under Noisy Function Measurements arXiv:2608.07837