Reverse-Time Diffusion Processes for Discrete Time Linear and Nonlinear Systems with non-Gaussian Noise
arXiv:2607.23947
2026
Sampling
1 ideas extracted · analyzed Aug 30, 2026
What the math gives to ML
The paper develops a direct theory for reversing discrete-time stochastic systems without taking a continuous-time SDE limit. Its key transferable mechanism is that the exact reverse transition is generally state-dependent and non-Gaussian, even when the forward process is linear with Gaussian noise and the state distribution is non-Gaussian. The paper constructs reverse noise using conditional cumulative distribution functions and characterizes independence through characteristic functions. The strongest neural-network application is a discrete diffusion sampler using conditional transport or flow-based reverse kernels instead of restrictive Gaussian affine updates, with explicit tests based on conditional likelihood and residual independence.
Ideas from this paper
✓✓ Beats tuned baseline
2026
Replace the standard Gaussian affine reverse step with a conditional transport kernel learned from the forward transition. Given a noisy state x_{k+1}, the model predicts a full conditional distribution for x_k using a monotone conditional CDF or an autoregressive normalizing flow. This represents multimodal and state-dependent reverse transitions that cannot be captured by a single Gaussian mean and variance.
Useful8/10
Difficulty6/10
Novelty5/10