Asymptotic Preservation and Uniform Accuracy of Diffusion and Flow-Matching Samplers

arXiv:2607.04113 2026 Sampling 1 ideas extracted · analyzed Aug 29, 2026

What the math gives to ML

The paper identifies sampler quality as a property of the complete specification—numerical update, time grid, and terminal rule—rather than of the base ODE/SDE solver alone. Its key transferable mechanism is to stop integration at a positive noise scale and analytically complete the final segment, avoiding the logarithmically diverging number of steps required by bounded log-noise stepping. For diffusion models with manifold-like or rank-deficient data, the proposed terminal map exploits the denoiser's normal-mode behavior and has error proportional to the switching scale squared, so choosing the cutoff as a function of base resolution preserves the solver's convergence order. This gives a directly testable way to reduce function evaluations while maintaining endpoint accuracy.

Ideas from this paper

Audited (legacy) 2026

Asymptotic-preserving terminal completion

Replace the final sequence of diffusion-sampler steps below a positive switching noise scale a with a single analytic normal-mode completion map. Run the existing solver only on [a, sigma_max], then use the denoiser at scale a to extrapolate to the requested terminal floor epsilon. This prevents the step count from growing like log(sigma_max/epsilon) and should preserve the base solver's order when a is coupled to the discretization size.

Useful8/10
Difficulty4/10
Novelty6/10
Paper: Asymptotic Preservation and Uniform Accuracy of Diffusion and Flow-Matching Samplers arXiv:2607.04113