ML: Diffusion sampling

Machine-learning ideas tagged Diffusion sampling in the ML taxonomy of the Math2NN corpus.

△ Mechanism confirmed, baseline not beaten 2026

Gradient-Projected Rectified Flow

Replace the unconstrained rectified-flow velocity predictor with the gradient of a learned scalar potential. At every rectification round, fit the potential by weighted least squares to the current displacement field, then integrate the resulting conservative velocity from the source distribution to the target distribution. The gradient restriction is intended to eliminate non-transport rotational motion and improve convergence toward the quadratic optimal-transport coupling.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Computational and Statistical Guarantees of the \textit{c}-Rectified flow arXiv:2608.02487
✓✓ Beats tuned baseline 2026

Entropy-production adaptive diffusion sampler

Use an entropy-production-inspired local discrepancy between full-step and coupled half-step reverse diffusion trajectories as an adaptive error signal. The sampler takes large Euler steps where the estimated marginal mismatch is small and refines only where score variation or reverse-flow mismatch is high, targeting terminal KL rather than path-space error.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: A Unified Kullback--Leibler Divergence Analysis of Generative Diffusion Models via Entropy Production Rate arXiv:2608.02406
✗ Failed on benchmark 2026

Gaussian-compensated Levy neural noise

Replace the unresolved small jumps of an infinite-activity stable Levy noise source in a neural SDE or stochastic optimizer with one Gaussian increment whose variance equals the discarded jump variance. Simulate only jumps above the cutoff exactly or by Poisson sampling, retaining the large-jump distribution while obtaining the paper's O(\varepsilon) Wasserstein error instead of the naive O(\varepsilon^{1-\alpha/2}) error.

Useful7/10
Difficulty5/10
Novelty8/10
Paper: A spectral-compensated scheme for space-parameter Poisson noise functionals: error bounds and complexity estimates arXiv:2607.27657
✗ Failed on benchmark 2026

Spectral-gap adaptive polynomial filtering

Use the paper's sharp sK approximately equal to 1 phase transition to choose between conservative Fejer averaging and higher-order polynomial filtering. When the local fixed-point spectrum is separated from eigenvalue 1, use a Jackson-type filter; near the critical regime, use the safe Fejer filter instead of unrestricted Anderson extrapolation.

Useful7/10
Difficulty7/10
Novelty7/10
Paper: Anderson acceleration of the proximal point method: the exact adaptive minimax, a spectral phase transition, and optimal safeguarding arXiv:2607.24643
△ Mechanism confirmed, baseline not beaten 2026

Padé-Hermite Neural ODE Integrator

Replace explicit Runge-Kutta integration in a neural ODE or probability-flow ODE sampler with the anchored two-derivative method. Each stage uses both the neural vector field and its total time derivative, while the coupled implicit solve is designed so the accepted map has an L-stable Padé stability function. The method should allow larger steps on stiff trajectories without amplifying fast decaying modes.

Useful7/10
Difficulty7/10
Novelty7/10
Paper: Arbitrary-Order Padé-Closed Anchored Two-Derivative Time Discretizations: $s$ Active Stages, Order $2s$, and $L$-Stability arXiv:2607.24592
✗ Failed on benchmark 2026

First-Hit Interacting Optimizer

Replace a single optimizer trajectory by N parameter particles and optimize the time until the first particle reaches a target loss or reward threshold. Use distinct interaction regimes: bounded normalized interactions should provide only the usual logarithmic extreme-search improvement, whereas unnormalized coherent force accumulation and stochastic pairwise kicks should produce distinct 1/N and 1/(N ln N) first-hit laws.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Extreme First-Passage Time of Many Interacting Particles arXiv:2607.22528
✓✓ Beats tuned baseline 2026

Context-free denoiser with analytic quadratic score injection

Train one denoiser only for the nonquadratic residual distribution, then modify the diffusion sampler using an analytically computed quadratic Gaussian context. Changing $K$ at inference changes the target distribution without retraining the denoiser, enabling transfer across temperatures, masses, coupling strengths, and boundary conditions whenever those changes remain quadratic.

Useful7/10
Difficulty6/10
Novelty6/10
Paper: Nuclear Quantum Effects as a Denoising Problem arXiv:2607.19680
✗ Failed on benchmark 2026

Tempered-Stable Volatility Clock for Sequence Diffusion

Replace independent Gaussian diffusion noise across sequence positions with a positive, persistent variance chain and conditionally Gaussian perturbations. This gives the denoiser exposure to heavy tails and volatility clustering without requiring a more expressive neural architecture; keep the denoiser blind to the realized variance when the goal is for generated samples to retain this structure.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Denoising Subordinated Probabilistic Models: Diffusion with a Tempered-Stable Volatility Clock, and What the Noise Mechanism Actually Controls arXiv:2607.19218
△ Mechanism confirmed, baseline not beaten 2026

OT-Sufficient Bottleneck Flow Matching

Replace a conventional regression bottleneck with an encoder whose representation is trained to preserve the conditional law of the target through conditional optimal transport. The encoder produces a low-dimensional z, while a conditional velocity field transports a fixed reference distribution into the observed target distribution given z; minimizing flow-matching error forces z to retain multimodality, conditional variance, and other distributional information.

Useful7/10
Difficulty6/10
Novelty6/10
Paper: Learning sufficient low-dimensional structures through conditional optimal transport arXiv:2607.18861
△ Mechanism confirmed, baseline not beaten 2026

PDE Sinkhorn with asymmetric geometric boundaries

Build a Schrödinger-bridge solver that represents the two Sinkhorn scaling factors as solutions of forward and backward Kolmogorov PDEs, rather than requiring explicit transition-density evaluation. Enforce an oblique Neumann condition on the backward factor and a normal no-flux condition on the forward factor, allowing degenerate diffusion and hard domain boundaries to be handled directly.

Useful7/10
Difficulty7/10
Novelty8/10
Paper: Reflected Schrodinger Bridge Problem over Sub-Riemannian Manifold arXiv:2607.17904
✓✓ Beats tuned baseline 2026

Exponential-Map Stochastic Residual Layer

Replace additive Euclidean stochastic residual updates with tangent-space updates followed by the Riemannian exponential map. A neural drift network produces a tangent vector, while noise is sampled using the metric induced by the inverse diffusion tensor; the resulting layer is invariant to smooth coordinate reparameterizations up to numerical integration error.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: On the use of the Belopol'skaya-Daletskii representation of a diffusion on a Riemann manifold to construct path integrals arXiv:2607.17871
△ Mechanism confirmed, baseline not beaten 2026

Work-trained neural Hamiltonian bridge

Train a neural finite-time Hamiltonian-style path from an easy base density to a Boltzmann target by minimizing its generalized nonequilibrium work. The work is a path-space log-density ratio, so its mean is a forward KL divergence up to a constant and the endpoint marginal mismatch is bounded by the same quantity. Unlike an uncorrected neural sampler, this produces a global proposal whose bias and overlap can be measured quantitatively.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Neural Non-Equilibrium Hamiltonian Monte Carlo for Corrected Boltzmann Sampling arXiv:2607.15682
△ Mechanism confirmed, baseline not beaten 2026

Solver-Trajectory Flow Matching

Train a conditional flow-matching model against a sequence of intermediate states generated by an expensive optimisation or refinement process, rather than only matching noise to the final sample. The resulting vector field should require fewer inference steps and remain closer to the solver's feasible trajectory than endpoint-only flow matching.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: Trajectory-Aware Flow Matching for Topology Optimisation arXiv:2607.14652
✗ Failed on benchmark 2026

Nonlinear Noise-Tightening Drift

Replace a linear restoring drift in score-based sampling, latent dynamics, or stochastic regularization with a state-dependent nonlinear restoring term that is at least as contractive globally and more contractive away from the origin. This should reduce stationary variance without changing the worst-case local contraction certificate.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Wasserstein Stability of Contracting Flows: Effective Rates, Euler Self-Correction, and Noise Tightening arXiv:2607.14291
△ Mechanism confirmed, baseline not beaten 2026

Self-Correcting Euler Horizon Rule

Use contraction-aware integration rather than assuming that Euler discretization error grows monotonically with sampling time. For a contracting neural ODE, permit a transient error peak but choose the step size and terminal horizon using the predicted peak time and subsequent exponential decay.

Useful7/10
Difficulty4/10
Novelty6/10
Paper: Wasserstein Stability of Contracting Flows: Effective Rates, Euler Self-Correction, and Noise Tightening arXiv:2607.14291
✓✓ Beats tuned baseline 2026

Profile-Preserving Multislice Noise

For an input with exactly $\alpha_a$ occurrences of each state $a\in\{0,\ldots,n-1\}$, corrupt it by repeatedly swapping two positions with different states instead of independently resampling tokens. This defines a Markov process on the connected fixed-profile multislice, preserving global composition exactly and avoiding the distribution shift caused by ordinary categorical masking.

Useful7/10
Difficulty3/10
Novelty7/10
Paper: The Action of the Lie Algebra $\mathfrak{sl}_n$ on Colored Graphs and Multicolored Johnson Graphs arXiv:2607.13208
✗ Failed on benchmark 2026

Barrier-Guided Diffusion Sampling

Insert a differentiable discrete-time control-barrier correction into the reverse diffusion process for action or trajectory generation. At each denoising step, roll out the candidate trajectory through a learned or known dynamics model, compute the minimum collision margin against all obstacles, and modify the denoising output toward trajectories satisfying one-step barrier inequalities. Unlike rejection sampling, this uses barrier gradients to repair unsafe samples before the final action is…

Useful7/10
Difficulty5/10
Novelty5/10
Paper: D-SafeMPC: Diffusion-Driven Safe Model Predictive Control with Discrete-Time Control Barrier Functions arXiv:2607.10842
✓✓ Beats tuned baseline 2026

Equal-information diffusion time grid

Replace uniformly spaced diffusion timesteps with a grid whose intervals contribute equal area under the local information-loss curve. The sampler then takes smaller steps in noise regions where the denoiser contributes most to likelihood and larger steps in low-information regions.

Useful7/10
Difficulty4/10
Novelty7/10
Paper: Conservation Laws for Diffusion Models arXiv:2607.10067
✗ Failed on benchmark 2026

Sample-adaptive Lipschitz budget for diffusion policies

Treat the diffusion drift Lipschitz constant K as an explicit capacity knob and tune it from the amount of trajectory data. Enforce K directly with spectral normalization or a product-of-layer-norm constraint, then select among a small set of budgets using held-out return or behavior-cloning likelihood rather than allowing unconstrained networks to acquire an uncontrolled effective Lipschitz constant.

Useful7/10
Difficulty4/10
Novelty5/10
Paper: Expressivity and Statistical Trade-offs in Diffusion Policy Learning arXiv:2607.07967
△ Mechanism confirmed, baseline not beaten 2026

Residual-Relaxed Trajectory Sampling

Make a diffusion policy or MPPI-style action-sequence sampler less committed to model-predicted cost rankings when the learned world model is inaccurate. Estimate a normalized prediction residual or ensemble disagreement, increase the sampling temperature with that residual, and retain ordinary low-temperature exploitation when the model is accurate.

Useful7/10
Difficulty4/10
Novelty6/10
Paper: Residual-Conservative Model Predictive Path Integral Control arXiv:2607.06950
△ Mechanism confirmed, baseline not beaten 2026

Predictive Safe Projection for Flow-Matching Actions

Add a safety projection step to every or selected Euler updates of a flow-matching action sampler. Instead of correcting only the first action, differentiate a collision-risk function through the predicted full action chunk, construct local linear inequality constraints, and apply the smallest correction that makes the future trajectory safe.

Useful7/10
Difficulty5/10
Novelty5/10
Paper: Neuro-Symbolic Safety Guidance for Vision-Language-Action Models via Constrained Flow Matching arXiv:2607.01378
✗ Failed on benchmark 2026

Tangent-Cone Score Target

Use the Gaussian mass of the local inward tangent cone to construct an analytic score target for noisy points lying within O(\sigma) of a support boundary or corner. This prevents a score network from learning an incorrect full-manifold or Euclidean approximation in the region where diffusion sampling is most sensitive to support truncation.

Useful7/10
Difficulty6/10
Novelty6/10
Paper: Boundary-layer asymptotics for Gaussian-smoothed singular measures arXiv:2607.04514
✓ Mechanism works 2026

Conditional-TC Reveal Scheduler

Replace confidence-only masked diffusion decoding with an adaptive scheduler that chooses batches whose unrevealed tokens have low conditional total correlation given the already revealed context. The scheduler should preserve large parallel batches when token predictions are conditionally independent, but split highly dependent tokens into separate rounds to reduce forward-KL error.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Conditional Total Correlation and the Serial Depth of Adaptive Parallel Sampling arXiv:2608.25505
✗ Mechanism failed 2026

Dependence-Adaptive Timestep Controller

Use an online estimate of the target distribution's remaining coordinate dependence to choose diffusion step sizes instead of using a uniform timestep grid. Take large jumps when the current state is nearly coordinate-factorized and shorten the step when the denoiser detects strong cross-coordinate dependence, targeting the paper's dependence-adaptive discretization scaling.

Useful7/10
Difficulty4/10
Novelty8/10
Paper: Provably adaptive sampling with uniform and remasking discrete diffusion models arXiv:2608.23554