ML: Diffusion sampling

Machine-learning ideas tagged Diffusion sampling in the ML taxonomy of the Math2NN corpus.

△ Mechanism confirmed, baseline not beaten 2026

Finite-Batch OT Reflow for Straighter Flow Matching

Replace fixed random source-target pairings in flow matching by an outer loop that repeatedly solves exact OT assignments inside minibatches, trains the velocity field on the resulting pairings, and regenerates pairings from the learned flow. The mathematical guarantee is not global OT optimality: for batch size N, any limiting coupling is N-cyclically monotone and the squared endpoint cost cannot increase through the alternating updates. This should produce straighter trajectories and permit…

Useful8/10
Difficulty5/10
Novelty5/10
Paper: Limit Points of Reflow with Minibatch Optimal Transport arXiv:2608.07042
△ Mechanism confirmed, baseline not beaten 2026

Barrier-Corrected Flow Sampler

Modify the flow-matching denoising velocity at every integration step by the smallest Euclidean correction that satisfies a control-barrier inequality on the entire generated action chunk. Aggregate waypoint and constraint barriers with a smooth minimum, so the sampler remains differentiable and can enforce safety without retraining the action model or applying a discontinuous final-action projection.

Useful8/10
Difficulty5/10
Novelty6/10
Paper: Safe Vision Language Action Models via Barrier Enhanced Flow Matching arXiv:2607.29569
△ Mechanism confirmed, baseline not beaten 2026

Pole-residue latent diffusion decoder

Represent a one-dimensional sharp-feature signal by a small unordered set of complex singularities and residues instead of predicting all grid amplitudes. A transformer diffusion model predicts these tokens, and a differentiable meromorphic decoder evaluates the result directly at arbitrary coordinates, avoiding grid-specific interpolation and preserving discontinuity structure.

Useful8/10
Difficulty6/10
Novelty8/10
Paper: The Singularity Space: A Generative Diffusion Framework for Signal Representation arXiv:2607.10930
✗ Failed on benchmark 2026

Dual-Co-State Constrained Flow Sampler

Augment a flow-matching or diffusion sampler with a dual variable for each equality constraint and integrate the sample and dual variables as one coupled ODE. The learned generative velocity is corrected in the constraint-normal direction using the transpose Jacobian of the constraint, while the dual state accumulates residual violations; this replaces per-step projection or nonlinear optimization.

Useful8/10
Difficulty5/10
Novelty7/10
Paper: Constrained Flow Matching via Lagrangian Dual Flows arXiv:2607.04513
Audited (legacy) 2026

Asymptotic-preserving terminal completion

Replace the final sequence of diffusion-sampler steps below a positive switching noise scale a with a single analytic normal-mode completion map. Run the existing solver only on [a, sigma_max], then use the denoiser at scale a to extrapolate to the requested terminal floor epsilon. This prevents the step count from growing like log(sigma_max/epsilon) and should preserve the base solver's order when a is coupled to the discretization size.

Useful8/10
Difficulty4/10
Novelty6/10
Paper: Asymptotic Preservation and Uniform Accuracy of Diffusion and Flow-Matching Samplers arXiv:2607.04113
△ Mechanism confirmed, baseline not beaten 2026

State-Dependent Temperature Langevin

Replace isotropic Langevin noise in latent or energy-based neural sampling with a smooth position-dependent temperature \(\sigma(x)\geq 1\). Use the divergence correction associated with the diffusion matrix so that increasing exploration in the tails does not change the desired target distribution. This should reduce metastability and improve effective samples per gradient evaluation on heavy-tailed latent posteriors.

Useful7/10
Difficulty4/10
Novelty6/10
Paper: Hypocoercivity of Tempered Bouncy Particle Samplers for Heavy-Tailed Targets arXiv:2608.29657
△ Mechanism confirmed, baseline not beaten 2026

Fisher-Geodesic Finite-Step Annealing

Replace uniformly spaced diffusion or energy annealing schedules by a finite sequence of quench-relax stages whose intermediary distributions are approximately equally spaced in Fisher-Rao distance. Each stage abruptly changes the model energy or noise level and then runs a short relaxation phase; the schedule concentrates stages where the distribution changes most sharply. This should reduce nonequilibrium mismatch at a fixed number of sampler evaluations and avoid large distributional jumps…

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Finite relaxation protocols with minimal dissipation arXiv:2608.25207
✗ Mechanism failed 2026

Killed-Brownian diffusion score

Replace the standard Gaussian perturbation kernel in a diffusion model for nonnegative or half-space data with the exact Dirichlet heat kernel obtained by subtracting the reflected Gaussian. Train the score network against the analytic boundary-corrected score, preserving absorbing-boundary behavior without clipping, reflection heuristics, or an unconstrained coordinate transform.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: A Heat Kernel Expectation Approach to Boundary-Corrected Li--Yau Estimates for the Dirichlet Heat Equation arXiv:2608.12376
△ Mechanism confirmed, baseline not beaten 2026

OT-Sufficient Bottleneck Flow Matching

Replace a conventional regression bottleneck with an encoder whose representation is trained to preserve the conditional law of the target through conditional optimal transport. The encoder produces a low-dimensional z, while a conditional velocity field transports a fixed reference distribution into the observed target distribution given z; minimizing flow-matching error forces z to retain multimodality, conditional variance, and other distributional information.

Useful7/10
Difficulty6/10
Novelty6/10
Paper: Learning sufficient low-dimensional structures through conditional optimal transport arXiv:2607.18861
✗ Failed on benchmark 2026

Barrier-Guided Diffusion Sampling

Insert a differentiable discrete-time control-barrier correction into the reverse diffusion process for action or trajectory generation. At each denoising step, roll out the candidate trajectory through a learned or known dynamics model, compute the minimum collision margin against all obstacles, and modify the denoising output toward trajectories satisfying one-step barrier inequalities. Unlike rejection sampling, this uses barrier gradients to repair unsafe samples before the final action is…

Useful7/10
Difficulty5/10
Novelty5/10
Paper: D-SafeMPC: Diffusion-Driven Safe Model Predictive Control with Discrete-Time Control Barrier Functions arXiv:2607.10842
△ Mechanism confirmed, baseline not beaten 2026

Predictive Safe Projection for Flow-Matching Actions

Add a safety projection step to every or selected Euler updates of a flow-matching action sampler. Instead of correcting only the first action, differentiate a collision-risk function through the predicted full action chunk, construct local linear inequality constraints, and apply the smallest correction that makes the future trajectory safe.

Useful7/10
Difficulty5/10
Novelty5/10
Paper: Neuro-Symbolic Safety Guidance for Vision-Language-Action Models via Constrained Flow Matching arXiv:2607.01378
✗ Failed on benchmark 2026

Tangent-Cone Score Target

Use the Gaussian mass of the local inward tangent cone to construct an analytic score target for noisy points lying within O(\sigma) of a support boundary or corner. This prevents a score network from learning an incorrect full-manifold or Euclidean approximation in the region where diffusion sampling is most sensitive to support truncation.

Useful7/10
Difficulty6/10
Novelty6/10
Paper: Boundary-layer asymptotics for Gaussian-smoothed singular measures arXiv:2607.04514
Unverified 2026

Lipschitz-Perturbation Brenier Latent Adapter

Replace an unconstrained latent-to-data map in a small generative model with a learned Brenier map T equal to the gradient of a convex potential, transporting a Gaussian latent distribution toward a density proportional to exp(-B) times the Gaussian density. Constrain B to be globally L-Lipschitz and use the resulting dimension-free Jacobian ceiling as an adaptive stability target. This should reduce pathological local expansion without requiring B itself to be convex or its Hessian to be…

Useful6/10
Difficulty7/10
Novelty6/10
Paper: Caffarelli Estimates under Lipschitz Perturbations arXiv:2609.04052
Unverified 2026

Flux-Calibrated Mode Mixing

Use a learned dividing surface between two modes or basins of a neural energy model, and regulate Langevin or diffusion noise using the measured one-way crossing flux. The surface should be aligned with an estimated saddle direction and should reject immediate recrossings, so the controller responds to genuine mode transitions rather than local oscillations.

Useful6/10
Difficulty6/10
Novelty7/10
Paper: Flip rate prediction in the double pendulum arXiv:2608.20276
Unverified 2026

Hodge-factorized neural vector field

Parameterize a periodic neural vector field as the sum of a harmonic global drift, an exact gradient field, and a co-exact divergence-free field. This gives separate control over conservative attraction/repulsion, rotational transport, and domain-wide drift, potentially preventing one unconstrained MLP from entangling incompatible dynamics.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: The Hodge structure of Berry-phase transport: topology, geometry, and noise arXiv:2608.15789
Unverified 2026

Tangential probability-flow sampler

Modify the probability-flow ODE of a reflected diffusion so that its learned velocity is tangent to the constraint boundary. Use an exact tangent projection for box or sphere constraints, or a smooth boundary-collar correction for general domains, and train with an additional penalty on the predicted normal flux. This prevents numerical trajectories from leaving the domain and targets the no-flux structure directly instead of clipping samples after each solver step.

Useful6/10
Difficulty4/10
Novelty5/10
Paper: Reflected diffusion, no-flux continuity equations and confined Lagrangian flows in bounded domains arXiv:2607.28344
Unverified 2026

Tangential Landau Pairwise Noise

Replace isotropic particle noise or unconstrained pairwise graph updates by antisymmetric, relative-velocity-tangential noise. For each pair of particles, the update lies approximately in the hyperplane orthogonal to their relative displacement and has variance determined by a regularized soft-potential kernel. This should produce stochastic exploration while reducing center-of-mass drift and violations of kinetic-energy-like invariants.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: The Homogeneous Landau Equation with Regularised Thermal Noise arXiv:2607.22329
△ Mechanism confirmed, baseline not beaten 2026

Nonreversible latent instanton sampler

Represent a rare transition in a neural latent space by a controlled path whose drift is optimized directly, instead of obtaining it by reversing the relaxation dynamics. Learn a state-dependent mobility or diffusion matrix so that the sampler allocates noise and control effort according to the local stochastic geometry. This should improve generation of low-probability transitions in nonequilibrium world models and reduce the number of failed trajectories.

Useful6/10
Difficulty6/10
Novelty5/10
Paper: Nucleation and time-reversal symmetry breaking in nonconserved scalar field theories arXiv:2607.05194
✗ Mechanism failed 2026

Phase-only quantum generative flow

Replace a time-dependent neural velocity field with a neural initial phase whose evolution is determined by the Madelung equations. Particles are sampled once from a reference density and then moved deterministically along the characteristic velocity field, while the quantum potential supplies a density-dependent smoothing and curvature correction.

Useful6/10
Difficulty7/10
Novelty6/10
Paper: QH-GEM: Quantum-Hydrodynamic Generative Modeling arXiv:2608.27216
Unverified 2026

Robin-Boundary Diffusion Sampler

Train a score-based diffusion model on a domain with partially reactive constraints, replacing hard rejection or large boundary penalties by a Robin boundary condition. Samples approaching the constraint boundary acquire a hazard proportional to accumulated boundary local time, giving a continuous interpolation between reflection and absorption.

Useful5/10
Difficulty6/10
Novelty8/10
Paper: Survival in a partially reactive wedge arXiv:2609.02665
Unverified 2026

Spectral-Gap Convex Perturbation Sampler

Replace rejection sampling or coordinate random walks for adversarial and augmentation perturbations in a convex feasible set with Hit-and-Run: choose a random direction through the current perturbation, compute the exact feasible chord, and sample uniformly on that chord. The paper's spectral-gap result predicts faster global exploration when the perturbation polytope is rounded or whitened, while preserving feasibility at every step.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Spectral Gaps of Hit-and-Run and Coordinate Hit-and-Run arXiv:2608.16878
Unverified 2026

Warm-start hit-and-run augmentation

Replace rejection sampling or short biased random walks inside a convex latent constraint set with hit-and-run. At each step, choose a uniformly random direction and sample uniformly along the entire chord through the current point; the paper's mixing result predicts that a chain initialized by a crude approximate sampler becomes close to uniform with only logarithmic dependence on initialization bias and target error.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Hit-and-Run Mixes as Fast as the Ball Walk arXiv:2608.13487