ML: Diffusion

Machine-learning ideas tagged Diffusion in the ML taxonomy of the Math2NN corpus.

△ Mechanism confirmed, baseline not beaten 2026

Finite-Batch OT Reflow for Straighter Flow Matching

Replace fixed random source-target pairings in flow matching by an outer loop that repeatedly solves exact OT assignments inside minibatches, trains the velocity field on the resulting pairings, and regenerates pairings from the learned flow. The mathematical guarantee is not global OT optimality: for batch size N, any limiting coupling is N-cyclically monotone and the squared endpoint cost cannot increase through the alternating updates. This should produce straighter trajectories and permit…

Useful8/10
Difficulty5/10
Novelty5/10
Paper: Limit Points of Reflow with Minibatch Optimal Transport arXiv:2608.07042
△ Mechanism confirmed, baseline not beaten 2026

Pole-residue latent diffusion decoder

Represent a one-dimensional sharp-feature signal by a small unordered set of complex singularities and residues instead of predicting all grid amplitudes. A transformer diffusion model predicts these tokens, and a differentiable meromorphic decoder evaluates the result directly at arbitrary coordinates, avoiding grid-specific interpolation and preserving discontinuity structure.

Useful8/10
Difficulty6/10
Novelty8/10
Paper: The Singularity Space: A Generative Diffusion Framework for Signal Representation arXiv:2607.10930
✗ Failed on benchmark 2026

Dual-Co-State Constrained Flow Sampler

Augment a flow-matching or diffusion sampler with a dual variable for each equality constraint and integrate the sample and dual variables as one coupled ODE. The learned generative velocity is corrected in the constraint-normal direction using the transpose Jacobian of the constraint, while the dual state accumulates residual violations; this replaces per-step projection or nonlinear optimization.

Useful8/10
Difficulty5/10
Novelty7/10
Paper: Constrained Flow Matching via Lagrangian Dual Flows arXiv:2607.04513
✓ Mechanism works 2026

Transport-Signature Density Decoder

Replace a pixelwise density decoder with a decoder that predicts coefficients of a transport potential relative to a fixed reference density. The reconstructed density is the pushforward of the reference measure through a differentiable transport map, so positivity and total mass are structural properties rather than learned penalties.

Useful8/10
Difficulty6/10
Novelty6/10
Paper: Structure-Preserving Reduced-Order Modeling via Low-Rank Transport Signatures arXiv:2607.01696
Audited (legacy) 2026

Asymptotic-preserving terminal completion

Replace the final sequence of diffusion-sampler steps below a positive switching noise scale a with a single analytic normal-mode completion map. Run the existing solver only on [a, sigma_max], then use the denoiser at scale a to extrapolate to the requested terminal floor epsilon. This prevents the step count from growing like log(sigma_max/epsilon) and should preserve the base solver's order when a is coupled to the discretization size.

Useful8/10
Difficulty4/10
Novelty6/10
Paper: Asymptotic Preservation and Uniform Accuracy of Diffusion and Flow-Matching Samplers arXiv:2607.04113
✓ Mechanism works 2026

Quotient-Aligned Flow Matching

Replace the arbitrary labelled target graph in each flow-matching pair by the node permutation that minimizes its Euclidean distance to the source graph. Construct the conditional interpolation and velocity target using this aligned representative, so the model learns transport in graph quotient space rather than wasting capacity on node-order mismatches.

Useful8/10
Difficulty5/10
Novelty6/10
Paper: Gromov-Monge Flow Matching for Equivariant Graph Generation arXiv:2608.26961
△ Mechanism confirmed, baseline not beaten 2026

Fisher-floor-corrected DSM

Replace raw denoising score-matching loss reports and weighting decisions with a floor-corrected loss that removes the conditional-target variance intrinsic to the corruption process. This makes models trained under different noise schedules comparable and can produce a lower-variance validation signal for checkpoint selection.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: The Loss Floor of Denoising Score Matching: Fisher Geometry from Schrödinger Bridges arXiv:2608.23916
△ Mechanism confirmed, baseline not beaten 2026

Dimension-Free Brenier Transport Layer

Build a neural transport layer by parameterizing a convex potential whose gradient maps a semi-log-concave latent distribution into a compact convex data domain. Use the paper's dimension-free Lipschitz certificate to set the layer's Jacobian scale, initialize the potential, and reject or regularize parameter updates that create excessive curvature. The goal is a bounded-output transport module that is less sensitive to latent dimension than diameter-based spectral heuristics.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Dimension-Free Lipschitz Bounds for Brenier Maps to Compactly Supported Log-Concave Targets arXiv:2608.15906
△ Mechanism confirmed, baseline not beaten 2026

OT Primitive Universal Flow

Parameterize a generative or density-evolving model as a composition of diffeomorphic optimal-mass-transport maps rather than unconstrained residual layers. Each layer transports one smooth positive density to another through a learned squared-distance OT map, while compositions provide a principled universal family for transformations connected to the identity.

Useful7/10
Difficulty7/10
Novelty6/10
Paper: The Holonomy of Optimal Mass Transport: The Smooth Case arXiv:2608.15585
✗ Mechanism failed 2026

Killed-Brownian diffusion score

Replace the standard Gaussian perturbation kernel in a diffusion model for nonnegative or half-space data with the exact Dirichlet heat kernel obtained by subtracting the reflected Gaussian. Train the score network against the analytic boundary-corrected score, preserving absorbing-boundary behavior without clipping, reflection heuristics, or an unconstrained coordinate transform.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: A Heat Kernel Expectation Approach to Boundary-Corrected Li--Yau Estimates for the Dirichlet Heat Equation arXiv:2608.12376
△ Mechanism confirmed, baseline not beaten 2026

Generalized-p Potential Flow Matching

Parameterize a continuous normalizing flow by a scalar potential and convert its gradient into the generalized p-optimal velocity field rather than using the usual quadratic-flow velocity. Train the field by matching velocities along straight source-target bridges, while retaining a terminal distribution loss so the flow remains useful when exact pointwise pairings are unavailable.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Potential Matching Optimal Transport: Continuous Normalizing Flows for Exact $p$-Wasserstein Dynamics arXiv:2608.05666
✗ Failed on benchmark 2026

Conditional Sinkhorn Adversarial Augmentation

Replace unconstrained input perturbations or generic distribution shifts with a conditional adversarial generator whose samples remain on a prescribed generator manifold. For each context x, maximize downstream loss over generator parameters within a debiased Sinkhorn-divergence radius of the nominal conditional generator, then minimize predictor loss against the resulting worst-case samples.

Useful7/10
Difficulty6/10
Novelty6/10
Paper: Generative Distributionally Robust Optimization arXiv:2607.24983
△ Mechanism confirmed, baseline not beaten 2026

OT-Sufficient Bottleneck Flow Matching

Replace a conventional regression bottleneck with an encoder whose representation is trained to preserve the conditional law of the target through conditional optimal transport. The encoder produces a low-dimensional z, while a conditional velocity field transports a fixed reference distribution into the observed target distribution given z; minimizing flow-matching error forces z to retain multimodality, conditional variance, and other distributional information.

Useful7/10
Difficulty6/10
Novelty6/10
Paper: Learning sufficient low-dimensional structures through conditional optimal transport arXiv:2607.18861
✗ Failed on benchmark 2026

Barrier-Guided Diffusion Sampling

Insert a differentiable discrete-time control-barrier correction into the reverse diffusion process for action or trajectory generation. At each denoising step, roll out the candidate trajectory through a learned or known dynamics model, compute the minimum collision margin against all obstacles, and modify the denoising output toward trajectories satisfying one-step barrier inequalities. Unlike rejection sampling, this uses barrier gradients to repair unsafe samples before the final action is…

Useful7/10
Difficulty5/10
Novelty5/10
Paper: D-SafeMPC: Diffusion-Driven Safe Model Predictive Control with Discrete-Time Control Barrier Functions arXiv:2607.10842
△ Mechanism confirmed, baseline not beaten 2026

Predictive Safe Projection for Flow-Matching Actions

Add a safety projection step to every or selected Euler updates of a flow-matching action sampler. Instead of correcting only the first action, differentiate a collision-risk function through the predicted full action chunk, construct local linear inequality constraints, and apply the smallest correction that makes the future trajectory safe.

Useful7/10
Difficulty5/10
Novelty5/10
Paper: Neuro-Symbolic Safety Guidance for Vision-Language-Action Models via Constrained Flow Matching arXiv:2607.01378
✗ Failed on benchmark 2026

Tangent-Cone Score Target

Use the Gaussian mass of the local inward tangent cone to construct an analytic score target for noisy points lying within O(\sigma) of a support boundary or corner. This prevents a score network from learning an incorrect full-manifold or Euclidean approximation in the region where diffusion sampling is most sensitive to support truncation.

Useful7/10
Difficulty6/10
Novelty6/10
Paper: Boundary-layer asymptotics for Gaussian-smoothed singular measures arXiv:2607.04514
✗ Mechanism failed 2026

Graph Quotient Minibatch Coupling

Use a minibatch-level transport plan that jointly decides which source graph should be paired with which target graph and how each target should be node-aligned. This can reduce total flow-matching displacement beyond per-example matching, producing shorter and less conflicting training trajectories without modifying the architecture.

Useful7/10
Difficulty7/10
Novelty7/10
Paper: Gromov-Monge Flow Matching for Equivariant Graph Generation arXiv:2608.26961
✗ Mechanism failed 2026

Mean-Preserving Diversity Regularizer

Train a conditional generator or set-valued predictor so that stochastic target refinements preserve the barycentric representation required by the source while allowing valid target-side diversity. The regularizer discourages collapse of multiple legitimate outcomes to one point without treating mean-preserving spread as semantic misalignment.

Useful7/10
Difficulty4/10
Novelty7/10
Paper: Barycentric Weak Inner-Product Gromov-Wasserstein arXiv:2608.25145
Unverified 2026

Information-flow DSM weighting

Use the corruption channel's information-loss rate to choose diffusion training weights rather than relying only on signal-to-noise heuristics. The conditional-score floor measures where the noisy observation still carries recoverable information about the clean data, allowing training compute to be concentrated on informative time regions.

Useful6/10
Difficulty6/10
Novelty6/10
Paper: The Loss Floor of Denoising Score Matching: Fisher Geometry from Schrödinger Bridges arXiv:2608.23916
Unverified 2026

Flux-Calibrated Mode Mixing

Use a learned dividing surface between two modes or basins of a neural energy model, and regulate Langevin or diffusion noise using the measured one-way crossing flux. The surface should be aligned with an estimated saddle direction and should reject immediate recrossings, so the controller responds to genuine mode transitions rather than local oscillations.

Useful6/10
Difficulty6/10
Novelty7/10
Paper: Flip rate prediction in the double pendulum arXiv:2608.20276
Unverified 2026

Directional Brenier Curvature Penalty

Add a theorem-guided regularizer to neural optimal-transport potentials that limits curvature separately in each direction according to the target support width. Unlike an isotropic Hessian penalty, it permits larger curvature along directions where the target is wide and enforces stronger smoothing along narrow directions, preserving anisotropic structure while controlling the transport map's Lipschitz constant.

Useful6/10
Difficulty4/10
Novelty8/10
Paper: Dimension-Free Lipschitz Bounds for Brenier Maps to Compactly Supported Log-Concave Targets arXiv:2608.15906
Unverified 2026

Hodge-factorized neural vector field

Parameterize a periodic neural vector field as the sum of a harmonic global drift, an exact gradient field, and a co-exact divergence-free field. This gives separate control over conservative attraction/repulsion, rotational transport, and domain-wide drift, potentially preventing one unconstrained MLP from entangling incompatible dynamics.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: The Hodge structure of Berry-phase transport: topology, geometry, and noise arXiv:2608.15789
Unverified 2026

Information-Projection Constraint Loss

Replace raw squared penalties on generated feature means with the paper's nested information-projection statistic. A model output distribution is projected once onto structural constraints and once onto structural-plus-test constraints; their KL divergence produces a sample-size-scaled loss and an approximate chi-square p-value. This should help when constraints have different variances or are strongly correlated, because the KL geometry automatically adapts to their covariance instead of…

Useful6/10
Difficulty6/10
Novelty6/10
Paper: The Boltzmann structure of sampling: Intrinsic $p$-value and its emergent closed-form expression arXiv:2608.14608
Unverified 2026

Cycle-Monotonicity Regularizer for Pairing and Velocity Training

Add a differentiable penalty to flow-matching batches that penalizes violations of the N-cyclic monotonicity inequalities implied by the minibatch OT reflow limit. The regularizer can either refine approximate Sinkhorn assignments or train the velocity field to preserve locally non-crossing endpoint geometry, providing a cheap alternative when exact assignment is too expensive.

Useful6/10
Difficulty4/10
Novelty6/10
Paper: Limit Points of Reflow with Minibatch Optimal Transport arXiv:2608.07042