Constrained Flow Matching via Lagrangian Dual Flows

arXiv:2607.04513 2026 Sampling 1 ideas extracted · analyzed Aug 30, 2026

What the math gives to ML

The paper transfers continuous-time primal-dual dynamics into flow-based generative sampling: a generated state and a Lagrange multiplier are integrated jointly rather than repeatedly projecting samples onto a nonlinear constraint manifold. The transferable asset is that constraint gradients enter the sample velocity through a dual co-state, while the dual state accumulates constraint violation, avoiding inner optimization, pseudoinverses, and explicit projection. A practical neural implementation is a constrained flow-matching sampler that augments the learned velocity field with a Jacobian-transpose dual correction and integrates the primal and dual ODEs with the same adaptive solver.

Ideas from this paper

Failed on benchmark 2026

Dual-Co-State Constrained Flow Sampler

Augment a flow-matching or diffusion sampler with a dual variable for each equality constraint and integrate the sample and dual variables as one coupled ODE. The learned generative velocity is corrected in the constraint-normal direction using the transpose Jacobian of the constraint, while the dual state accumulates residual violations; this replaces per-step projection or nonlinear optimization.

Useful8/10
Difficulty5/10
Novelty7/10
Paper: Constrained Flow Matching via Lagrangian Dual Flows arXiv:2607.04513