Constrained Flow Matching via Lagrangian Dual Flows
arXiv:2607.04513
2026
Sampling
1 ideas extracted · analyzed Aug 30, 2026
What the math gives to ML
The paper transfers continuous-time primal-dual dynamics into flow-based generative sampling: a generated state and a Lagrange multiplier are integrated jointly rather than repeatedly projecting samples onto a nonlinear constraint manifold. The transferable asset is that constraint gradients enter the sample velocity through a dual co-state, while the dual state accumulates constraint violation, avoiding inner optimization, pseudoinverses, and explicit projection. A practical neural implementation is a constrained flow-matching sampler that augments the learned velocity field with a Jacobian-transpose dual correction and integrates the primal and dual ODEs with the same adaptive solver.
Ideas from this paper
✗ Failed on benchmark
2026
Augment a flow-matching or diffusion sampler with a dual variable for each equality constraint and integrate the sample and dual variables as one coupled ODE. The learned generative velocity is corrected in the constraint-normal direction using the transpose Jacobian of the constraint, while the dual state accumulates residual violations; this replaces per-step projection or nonlinear optimization.
Useful8/10
Difficulty5/10
Novelty7/10