OT Primitive Universal Flow
Implementation & benchmark of arXiv:2608.15585 — The Holonomy of Optimal Mass Transport: The Smooth Case
Source paper: The Holonomy of Optimal Mass Transport: The Smooth Case arXiv:2608.15585 ⓘ · analyzed Sep 1, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Parameterize a generative or density-evolving model as a composition of diffeomorphic optimal-mass-transport maps rather than unconstrained residual layers. Each layer transports one smooth positive density to another through a learned squared-distance OT map, while compositions provide a principled universal family for transformations connected to the identity.
Formulas
Mathematical statement
For smooth positive probability measures nu_1 and nu_2 on a compact connected Riemannian manifold M, the paper considers the Monge problem minimizing one half of the expected squared geodesic displacement subject to the pushforward constraint phi_sharp nu_1=nu_2. McCann's theorem characterizes the almost-everywhere unique optimizer as phi_star^{1 to 2}=exp_g(grad phi_star^{1 to 2}), where exp_g is the Riemannian exponential map, grad is the Riemannian gradient, and phi_star is a one-half d-squared-convex potential. The paper states that, on a compact boundaryless Riemannian manifold, the group generated by diffeomorphic OMT maps is dense in the identity component of the diffeomorphism group. Thus maps T_j=exp_g(grad psi_j), with T_{j sharp} mu_j=mu_{j+1}, can serve as universal transformation primitives. The density-matching term below is an implementation adaptation rather than a theorem statement.
Implementation notes
Use this as an invertible generative-flow or manifold diffusion architecture. Choose a base smooth positive density mu_0 and L intermediate densities mu_1 through mu_L, represented by neural energies log mu_j(z)=-E_j(z)-log Z_j. Let each layer be T_j(z)=Exp_z(grad_g psi_j(z)), where psi_j is a scalar potential network and Exp_z is the manifold exponential map. For a minibatch z sampled from mu_j, compute v=grad_g psi_j(z), y=Exp_z(v), then optimize 0.5 times the mean squared geodesic distance d(z,y)^2 plus lambda times a distribution discrepancy between the y batch and samples from mu_{j+1}. Use sliced Wasserstein distance, kernel MMD, or a differentiable density-ratio discriminator for D; in Euclidean space replace Exp_z(v) by z+v or integrate the gradient field with an ODE solver. The paper supplies the squared-distance OT objective, exponential-gradient form, and density pushforward constraint; numerical exponential-map error, positivity of intermediate densities, and the number of useful layers must be tested empirically. First test a four-layer 2D flow on two-moons-to-Gaussian and Swiss-roll transport, comparing with RealNVP and an unconstrained neural ODE at equal function evaluations. Report negative log likelihood, sliced-Wasserstein distance, mode coverage, and inverse reconstruction error. Success is lower transport discrepancy and better mode coverage without loss of invertibility.
Verification
Stage 1 · Toy mechanism gate: Passed ✓
Stage 2 · Mechanism transferred to benchmark: Confirmed ✓
Stage 2 · Practical benchmark result: No measurable effect
Methodology: 8 paired seeds, permutation test (p<0.05) against a learning-rate-tuned baseline. How verification works
Stage 1 — Mechanism check agent confidence 6/10
Built a two-layer Euclidean OT-primitive flow using T(x)=x+grad psi(x), and compared it with an equally sized unconstrained residual flow on moons-to-Gaussian transport. The Gaussian pushforward check matched the predicted mean and covariance up to finite-sample error, and translation composition followed the exact 1/L cost law. The gradient-potential flow had slightly better MMD, sliced Wasserstein distance, and displacement cost while maintaining positive sampled Jacobians; this is a modest promising signal rather than a demonstrated major win.
- Agent confidence
- 6/10
- Baseline
- MMD 0.011374; sliced Wasserstein 0.202921; displacement cost 0.308493; positive-Jacobian fraction 1.0; determinant range 0.653–26.707
- Idea
- MMD 0.011317; sliced Wasserstein 0.200347; displacement cost 0.304945; positive-Jacobian fraction 1.0; determinant range 1.580–26.424; Gaussian mean/covariance errors 0.0121/0.0275; translation cost relative errors 0
Limitations: Only a tiny two-dimensional Euclidean experiment with two layers, one fixed seed, finite-sample MMD and sliced-Wasserstein metrics, and local Jacobian checks was tested. No manifold exponential map, likelihood/NLL, RealNVP, neural ODE, multi-seed statistics, inverse reconstruction under learned numerical inversion, or larger-scale universal approximation behavior was evaluated.
How to run: python3 ot_primitive_experiment.py
Stage 2 — Benchmark vs. tuned baseline (arXiv:2608.15585)
No significant difference vs. the tuned baseline (+0.1%, p=0.3996, wins 2 / 8 paired seeds).
- Benchmark
- Dynamics forecasting
- Model
- rnn_small
- Paired seeds
- 8
- Baseline mean
- 0.0005
- Idea mean
- 0.0005
- Effect (Δ)
- 0 (+0.1%; negative = idea better)
- Wins
- 2 / 8 paired seeds
- p-value
- 0.3996 (permutation test, 20 000 shuffles)
- Smallest detectable effect
- n/a
- Mechanism
- Confirmed ✓
- Practical effect
- No effect
- Baseline tuning
- swept over 3 configs
Only the registered built-in dynamics track was tested. No manifold exponential map, full density-to-density OT likelihood, RealNVP, neural ODE, image/sequence tracks, or larger models were evaluated. The benchmark proxy constrains the terminal-angle Jacobian rather than learning a complete density transport map.
How to run: python3 bench_ot_dynamics.py
Verdict computed by deterministic test code from paired-seed statistics — not by the language model.
Stage 2 — Benchmark latest Failed ✗
Agent confidence: 9/10
Implemented the OT-inspired intervention on the registered dynamics track with the shared rnn_small architecture, adding monotonicity and displacement penalties to MSE. The idea was slightly worse than baseline and not significant: paired delta_mean was +2.777924237307161e-7 and permutation p=0.39955. The trained-model positive-Jacobian signature was confirmed, but it did not yield a task-metric win.
- Baseline
- 8-seed mean test MSE 0.0005214317206991836, std 0.000071050613588211; best lr=0.006
- Idea
- 8-seed mean test MSE 0.0005217095131229144, std 0.000071353424012946; best lr=0.006; 2/8 paired wins; delta_mean +2.777924237307161e-7; p=0.39955
Benchmark result
No significant difference vs. the tuned baseline (+0.1%, p=0.3996, wins 2 / 8 paired seeds).
- Benchmark
- Dynamics forecasting
- Model
- rnn_small
- Paired seeds
- 8
- Baseline mean
- 0.0005
- Idea mean
- 0.0005
- Effect (Δ)
- 0 (+0.1%; negative = idea better)
- Wins
- 2 / 8 paired seeds
- p-value
- 0.3996 (permutation test, 20 000 shuffles)
- Smallest detectable effect
- n/a
- Mechanism
- Confirmed ✓
- Practical effect
- No effect
- Baseline tuning
- swept over 3 configs
Only the registered built-in dynamics track was tested. No manifold exponential map, full density-to-density OT likelihood, RealNVP, neural ODE, image/sequence tracks, or larger models were evaluated. The benchmark proxy constrains the terminal-angle Jacobian rather than learning a complete density transport map.
How to run: python3 bench_ot_dynamics.py
Artifacts
- bench_ot_dynamics.py 6.1 KB View Raw
- bench_report.json 5.5 KB View Raw
- ot_primitive_experiment.py 6.1 KB View Raw
- report.md 1.6 KB View
- report_bench_2026-09-02T162717.md 4.6 KB View
- results.json 1.5 KB View Raw