Monotone transport-map latent space
Implementation & benchmark of arXiv:2607.17066 — Reduced Order Modeling of One-Dimensional Conservative PDEs via the Cumulative Distribution Transform
Source paper: Reduced Order Modeling of One-Dimensional Conservative PDEs via the Cumulative Distribution Transform arXiv:2607.17066 ⓘ · analyzed Aug 30, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Represent every nonnegative equal-mass one-dimensional state by its CDT quantile map relative to a fixed reference density, then train the neural dynamics model in this transformed space rather than on Eulerian grid values. The latent manifold for translations and transport-dominated evolution is substantially flatter: linear transport lies in the span of the initial transformed state and the constant function, while nonlinear conservative dynamics have algebraic approximation error bounds.
Formulas
Mathematical statement
For a nonnegative probability density u on an interval I, define its cumulative distribution function by F_u(x)=\int_{I\cap(-\infty,x]}u(s)\,ds and its quantile by F_u^\dagger(p)=\inf\{x\in I:F_u(x)\geq p\}, p\in(0,1). Fix a reference density r with CDF F_r. The CDT representation is the monotone transport map \widehat u(x)=F_u^\dagger(F_r(x)); it maps reference mass at x to the quantile location of u with the same cumulative probability. For equal-mass densities, the one-dimensional quadratic Wasserstein distance is represented by an L2 distance between quantile functions, W_2^2(u,v)=\int_0^1|F_u^\dagger(p)-F_v^\dagger(p)|^2\,dp, or equivalently, after sampling p=F_r(x), by a weighted L2 distance between CDT maps. For a translated density u(x,t)=u_0(x-ct), the transformed map is \widehat u(x,t)=\widehat u_0(x)+ct, so the entire trajectory lies in \operatorname{span}\{\widehat u_0,1\}. The paper also gives robust O(n^{-1}) Kolmogorov-width decay for nonlinear conservative transport and sharper O(n^{-2}) decay before shocks; n is the number of linear modes. The transferable property is that transport variation becomes low-rank without requiring a learned nonlinear encoder.
Implementation notes
Integrate this at the input and output interface of a one-dimensional conservative neural surrogate, such as an SSM, temporal Transformer, or latent MLP predicting u_{t+1} from u_t. First normalize every nonnegative state to equal mass: u\leftarrow Mu/(\sum_i u_i\Delta x), where M is the desired mass, usually 1. Choose a fixed reference density r on the same grid, compute its CDF F_r, and choose K reference probabilities p_k=(k-0.5)/K. For every snapshot u, compute the discrete CDF C_i=\sum_{m\le i}u_m\Delta x and obtain the quantile samples q_k=\inf\{x_i:C_i\ge p_k\}; use linear interpolation between grid points to reduce quantization error. Feed q=(q_1,\ldots,q_K) or a low-rank projection of q into the dynamics network. A practical model predicts residual transport-map changes, q_{t+1}=q_t+\Delta t\,f_ heta(q_t,a_t), rather than predicting q_{t+1} directly. Decode by monotone interpolation of q(p) and push forward the reference measure: estimate u on cells from the inverse map, or use the differentiable histogram formula u(x_i)\approx r(x_j)\Delta x/\max(\Delta q_j,\epsilon) for intervals where q maps reference cell j to target cells. During training use both transformed-space loss L_q=K^{-1}\sum_k|q_{t+1,k}-\widehat q_{t+1,k}|^2 and physical mass/nonnegativity checks. The CDT and quantile definitions are fixed mathematically; the reference density, K, interpolation, and model architecture are engineering choices. First test on a translating Gaussian or square pulse and then 1D Burgers before shock formation, using a small GRU or SSM. Compare against the same model on Eulerian grid values at equal parameter count and latent dimension. Success is lower rollout error and faster loss descent at the same latent width; for pure translation, a two-mode linear latent baseline should nearly match the CDT model while Eulerian POD should require many modes.
Verification
Stage 1 · Toy mechanism gate: Passed ✓
Stage 2 · Mechanism transferred to benchmark: Confirmed ✓
Stage 2 · Practical benchmark result: Significantly worse ✗
Methodology: 8 paired seeds, permutation test (p<0.05) against a learning-rate-tuned baseline. How verification works
Stage 1 — Mechanism check agent confidence 9/10
Built a discrete CDT/quantile-map MVP for translated compactly supported densities and verified the core transport-map mechanism. Across K=32–256, the observed translation slope was 0.999999999–1.000000001 with maximum affine residual 2.2e-6; W2^2 matched shift^2 with maximum absolute error about 9e-8. CDT snapshots reached 99% and 99.9% SVD energy with one centered mode, versus 7 and 11 Eulerian modes, respectively. This is a clear mechanism win, but not yet evidence for trained rollout accuracy on nonlinear dynamics.
- Agent confidence
- 9/10
- Baseline
- Eulerian centered POD: 99% energy requires 7 modes, 99.9% requires 11; 1-mode reconstruction RMSE 1.3982 and 8-mode RMSE 0.1074.
- Idea
- CDT: translation slope approximately 1.0, affine residual <=2.2e-6, W2^2 error <=9e-8, 99% and 99.9% energy require 1 centered mode; 1-mode latent RMSE 1.04e-6.
Limitations: Only a noiseless translated compactly supported bump was tested. No neural dynamics training, GRU/SSM comparison, Burgers evolution, shock formation, decoder implementation, boundary crossing, noisy density robustness, or runtime/memory scaling was evaluated.
How to run: python3 experiment.py
Stage 2 — Benchmark vs. tuned baseline (arXiv:2607.17066)
Significantly WORSE than the tuned baseline (+67903.8%, p=0.0081, wins 0 / 8 paired seeds).
- Benchmark
- Translated_density_transport
- Model
- shared_mlp
- Paired seeds
- 8
- Baseline mean
- 0.002
- Idea mean
- 1.3791
- Effect (Δ)
- 1.377 (+67903.8%; negative = idea better)
- Wins
- 0 / 8 paired seeds
- p-value
- 0.0081 (permutation test, 20 000 shuffles)
- Smallest detectable effect
- ±24245.8%
- Mechanism
- Confirmed ✓
- Practical effect
- Hurts
- Baseline tuning
- swept over 3 configs
Only the custom translated-Gaussian one-step task was tested; nonlinear Burgers dynamics, shocks, multistep rollouts, alternative decoders, larger quantile resolutions, and computational scaling were not tested. The custom track uses a fixed translation and the CDT decoder is a simple cell-deposition approximation, which may contribute to its poor physical reconstruction accuracy.
How to run: python3 bench_cdt.py
Verdict computed by deterministic test code from paired-seed statistics — not by the language model.
Stage 2 — Benchmark latest Failed ✗
Agent confidence: 10/10
Built and evaluated a custom translated-density transport track with independently trained matched MLP systems: Eulerian grid prediction versus CDT quantile-map prediction with physical density decoding. The mechanism signature was quantitatively confirmed, with mean learned quantile displacement 0.08012 versus the true 0.08. However, the CDT system had test MSE 1.37907 versus baseline 0.002028; paired delta was +1.37704 with permutation p=0.0081, yielding the required verdict "idea worse (significant)".
- Baseline
- 8-seed tuned sweep: best lr=0.009, 35 epochs; physical test MSE mean 0.00202793, std 0.00047217; per-seed [0.00200073, 0.00299634, 0.00210573, 0.00171482, 0.00189333, 0.00146709, 0.00247447, 0.00157095].
- Idea
- 8-seed 3-value parity sweep: best lr=0.009, 35 epochs; physical decoded-density test MSE mean 1.37906960, std 0.55017672; paired delta +1.37704167, 0/8 wins, permutation p=0.0081. Mechanism signature: learned mean quantile delta 0.08011689 versus expected 0.08, confirmed=true.
Benchmark result
Significantly WORSE than the tuned baseline (+67903.8%, p=0.0081, wins 0 / 8 paired seeds).
- Benchmark
- Translated_density_transport
- Model
- shared_mlp
- Paired seeds
- 8
- Baseline mean
- 0.002
- Idea mean
- 1.3791
- Effect (Δ)
- 1.377 (+67903.8%; negative = idea better)
- Wins
- 0 / 8 paired seeds
- p-value
- 0.0081 (permutation test, 20 000 shuffles)
- Smallest detectable effect
- ±24245.8%
- Mechanism
- Confirmed ✓
- Practical effect
- Hurts
- Baseline tuning
- swept over 3 configs
Only the custom translated-Gaussian one-step task was tested; nonlinear Burgers dynamics, shocks, multistep rollouts, alternative decoders, larger quantile resolutions, and computational scaling were not tested. The custom track uses a fixed translation and the CDT decoder is a simple cell-deposition approximation, which may contribute to its poor physical reconstruction accuracy.
How to run: python3 bench_cdt.py
Artifacts
- README.md 1.3 KB View
- bench_cdt.py 5.8 KB View Raw
- bench_report.json 3.6 KB View Raw
- experiment.py 4.3 KB View Raw
- report.md 1.4 KB View
- report_bench_2026-08-30T193959.md 4.9 KB View
- results.json 3.3 KB View Raw