Submetry-Lifted Relational Alignment
Implementation & benchmark of arXiv:2608.11680 — Metric Geometry of Lebesgue, Wasserstein, and Gromov-Wasserstein Spaces: Submetries, Curvature, and Geodesics
Source paper: Metric Geometry of Lebesgue, Wasserstein, and Gromov-Wasserstein Spaces: Submetries, Curvature, and Geodesics arXiv:2608.11680 ⓘ · analyzed Sep 1, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Represent a graph, set, or attributed network as a measurable Z-valued kernel and train on lifted representatives while explicitly minimizing over node couplings. The quotient objective is invariant to relabeling by construction, while the lifted loss gives a dense correspondence signal that can stabilize graph attention and relational encoders.
Formulas
Mathematical statement
Let Omega=[0,1] with Lebesgue measure lambda, let (Z,d_Z) be the feature or edge-attribute metric space, and let omega,eta:Omega^2->Z be measurable kernels. The quotient map Q sends a kernel to its equivalence class under measure-preserving reparameterizations. A finite-sample quotient distance is d_Q(omega,eta)^p = inf_Pi sum_{i,j,k,l} Pi_{ik}Pi_{jl}d_Z(omega_{ij},eta_{kl})^p, where Pi is a coupling between node-weight vectors a and b, Pi 1=b and Pi^T 1=a (transpose convention may be swapped). The submetry property means quotient distances and metric balls can be realized by suitable lifted representatives rather than arbitrary quotient-level searches. Use the same coupling to compare relational inputs and predictions. The paper also gives an isometric embedding iota:(P_p(Z),(1/2)W_p^Z)->(M_p(Z),GW_p^Z), with E composed with iota equal to the identity, showing that ordinary Wasserstein-distributed features are a consistent special case.
Implementation notes
Integrate this at the input-to-encoder boundary for graph or network batches. Each sample should expose node weights a,b and an edge or relational tensor omega[i,j] in Z; the encoder may produce node states, a predicted relational tensor eta[k,l], or two augmented views whose tensors are compared. For every pair of views, form the cost tensor C[i,k,j,l]=d_Z(omega[i,j],eta[k,l])^p. Compute a soft node coupling Pi with 20-50 Sinkhorn iterations under Pi 1=a and Pi^T 1=b, using entropic regularization epsilon; begin with epsilon=0.1 times the median cost and optionally anneal to 0.01 times that median. Add lambda_align times the p-root of sum Pi[i,k]Pi[j,l]C[i,k,j,l] to the task loss. Stop gradients through Pi in the first MVP, then compare with differentiating through Sinkhorn. The exact mathematical component is the coupling-based quotient objective and its marginal constraints; finite graph size, entropic regularization, and the ground metric are engineering approximations. Start with a 3-6 layer GIN or graph transformer on MUTAG, ZINC, or synthetic attributed graphs. Compare against cross-entropy plus random node-permutation augmentation. Success means invariant predictions under arbitrary node permutations, lower prediction variance across permutations, and higher validation accuracy at equal training FLOPs; report Sinkhorn time and coupling entropy.
Verification
Stage 1 · Toy mechanism gate: Passed ✓
Stage 2 · Mechanism transferred to benchmark: Confirmed ✓
Stage 2 · Practical benchmark result: Inconclusive
Methodology: 8 paired seeds, permutation test (p<0.05) against a learning-rate-tuned baseline. How verification works
Stage 1 — Mechanism check agent confidence 8/10
Built a finite lifted relational alignment MVP with Sinkhorn node couplings, marginal checks, exact relabeling reference, entropy measurement, and a synthetic graph classifier comparison. The toy predictions manifested: identity/exact relabeling distance was 0, noisy lifted distance scaled approximately linearly with noise (slope 0.758), and coupling entropy increased monotonically with epsilon from 1.792 to 2.641. The classifier had equal accuracy (1.00) but alignment was slower (2.03s vs 0.18s) and slightly increased permutation prediction variance (0.000516 vs 0.000321), so there was no practical task-level win in this toy setup.
- Agent confidence
- 8/10
- Baseline
- accuracy=1.000; permutation probability variance=0.000321; training/evaluation time=0.184s
- Idea
- accuracy=1.000; permutation probability variance=0.000516; training/evaluation time=2.026s; Sinkhorn marginal max error=0.00141; exact relabel quotient root distance=0; approximate Sinkhorn quotient root distance=0.253
Limitations: Only a small synthetic graph dataset and shallow row-wise relational encoder were tested; no MUTAG/ZINC benchmark, GPU run, larger graphs, differentiable Sinkhorn, annealing, weighted nodes, or FLOP-normalized comparison was performed. The approximate entropic alternating coupling did not recover exact zero distance for relabeled graphs, unlike the explicitly constructed exact permutation coupling.
How to run: OMP_NUM_THREADS=1 MKL_NUM_THREADS=1 /home/maxwelhelp/main/bin/python3 experiment.py
Stage 2 — Benchmark vs. tuned baseline (arXiv:2608.11680)
Ahead of the baseline (−7.7%) but not statistically significant (p=1, wins 1 / 8 paired seeds).
- Benchmark
- Relational_graph_classification
- Model
- graphnet
- Paired seeds
- 8
- Baseline mean
- 0.0102
- Idea mean
- 0.0094
- Effect (Δ)
- -0.0008 (−7.7%; negative = idea better)
- Wins
- 1 / 8 paired seeds
- p-value
- 1 (permutation test, 20 000 shuffles)
- Smallest detectable effect
- ±18.2%
- Mechanism
- Confirmed ✓
- Practical effect
- Inconclusive
- Baseline tuning
- swept over 3 configs
The custom benchmark is small (400 training and 160 test graphs, 8 nodes each) and uses a simple GraphNet rather than MUTAG/ZINC or a deeper GNN. The relational alignment compares dense relational rows and hidden node states, not a full edge-attribute prediction head; differentiating through Sinkhorn, annealing, weighted nodes, FLOP profiling, and larger graph sizes were not tested.
How to run: cd /home/maxwelhelp/all/math2nn/experiments/exp2140_submetry-lifted-relational-alignment && /home/maxwelhelp/main/bin/python3 bench_run.py
Verdict computed by deterministic test code from paired-seed statistics — not by the language model.
Stage 2 — Benchmark latest Failed ✗
Agent confidence: 9/10
Built a custom attributed relational-graph classification track and matched GraphNet systems; the only intervention was detached Sinkhorn-based lifted node alignment during training. The idea achieved mean test error 0.009375 versus baseline 0.010156, but the paired permutation p-value was 1.0 and the harness verdict was "no significant win". The trained-model mechanism signature was confirmed for reduced permutation prediction variance, yet this did not translate into a statistically significant task-metric improvement.
- Baseline
- mean test error=0.01015625; per-seed=[0.0125,0.00625,0,0.01875,0.00625,0.01875,0,0.01875]; best lr=0.01; permutation variance=4.22e-17
- Idea
- mean test error=0.00937500; per-seed=[0.0125,0.00625,0,0.0125,0.00625,0.01875,0,0.01875]; best lr=0.01; permutation variance=1.26e-17; Sinkhorn=35 iterations; epsilon=0.1*median relational row cost
- Idea wins
- 1
- N pairs
- 8
- Paired delta
- -0.00078125 (idea lower/better)
- Permutation p value
- 1
Benchmark result
Ahead of the baseline (−7.7%) but not statistically significant (p=1, wins 1 / 8 paired seeds).
- Benchmark
- Relational_graph_classification
- Model
- graphnet
- Paired seeds
- 8
- Baseline mean
- 0.0102
- Idea mean
- 0.0094
- Effect (Δ)
- -0.0008 (−7.7%; negative = idea better)
- Wins
- 1 / 8 paired seeds
- p-value
- 1 (permutation test, 20 000 shuffles)
- Smallest detectable effect
- ±18.2%
- Mechanism
- Confirmed ✓
- Practical effect
- Inconclusive
- Baseline tuning
- swept over 3 configs
The custom benchmark is small (400 training and 160 test graphs, 8 nodes each) and uses a simple GraphNet rather than MUTAG/ZINC or a deeper GNN. The relational alignment compares dense relational rows and hidden node states, not a full edge-attribute prediction head; differentiating through Sinkhorn, annealing, weighted nodes, FLOP profiling, and larger graph sizes were not tested.
How to run: cd /home/maxwelhelp/all/math2nn/experiments/exp2140_submetry-lifted-relational-alignment && /home/maxwelhelp/main/bin/python3 bench_run.py
Artifacts
- bench_report.json 3.2 KB View Raw
- bench_run.py 7.1 KB View Raw
- experiment.py 6.3 KB View Raw
- graph_track.py 1.1 KB View Raw
- report.md 1.7 KB View
- report_bench_2026-09-01T125006.md 4.5 KB View
- results.json 1.3 KB View Raw