Discrete Gromov-Wasserstein Duality: Algorithms and Isomorphism Testing

arXiv:2609.03094 2026 Architecture 1 ideas extracted · analyzed Sep 4, 2026

What the math gives to ML

The paper supplies a discrete Gromov–Wasserstein objective together with a useful quadratic representation for graph collections: for squared costs, the interaction matrix can be written as a negative Kronecker product of positive-semidefinite kernel matrices. This exposes a low-rank factorization that can replace explicit pair-of-pairs computations in a neural graph-alignment module. The paper also gives convergence bounds for optimization with uniformly inexact gradient oracles, which is directly relevant when the GW gradient is approximated by truncated low-rank products or minibatches. The most promising transfer is a structure-aware cross-attention layer whose transport matrix is optimized under graph-intrinsic costs rather than learned from node features alone.

Ideas from this paper

Unverified 2026

Low-Rank Gromov-Wasserstein Cross-Attention

Replace ordinary feature-only cross-attention between two graph sets with a transport coupling optimized using pairwise structural costs. Use the paper's positive-semidefinite graph-kernel factorization to compute the quadratic GW interaction without materializing an O(N_0^2 N_1^2) tensor, and use the inexact-gradient convergence bound to control truncated or approximate updates. The resulting coupling can be used directly as attention weights or as a soft graph-matching matrix.

Useful6/10
Difficulty6/10
Novelty6/10
Paper: Discrete Gromov-Wasserstein Duality: Algorithms and Isomorphism Testing arXiv:2609.03094