Synchronized spherical dimension bridge
Implementation & benchmark of arXiv:2608.13264 — The Gromov-Hausdorff Distance Between Consecutive Spheres
Source paper: The Gromov-Hausdorff Distance Between Consecutive Spheres arXiv:2608.13264 ⓘ · analyzed Sep 1, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Insert a hyperspherical adapter that splits an embedding into several unit-sphere blocks, changes the dimension of each block, and recombines them with a synchronized spherical join. Train the adapter to preserve pairwise angular distances, while using the paper's max-distortion composition principle to avoid uncontrolled accumulation of blockwise errors.
Formulas
Mathematical statement
For a correspondence R between metric spaces X and Y, the paper defines distortion as dis(R) = sup over paired pairs of |d_X(x,x') - d_Y(y,y')|, and Gromov-Hausdorff distance as one half of the infimum distortion over all correspondences. On a unit sphere, d_n(x,x') = arccos(x dot x'). The paper proves the sharp consecutive-sphere value d_GH(S^n,S^(n+1)) = zeta_n / 2, where zeta_n = arccos(-1/(n+1)), and gives explicit correspondences attaining distortion zeta_n. Its transferable composition rule states that synchronized spherical joins have distortion equal to the maximum distortion of their factors, while suspension preserves distortion. For two unit vectors u1 and u2, define J_theta(u1,u2) = (cos(theta) u1, sin(theta) u2), with theta in [0, pi/2]. The joined inner product is cos(theta)^2 times the first block inner product plus sin(theta)^2 times the second block inner product. This weighted spherical construction is the proposed neural representation.
Implementation notes
Integrate the bridge directly after a contrastive embedding head, retrieval encoder, or transformer final hidden state. Given h in R^D, first normalize it to h divided by its Euclidean norm, then split it into K blocks h_k. Normalize each block to u_k. For every block, learn a dimension-changing matrix A_k from the original block dimension d_k to target dimension e_k, and compute v_k = A_k u_k divided by the Euclidean norm of A_k u_k. Choose nonnegative join weights w_k satisfying the sum of w_k squared equals one, either fixed from block widths or learned through a softmax followed by square-root normalization. Produce the final unit representation z by concatenating w_k v_k. In pseudocode: u = split(normalize(h)); v_k = normalize(A_k @ u_k); w = normalize_positive_weights(); z = concat(w_k * v_k). For each training pair, compute original angular distance d_ij = arccos(clamp(h_i dot h_j, -1 + epsilon, 1 - epsilon)) and adapted angular distance t_ij = arccos(clamp(z_i dot z_j, -1 + epsilon, 1 - epsilon)). Add lambda times the mean absolute defect |d_ij - t_ij| to the task or contrastive loss. Log both mean and maximum batch defect. Compute the spherical formulas exactly; estimate global distortion empirically using random pairs and hard negatives. Begin with a two-layer MLP on CIFAR-10 or a small sentence-retrieval encoder, comparing against a single dense projection with the same output dimension. Success is lower memory at equal recall, stable maximum angular defect, and error that does not grow linearly with the number of blocks.
Verification
This idea has not been verified yet.
Verification happens in two stages: Stage 1 — a mechanism check on a toy system confirms the claimed mathematical phenomenon reproduces; Stage 2 — a benchmark implements the idea on a real (small) neural network task and compares it against a tuned baseline over 8 paired seeds with a permutation test.
Artifacts
Artifacts unavailable.