Pullback-Commuting 3-Axis Network
Implementation & benchmark of arXiv:2607.29233 — Higher-Dimensional Symbolic Dynamics: A Textile Framework For 3-graphs
Source paper: Higher-Dimensional Symbolic Dynamics: A Textile Framework For 3-graphs arXiv:2607.29233 ⓘ · analyzed Aug 31, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Use three learned state-transition operators corresponding to three data axes, and train them to satisfy the paper's pullback-style interchange rule. For every local pair of axes, two successive updates should reach the same square state; for triples of axes, all six update orders should agree. This reduces sensitivity to scan direction and limits long-horizon drift caused by inconsistent local transitions.
Formulas
Mathematical statement
Let $X$ be the latent state space and let $T_i:X\times U_i\to X$ be differentiable transitions for axis $i\in\{1,2,3\}$, where $u_i\in U_i$ is the local input or edge label. A pullback square requires compatible compositions $T_j(T_i(x,u_i),u_j)$ and $T_i(T_j(x,u_j),u_i)$ to coincide, or to coincide with a shared witness map $S_{ij}$. Define the pairwise interchange defect $\delta_{ij}$ as their Euclidean distance. The 3-graph associativity analogue requires all six permutations of three transitions to agree; define this defect as their maximum pairwise distance. If every transition is $L$-Lipschitz and every adjacent interchange has defect at most $\varepsilon$, then three adjacent swaps give an output discrepancy bounded by $3\varepsilon(1+L+L^2)$; for $L<1$, the corresponding accumulated error over repeated local swaps is bounded by approximately $3\varepsilon/(1-L)$.
Implementation notes
1. Exact integration point: implement a three-axis block for data with time, spatial, and group axes, such as a tensor h[t,x,g]. Each axis has a gated residual transition T_i(h,u_i), with shared latent width and separate axis embeddings. Add the commutation loss to the ordinary task loss. 2. Pseudocode: sample a latent state h and local labels u1,u2,u3; compute both paths for each pair, d12 = norm(T2(T1(h,u1),u2) - T1(T2(h,u2),u1)) and analogously d13,d23; enumerate the six triple compositions, compute their maximum pairwise distance d123; optimize task_loss + lambda_pair*(d12²+d13²+d23²) + lambda_assoc*d123². Use gradient clipping and optionally normalize defects by the latent-state norm. 3. Taken directly from the paper's mechanism: colored path interchange, pullback uniqueness, and triple consistency implied by compatible local diagrams. Estimated empirically: the transition Lipschitz constant L using Jacobian-vector power iteration, epsilon as the validation mean pairwise defect, and collision rate by testing whether equal boundary conditions produce materially different latent outputs. 4. First cheap experiment: train a three-axis gated SSM on Moving-MNIST or a synthetic 3D advection dataset. Compare fixed-order scanning, random scan-order scanning, and the commuting model at equal parameter count. Measure task error, rollout error at horizons 1, 10, 50, and the disagreement across all six scan orders. The quantitative prediction is that six-order disagreement will scale approximately as 3*epsilon*(1+L+L²), within 30 percent, and that rollout disagreement will stop growing when measured L is below one. Sweep lambda_pair and identify whether a sharp reduction occurs once pairwise defects fall below the task-loss noise scale.
Verification
This idea has not been verified yet.
Verification happens in two stages: Stage 1 — a mechanism check on a toy system confirms the claimed mathematical phenomenon reproduces; Stage 2 — a benchmark implements the idea on a real (small) neural network task and compares it against a tuned baseline over 8 paired seeds with a permutation test.
Artifacts
Artifacts unavailable.