Unverified 2026

Cayley-Residual Graph Convolution

Usefulness5/10
Difficulty7/10
Novelty7/10

Source paper: The Cayley Completion of a Graph arXiv:2608.30894 · analyzed Sep 1, 2026

AI-generated research hypothesis, automatically tested. Not peer-reviewed.

Idea description

Approximate a graph's adjacency by a learned abelian Cayley host and use one shared message-passing operator for every edge in the same inverse-pair generator class. Keep only the unexplained original edges as a residual branch, so the layer interpolates between a parameter-efficient group convolution and ordinary graph message passing.

Formulas

$$\gamma^{+}(G)\;\geq\;\frac{n\Delta^{*}}{2m}-1,$$
$$E_H(\pi,S)=\big\{\{u,v\}:\pi(v)-\pi(u)\in S\big\},\qquad S=-S,\quad 0\notin S,$$
$$H_{\mathrm{cay}}X=\sum_{\{s,-s\}\subseteq S} A_s X W_s,\qquad (A_sX)_{u}=X_{\pi^{-1}(\pi(u)+s)},$$
$$Y=\sigma\!\left(H_{\mathrm{cay}}XW_0+\lambda\,A_{\mathrm{res}}XW_{\mathrm{res}}\right),\qquad A_{\mathrm{res}}=A_G-A_H,$$

Mathematical statement

Let G=(V,E) be an undirected graph with n vertices and m edges. Choose an abelian group Gamma of order n, most simply Gamma=Z_n, and a bijective labeling pi:V -> Gamma. For a symmetric generator set S subset Gamma\{0}, satisfying S=-S, the Cayley host has edges E_H(pi,S)={{u,v}: pi(v)-pi(u) is in S}. The paper states that a labeling sorts host edges into inverse-pair classes {s,-s}; each class is a perfect matching or a disjoint union of equal-length cycles, so all edges in one class can share a message operator. For maximum degree Delta, let Delta* be the least integer d>=Delta for which nd is even. Theorem B gives the addition-only normalized lower bound gamma^+(G)>=n Delta*/(2m)-1. In the neural layer, A_s is the permutation matrix translating labels by s, A_H is the selected Cayley adjacency, and A_res=A_G-A_H contains graph edges not represented by the host.

Implementation notes

(1) Integration point: replace a standard GCN message-passing layer on a fixed graph by a two-branch layer. The structured branch uses Gamma=Z_n and one shift operator per inverse pair {s,-s}; the residual branch uses only original edges absent from the selected Cayley host. For variable-size graph batches, construct a separate cyclic host per graph or pad to a common n.

(2) MVP pseudocode:

input node features X and adjacency A_G
compute n, m, Delta; set d=max(Delta, smallest d with n*d even)
initialize permutation logits P and generator scores a[1:n//2]
for each training step:
    Pi = Sinkhorn(P/tau)                 # soft vertex labeling
    for s in 1,...,floor((n-1)/2):
        A_s = cyclic_shift(s)
        score[s] = sum_u A_G[u, Pi_inverse(Pi[u]+s)]
    S = top_k(score[s]+a[s], k=d//2)
    A_H = sum_{s in S}(A_s + A_{-s})
    A_res = relu(A_G-A_H)
    Y = activation(sum_{s in S} A_s @ X @ W_s + lambda*A_res @ X @ W_res)
    loss = task_loss(Y) + eta*edge_count(A_res)
update P, a, W with Adam; use straight-through top-k at inference

Use a sigmoid relaxation for generator selection during early training and anneal the Sinkhorn temperature tau. Normalize each shift and the residual adjacency by their respective degrees. Initialize lambda=1 so training begins near ordinary message passing.

(3) The paper supplies the inverse-pair decomposition and degree lower bound. The permutation, generator scores, and residual coefficient are learned empirically. Compute Delta* directly from n and Delta by incrementing Delta until n*Delta* is even. Measure the actual residual density |E_res|/m; the theorem is only a lower-bound diagnostic and need not be tight.

(4) First cheap experiment: train on Cora and on synthetic randomly permuted cycle, grid, and SBM graphs. Compare a 2-layer GCN, a full-edge graph transformer, a Cayley-only layer, and this residual layer at matched hidden width. Record validation accuracy, peak edge-memory, edge operations, and wall-clock time. A positive result is at least 30% fewer edge operations or lower memory at matched accuracy; on graphs generated from known Cayley structures, the Cayley-only model should nearly match full message passing while using substantially fewer distinct operators.

Verification

This idea has not been verified yet.

Verification happens in two stages: Stage 1 — a mechanism check on a toy system confirms the claimed mathematical phenomenon reproduces; Stage 2 — a benchmark implements the idea on a real (small) neural network task and compares it against a tuned baseline over 8 paired seeds with a permutation test.

Artifacts

Artifacts unavailable.