✗ Mechanism failed 2026

KS-Adaptive Graph Halting

Implementation & benchmark of arXiv:2607.16676 — The Value of Depth in Message Passing on Sparse Graphs: A Kesten-Stigum Dichotomy

Usefulness7/10
Difficulty5/10
Novelty5/10

Source paper: The Value of Depth in Message Passing on Sparse Graphs: A Kesten-Stigum Dichotomy arXiv:2607.16676 ⓘ · analyzed Aug 30, 2026

AI-generated research hypothesis, automatically tested. Not peer-reviewed.

Idea description

Use the KS ratio to decide how many message-passing layers to execute per graph or per node, rather than selecting a fixed depth. In the subcritical regime, stop once the predicted remaining effect is below a tolerance; in the supercritical regime, continue until the observed logit change becomes small or a larger budget is reached.

Formulas

$$\kappa=\gamma^2\Delta,$$
$$|\mathcal{E}(\ell)-\mathcal{E}(\ell')|\leq C\kappa^{(\ell+1)/3}\qquad(\kappa<1,\ \ell'>\ell),$$
$$\ell_{\varepsilon}=\left\lceil\frac{3\log(C/\varepsilon)}{\log(1/\kappa)}-1\right\rceil,$$
$$\Pr\{\text{layer }\ell\text{ changes the decision}\}\geq c\,\kappa^{\ell/2}.$$

Mathematical statement

For the paper's depth-\(\ell\) classifier, the error sequence satisfies \(|\mathcal{E}(\ell)-\mathcal{E}(\ell')|\leq C\kappa^{(\ell+1)/3}\) for \(\ell'>\ell\) when \(\kappa=\gamma^2\Delta<1\). Thus the uncomputed tail has an explicit geometric upper envelope with decay exponent \(1/3\), giving a sufficient stopping depth proportional to \(\log(1/\varepsilon)/\log(1/\kappa)\). The paper also states that under regularity, sufficiently deep layers still change the decision with probability at least \(c\kappa^{\ell/2}\), where \(c>0\) is a model-dependent anti-concentration constant. This suggests stopping only when both the theoretical tail estimate and the observed decision change are small.

Implementation notes

Add adaptive computation to an otherwise standard message-passing GNN. Process a sampled neighborhood one hop at a time, retain the current root logit \(s_\ell\), and define the empirical change \(d_\ell=|s_\ell-s_{\ell-1}|\) or, for classification, the fraction of nodes whose predicted class changed between layers. Estimate \(\Delta\) from the graph and estimate \(\gamma\) either from labels on a calibration split, from a fitted edge-correlation parameter, or as the sigmoid-constrained scalar used by the attenuated model. Compute \(\kappa=\gamma^2\Delta\). For \(\kappa<1\), choose a conservative budget using \(\ell_\varepsilon=\lceil3\log(C/\varepsilon)/\log(1/\kappa)-1\rceil\), with \(C\) calibrated by measuring the error gap between depths 2 and 4 on a validation set. At each layer, halt a node when \(d_\ell<\tau\) for two consecutive layers and the theoretical tail proxy \(C\kappa^{(\ell+1)/3}<\varepsilon\); batch nodes with the same active depth. For \(\kappa\geq1\), disable the subcritical certificate and use a maximum depth plus the empirical change criterion. The paper determines the geometric form, while \(C\), \(c\), and \(\tau\) are validation estimates. Test first on Reddit or ogbn-arxiv with a 2-to-12-layer GraphSAGE, comparing fixed depth, Ponder-style halting, and KS halting at equal accuracy. The target signal is 20–50% fewer message-passing FLOPs and sampled edges at unchanged accuracy, with no increase in worst-case error and a clear correlation between predicted \(\ell_\varepsilon\) and the empirically optimal depth.

Verification

Mechanism failed

Stage 1 · Toy mechanism gate: Failed ✗

Stage 2 · Mechanism transferred to benchmark: Not tested

Stage 2 · Practical benchmark result: Not run

Methodology: Toy-system gate first; the benchmark stage runs only after a pass. How verification works

Stage 1 — Mechanism check agent confidence 9/10

Built and ran a reproducible KS certificate sweep, stability-boundary sweep, and synthetic SBM message-passing halting experiment. The geometric ratio prediction and the decay/critical/growth boundary were exactly observed, but the literal stopping-depth formula underestimated the exact summed-tail depth by 1.17–1.59x because it omits the geometric-series prefactor. On the GNN task, adaptive halting matched fixed-depth accuracy (1.00 versus 1.00) but used 1.41x the message-work, so the proposed speedup was not observed.

Agent confidence
9/10
Baseline
Fixed depth 4: test accuracy 1.000, normalized test work 1.000
Idea
KS adaptive: test accuracy 1.000, mean depth 5.644, normalized work 1.411
Toy math
Tail ratios exactly matched kappa^(1/3); observed certificate depths were 7, 12, 19, 36, 76, 181, 642 versus predicted 6, 10, 17, 29, 58, 127, 404; multipliers across gamma*Lambda=0.70..1.30 exactly matched the parameter and crossed at 1.0

Limitations: Only a synthetic 600-node SBM was tested; no Reddit/ogbn-arxiv data, sampled-neighborhood implementation, Ponder baseline, wall-clock benchmark, or GPU execution was evaluated. The toy recurrence verifies the claimed scaling but does not establish the paper's bound constants for a trained GNN.

How to run: python3 ks_adaptive_experiment.py

Verdict computed by deterministic test code from paired-seed statistics — not by the language model.

Artifacts

Implementation overview ⬇ Download all as ZIP 3 files · code, reports and structured results