△ Mechanism confirmed, baseline not beaten 2026

Edge-Supported Polynomial State Space

Implementation & benchmark of arXiv:2607.17664 — Graph-Induced Tensor Liftings for Networked SEIR Models: Dimensional Reduction and Residual Analysis

Usefulness8/10
Difficulty5/10
Novelty8/10

Source paper: Graph-Induced Tensor Liftings for Networked SEIR Models: Dimensional Reduction and Residual Analysis arXiv:2607.17664 ⓘ · analyzed Aug 30, 2026

AI-generated research hypothesis, automatically tested. Not peer-reviewed.

Idea description

Replace a complete tensor/Kronecker polynomial lift of a graph dynamical system with observables selected only from the support of the interaction graph. The lifted state can then be propagated by a sparse structured linear operator, while the first omitted degree is treated as an explicit residual or learned closure. This gives a graph-aware polynomial state-space layer for neural ODEs, graph RNNs, and world models.

Formulas

$$\dot{x}=A_\ell x+K_{1,2}^{\mathcal E}\Phi_2^{\mathcal E}(x),\qquad \Phi_d^{\mathcal E}(x)=T_d^{\mathcal E}x^{\otimes d}.$$
$$z_d^{\mathcal E}(x)=\operatorname{col}\left(x,\Phi_2^{\mathcal E}(x),\ldots,\Phi_d^{\mathcal E}(x)\right),\qquad \frac{d}{dt}z_d^{\mathcal E}(x)=K_d^{\mathcal E}z_d^{\mathcal E}(x)+r_d^{\mathcal E}(x).$$
$$r_d^{\mathcal E}(x)=\operatorname{col}\left(0,\ldots,0,\mathcal L_{f_Q}\Phi_d^{\mathcal E}(x)\right),\qquad \mathcal L_{f_Q}\Phi_d^{\mathcal E}(x)=D\Phi_d^{\mathcal E}(x)f_Q(x).$$
$$\dim\Phi_2^{\mathcal E}=O(p+|\mathcal E|),\quad\text{whereas a complete degree-2 lift has }O(p^2)\text{ coordinates.}$$

Mathematical statement

Let $G=(\mathcal V,\mathcal E)$ be a directed graph with $n=|\mathcal V|$, let $x\in\mathbb R^p$ be the base state, and let the dynamics be $\dot x=A_\ell x+f_Q(x)$, where $A_\ell$ is linear and $f_Q$ is a quadratic vector field. For the SEIR example, $p=4n$ and $f_Q$ contains only monomials $S_iI_j$ for $(i,j)\in\mathcal E$, with coefficient proportional to $\beta a_{ij}$. Define $\Phi_d^{\mathcal E}(x)=T_d^{\mathcal E}x^{\otimes d}$, where the sparse selection tensor $T_d^{\mathcal E}$ retains only monomials recursively generated from active edges and lower-degree observables. The lifted state is $z_d^{\mathcal E}(x)=\operatorname{col}(x,\Phi_2^{\mathcal E}(x),\ldots,\Phi_d^{\mathcal E}(x))$. The chain rule gives $\dot z_d^{\mathcal E}=K_d^{\mathcal E}z_d^{\mathcal E}+r_d^{\mathcal E}$, where $K_d^{\mathcal E}$ contains within-degree linear couplings and quadratic couplings from degree $k$ to degree $k+1$, and $r_d^{\mathcal E}=\operatorname{col}(0,\ldots,0,\mathcal L_{f_Q}\Phi_d^{\mathcal E}(x))$ is the first omitted degree-$d+1$ contribution. The key property is that dictionary size depends on graph support rather than all ordered tensor indices.

Implementation notes

1. Integration point: implement this as a fixed feature encoder and linear recurrent or ODE block inside a graph RNN or neural ODE. Given adjacency support $\mathcal E$, enumerate only base coordinates and active quadratic monomials such as $S_iI_j$; recursively construct degree-3 and higher monomials by differentiating the retained monomials under the known or learned quadratic interaction map. Use sparse COO indices for $T_d^{\mathcal E}$ and sparse block matrices for $K_d^{\mathcal E}$. 2. Pseudocode: initialize z=[x]; for k=2,...,d, append select_edge_monomials(z,E); compute dz=K_d@z; optionally compute r_hat=closure_mlp(z) only in the final block; integrate z <- solver_step(z,dz+r_hat,dt); decode the base state from the first $p$ coordinates. 3. Computed quantities are the graph support, sparse monomial indices, and exact linear/quadratic coefficient blocks when physical dynamics are known. For a learned model, estimate $K_d$ by least squares or gradient descent and estimate the closure from the observed residual $\dot z-K_dz$. 4. First cheap experiment: use a synthetic $n=32$ SEIR or quadratic graph system with an Erdős-Rényi or ring graph, comparing a dense polynomial lift, an edge lift, and a standard message-passing GNN at equal parameter count. Train one-step and rollout prediction. Measure dictionary size, wall-clock cost, rollout error, and $\|r_d\|_2$. The quantitative prediction is that degree-2 edge features scale linearly with $|\mathcal E|$ and remain far below the dense $p^2$ baseline; for fixed graph support, changing edge weights should not change feature dimension, while residual magnitude should increase with maximum weighted incoming intensity $\max_i\sum_j|a_{ij}|$ and approximately quadratically with state amplitude for the cubic omitted term.

Verification

Mechanism confirmed, baseline not beaten

Stage 1 · Toy mechanism gate: Passed ✓

Stage 2 · Mechanism transferred to benchmark: Confirmed ✓

Stage 2 · Practical benchmark result: Inconclusive

Methodology: 8 paired seeds, permutation test (p<0.05) against a learning-rate-tuned baseline. How verification works

Stage 1 — Mechanism check agent confidence 9/10

Built an edge-supported degree-2 polynomial state-space module and deterministic verification/mini-experiment scripts. The chain-rule identity matched finite differences with maximum error 3.88e-10, feature dimension scaled with observed slope 1.0 versus the predicted linear dependence on |E|, residual amplitude scaling had observed log-log slope 3.0, and interaction-weight scaling had slope 1.0000000000000004. The mechanism manifested clearly; the sparse model used 96 versus 1024 quadratic features and achieved near-zero exact-task test error, although its small NumPy encoder timing was not faster than dense encoding.

Agent confidence
9/10
Baseline
Complete degree-2 lift: 1024 quadratic features, 32,800 decoder parameters, test relative L2 error 0.177888, fit time 1555.0 ms, encoding time 5.28 ms.
Idea
Edge-supported lift: 96 quadratic features, 3,104 decoder parameters, test relative L2 error 2.86e-11, fit time 269.1 ms, encoding time 6.77 ms. Mechanism sweeps: dimension slope 1.0, residual-amplitude slope 3.0, residual-weight slope 1.0000000000000004; finite-difference chain-rule error 3.88e-10.

Limitations: Only degree-2 observables and a synthetic quadratic graph system were tested. No learned closure, higher-degree recursive dictionary, neural ODE integration, SEIR dynamics, GPU implementation, long-horizon rollout, or large-scale sparse performance benchmark was evaluated; the timing comparison is a small NumPy CPU microbenchmark.

How to run: python3 verify_edge_polynomial.py && /home/maxwelhelp/main/bin/python3 mini_experiment.py

Stage 2 — Benchmark vs. tuned baseline (arXiv:2607.17664)

Ahead of the baseline (−21.4%) but not statistically significant (p=0.3069, wins 6 / 8 paired seeds).

Benchmark
Dynamics forecasting
Model
rnn_small
Paired seeds
8
Baseline mean
0.0015
Idea mean
0
Effect (Δ)
-0.0003 (−21.4%; negative = idea better)
Wins
6 / 8 paired seeds
p-value
0.3069 (permutation test, 20 000 shuffles)
Smallest detectable effect
n/a
Mechanism
Confirmed ✓
Practical effect
Inconclusive
Baseline tuning
swept over 3 configs
Limitations:

Only the registered actuated-pendulum dynamics track was tested. Higher-degree recursive lifts, learned closure, sparse COO K operators, neural ODE integration, long-horizon rollout evaluation, and larger graph-scale benchmarks were not tested. The idea model had 14,465 parameters versus 13,313 for baseline.

How to run: python3 stage2_bench.py

Verdict computed by deterministic test code from paired-seed statistics — not by the language model.

Stage 2 — Benchmark latest Failed ✗

Agent confidence: 9/10

The edge-supported polynomial GRU improved mean test MSE on the structurally matched registered dynamics track, from 0.0015438102 to 0.0012128049. However, the paired permutation test gave p=0.3069, so the improvement is not statistically significant under the required protocol. The trained-model mechanism signature was confirmed, but this does not satisfy the significant-win criterion.

Baseline
Raw-input rnn_small GRU; best lr=0.01, weight_decay=0.0; mean test MSE 0.0015438102273.
Idea
Edge-supported polynomial GRU with 6 quadratic features per timestep; best lr=0.01, weight_decay=0.0; mean test MSE 0.0012128048838; paired delta=-0.0003310053435; p=0.3069.

Benchmark result

Ahead of the baseline (−21.4%) but not statistically significant (p=0.3069, wins 6 / 8 paired seeds).

Benchmark
Dynamics forecasting
Model
rnn_small
Paired seeds
8
Baseline mean
0.0015
Idea mean
0
Effect (Δ)
-0.0003 (−21.4%; negative = idea better)
Wins
6 / 8 paired seeds
p-value
0.3069 (permutation test, 20 000 shuffles)
Smallest detectable effect
n/a
Mechanism
Confirmed ✓
Practical effect
Inconclusive
Baseline tuning
swept over 3 configs
Limitations:

Only the registered actuated-pendulum dynamics track was tested. Higher-degree recursive lifts, learned closure, sparse COO K operators, neural ODE integration, long-horizon rollout evaluation, and larger graph-scale benchmarks were not tested. The idea model had 14,465 parameters versus 13,313 for baseline.

How to run: python3 stage2_bench.py

Artifacts

Implementation overview ⬇ Download all as ZIP 9 files · code, reports and structured results