✗ Failed on benchmark 2026

Ratio-Stable Positive Recurrent Core

Implementation & benchmark of arXiv:2608.07403 — Topology Inference for Immune System Networks by Using Cell Amount Data

Usefulness7/10
Difficulty5/10
Novelty7/10

Source paper: Topology Inference for Immune System Networks by Using Cell Amount Data arXiv:2608.07403 ⓘ · analyzed Sep 1, 2026

AI-generated research hypothesis, automatically tested. Not peer-reviewed.

Idea description

Replace an unconstrained recurrent transition with a positive linear state-space core whose equilibrium has a prescribed composition vector. Fit or project its interaction matrix using a quadratic program with sign, sparsity, diagonal-dominance, and equilibrium constraints, then use the resulting stable dynamics as the hidden-state update.

Formulas

x_i(k) >= 0, and lim_(t -> infinity) x(t) = x_star, with x_star_j / x_star_i = mu_j / mu_i, mu_i > 0, and sum_i mu_i = 1.
min_(A,b) sum_(k=0)^(T-1) ||(x_(k+1) - x_k)/h - A x_k - b||_2^2 + lambda ||A||_F^2, subject to A_ij >= 0 for i not equal to j and A_ii + sum_(j not equal to i) A_ij <= -alpha.
b = -A x_star, and x_(k+1) = (I + h A)x_k + h b + h B phi(U u_k).
rho(I + h A) < 1, and ||x(t) - x_star||_infinity <= C exp(-alpha t) ||x(0) - x_star||_infinity.

Mathematical statement

Let x in R^n be the hidden state, A in R^(n x n) the interaction matrix, b in R^n the bias, and mu in R^n be a positive composition vector with sum_i mu_i = 1. The desired equilibrium is x_star = c mu for c > 0. Positivity is guaranteed for the continuous-time system dx/dt = A x + b when A is Metzler, meaning A_ij >= 0 for i not equal to j, and b >= 0. Impose b = -A x_star so that x_star is an equilibrium. A simple computable stability certificate is row diagonal dominance: A_ii + sum_{j not equal to i} A_ij <= -alpha for every i, with alpha > 0. This makes A Hurwitz under suitable norm conditions and gives exponential contraction. For the discrete update x_(k+1) = (I + h A)x_k + h b, choose h small enough that I + h A is nonnegative and its spectral radius is below one. Signed topology labels can be enforced by setting A_ij = 0 for absent edges, A_ij >= 0 for positive edges, and A_ij <= 0 for negative edges; negative edges should be represented through a separate signed residual channel if strict state positivity is required.

Implementation notes

1. Integration point: implement this module as the recurrent core of a small RNN, a linear state-space model, or a memory block inside a sequence model. Let x be the nonnegative hidden state and use an unconstrained linear readout y = W x + c. Choose a target composition vector mu either from empirical average hidden activations or as a learnable positive simplex vector.

2. Pseudocode: collect hidden-state pairs (x_k, x_(k+1)) from a warm-start model; solve the quadratic program in the formulas for A and b; enforce off-diagonal sign constraints and the row stability margin alpha; select h so that I + h A is elementwise nonnegative; update x_(k+1) = (I + h A)x_k + h b + h B phi(Uu_k); then fine-tune B, U, W, and optionally mu with backpropagation. Add an L1 penalty on A to encourage a sparse inferred topology.

3. Computed from the paper: the positivity condition, equilibrium-ratio constraint, sign restrictions, and constrained least-squares topology fit. Estimated empirically: A, B, U, W, alpha, h, and the contraction constant C. Log the minimum hidden coordinate, equilibrium-ratio error, spectral radius, and hidden-state norm over long rollouts.

4. First cheap experiment: compare a vanilla tanh RNN, a GRU, and this constrained core on sequential MNIST, permuted sequential MNIST, and a synthetic stable linear system with known equilibrium mu. Sweep h and alpha. The falsifiable prediction is that instability appears close to the measured boundary rho(I + h A) = 1, while the constrained model remains bounded below that boundary. On the synthetic system, the log error relative to equilibrium should decrease approximately linearly with slope -alpha, within 20 percent of the predicted rate. Long-horizon hidden-state variance and the frequency of negative activations should also be lower than for the unconstrained RNN at matched one-step loss.

Verification

Failed on benchmark

Stage 1 · Toy mechanism gate: Passed ✓

Stage 2 · Mechanism transferred to benchmark: Not reproduced ✗

Stage 2 · Practical benchmark result: Significantly worse ✗

Methodology: 8 paired seeds, permutation test (p<0.05) against a learning-rate-tuned baseline. How verification works

Stage 1 — Mechanism check agent confidence 8/10

Built a readable NumPy MVP of the ratio-stable positive recurrent core with Metzler interactions, prescribed equilibrium, Euler updates, and parameter sweeps. The mechanism manifested: equilibrium residual was 0, the measured spectral-radius boundary matched prediction within 0.07%, decay slopes matched discrete theory within 0.33%, and the positivity boundary matched the predicted value at sweep resolution. The constrained core also reached 0.61 toy test accuracy versus 0.53 for the vanilla tanh RNN, though this is not evidence of broad accuracy improvement.

Agent confidence
8/10
Baseline
Vanilla tanh RNN: test accuracy 0.53; mean final hidden norm 0.3404.
Idea
Positive core: test accuracy 0.61; mean final hidden norm 0.1957. Predicted versus observed rho=1 boundary: 1.4953 vs 1.4964. Predicted versus observed decay slope: -0.40654 vs -0.40667. Positivity boundary: predicted 0.869565, observed 0.869565. Across alpha 0.2, 0.4, 0.8, 1.2, observed decay slopes were -0.2042, -0.4071, -0.8192, -1.2401 versus predictions -0.2010, -0.4041, -0.8164, -1.2375.

Limitations: The QP fitting/projection stage, signed topology residual channel, learnable composition vector, GPU implementation, GRU comparison, sequential MNIST, and large-scale training were not tested. The toy task uses fixed recurrent dynamics and trains only input/readout parameters; positivity above the Euler matrix boundary was identified through a negative matrix entry rather than a dedicated adversarial state rollout.

How to run: python3 experiment.py

Stage 2 — Benchmark vs. tuned baseline (arXiv:2608.07403)

Significantly WORSE than the tuned baseline (+30171.7%, p=0.0081, wins 0 / 8 paired seeds).

Benchmark
Dynamics forecasting
Model
rnn_small
Paired seeds
8
Baseline mean
0.0008
Idea mean
0.231
Effect (Δ)
0.2302 (+30171.7%; negative = idea better)
Wins
0 / 8 paired seeds
p-value
0.0081 (permutation test, 20 000 shuffles)
Smallest detectable effect
±4988.3%
Mechanism
Not confirmed ✗
Practical effect
Hurts
Baseline tuning
swept over 3 configs
Limitations:

Only the registered built-in dynamics track was tested. QP fitting, signed residual channels, learnable composition vectors, alternative recurrent baselines, and other built-in tracks were not tested.

How to run: python3 positive_core_bench.py

Verdict computed by deterministic test code from paired-seed statistics — not by the language model.

Stage 2 — Benchmark latest Failed ✗

Agent confidence: 10/10

The ratio-stable positive recurrent core was implemented as a local recurrent-transition replacement and tested on the structurally matched registered dynamics track. Its stability mechanism was confirmed, but task performance was significantly worse than the tuned GRU baseline, so the benchmark verdict is not a win.

Baseline
GRU baseline, best lr=0.006, 8-seed test MSE mean 0.0007629804.
Delta mean
0.2302043606
Idea
Positive Metzler Euler core, best lr=0.006, 8-seed test MSE mean 0.2309673410.
P value
0.0081

Benchmark result

Significantly WORSE than the tuned baseline (+30171.7%, p=0.0081, wins 0 / 8 paired seeds).

Benchmark
Dynamics forecasting
Model
rnn_small
Paired seeds
8
Baseline mean
0.0008
Idea mean
0.231
Effect (Δ)
0.2302 (+30171.7%; negative = idea better)
Wins
0 / 8 paired seeds
p-value
0.0081 (permutation test, 20 000 shuffles)
Smallest detectable effect
±4988.3%
Mechanism
Not confirmed ✗
Practical effect
Hurts
Baseline tuning
swept over 3 configs
Limitations:

Only the registered built-in dynamics track was tested. QP fitting, signed residual channels, learnable composition vectors, alternative recurrent baselines, and other built-in tracks were not tested.

How to run: python3 positive_core_bench.py

Artifacts

Implementation overview ⬇ Download all as ZIP 6 files · code, reports and structured results