Bernstein-Certified Scheduled Recurrent Core
Implementation & benchmark of arXiv:2608.03175 — GriD-LMIA: A Gridding-Based Assembler for Solving Differentiable Parameter-Dependent Linear Matrix Inequalities
Source paper: GriD-LMIA: A Gridding-Based Assembler for Solving Differentiable Parameter-Dependent Linear Matrix Inequalities arXiv:2608.03175 ⓘ · analyzed Aug 31, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Build a recurrent or state-space neural module with a transition matrix A_theta(rho) that is affine in a context or scheduling vector rho, and certify contraction using a continuous piecewise-polynomial Lyapunov matrix P(rho). Instead of checking stability only at sampled contexts, use Bernstein coefficient inequalities on every grid cell and every vertex of the allowed context-rate box, producing a finite certificate for all continuous trajectories within the domain.
Formulas
Mathematical statement
Let the recurrent state evolve as dot{x} = A_theta(rho)x + B_theta(rho)u and let rho_dot belong to the box R = {v: v_i in [v_i^-,v_i^+]}. Choose a symmetric piecewise-polynomial P(rho) represented on cell c by P^(c)(alpha) = sum_i B_i^m(alpha)P^(c)[i], where alpha maps the physical cell to [0,1]^ell, B_i^m are tensor Bernstein basis functions, and P^(c)[i] are symmetric certificate matrices. The continuous-time contraction condition is F(rho,v) = sum_s v_s partial P/partial rho_s + P(rho)A_theta(rho) + A_theta(rho)^T P(rho) + 2 alpha P(rho) <= 0, with alpha > 0 the desired decay rate. Require P(rho) >= epsilon I for epsilon > 0. If F is assembled into Bernstein coefficients F^(c)[i,v], imposing F^(c)[i,v] <= 0 for every coefficient i, cell c, and rate-box vertex v is sufficient because Bernstein basis functions are nonnegative and sum to one. Shared face coefficients enforce continuity of P. At an interface, Clarke generalized derivatives are convex combinations of adjacent one-sided derivatives, so checking adjacent-cell derivative cases covers nonsmooth boundaries.
Implementation notes
1. Exact integration point: implement a continuous-time latent state-space block inside a sequence model, with dot{x} = A_theta(rho)x + B_theta(rho)u and y = C_theta x. Start with A_theta(rho) = A_0 + sum_s rho_s A_s, where rho is a normalized context such as timestep, operating condition, or a low-dimensional encoder output. Use matrix exponentials or a stable ODE discretization for rollout. 2. Pseudocode: create a rectangular grid over rho; introduce symmetric Bernstein coefficients P for every cell; impose P_coeff - epsilon*I >> 0; for every cell and every rate-box vertex v, symbolically assemble the Bernstein coefficients of v dot grad(P) + P A + A^T P + 2 alpha P and impose each coefficient << 0; impose equality of Bernstein coefficients on shared faces; solve the SDP for P and, optionally, A when A enters affinely. During neural training, either freeze A and periodically recertify P, or alternate several gradient steps on the predictor with an SDP feasibility solve and reject updates that destroy the certificate. 3. Computed versus estimated: Bernstein coefficient matrices, derivatives, face equalities, and rate vertices are computed exactly from polynomial coefficients; neural approximation error, discretization error, and whether rho remains in the declared box are estimated empirically. 4. First cheap experiment: use a 2- or 4-dimensional latent linear SSM on Copy Memory and sequential MNIST, comparing unconstrained, spectral-normalized, and certified models. Sweep maximum context-rate bound r and polynomial degree m. The quantitative prediction is a feasibility transition: the SDP becomes infeasible near the largest admissible rate r_star, while increasing m or grid-cell count should weakly increase feasible r_star and reduce long-horizon hidden-state error. Validate by dense random sampling and require every sampled largest eigenvalue of F to be nonpositive, with the observed boundary agreeing with the SDP prediction within 20%.
Verification
Stage 1 · Toy mechanism gate: Passed ✓
Stage 2 · Mechanism transferred to benchmark: Confirmed ✓
Stage 2 · Practical benchmark result: Significantly worse ✗
Methodology: 8 paired seeds, permutation test (p<0.05) against a learning-rate-tuned baseline. How verification works
Stage 1 — Mechanism check agent confidence 8/10
Built a readable scalar MVP of the Bernstein-certified scheduled recurrent core, including exact Bernstein derivative, product, and degree-elevation operations plus LP feasibility for the scalar SDP special case. The mechanism was verified: Bernstein coefficient inequalities produced zero violations in 500 random convex-hull checks and dense sampling remained nonpositive. The decay feasibility boundary matched the predicted worst-case condition alpha <= a - b*rho_max, approximately 0.30, while the rate bound had no finite boundary in this uniformly stable scalar system, correctly showing that rate dependence is not universal. The certified rollout decayed to 5.90e-29, whereas the unstable baseline grew to 3.27e6.
- Agent confidence
- 8/10
- Baseline
- Unstable scheduled scalar rollout: final and peak absolute state = 3.269017e6
- Idea
- Certified rollout: final absolute state = 5.900091e-29, peak = 1.0; convex-hull violations = 0/500; worst dense F = -9.9999997e-08; observed alpha boundary approximately 0.30 versus predicted 0.30; rate boundary exceeded 2.0 for alpha below 0.30.
Limitations: Only a scalar one-cell continuous-time system was implemented. Matrix-valued LMIs, multiple grid cells, shared-face continuity constraints, neural training, input/output maps, discretization effects, and sequential-memory benchmarks were not tested. The exact alpha=0.30 boundary is non-strict and accepted at machine precision; strict positive margins become infeasible immediately above it.
How to run: python3 run_experiment.py
Stage 2 — Benchmark vs. tuned baseline (arXiv:2608.03175)
Significantly WORSE than the tuned baseline (+165.9%, p=0.0081, wins 0 / 8 paired seeds).
- Benchmark
- Dynamics forecasting
- Model
- rnn_small
- Paired seeds
- 8
- Baseline mean
- 0.0005
- Idea mean
- 0
- Effect (Δ)
- 0.0009 (+165.9%; negative = idea better)
- Wins
- 0 / 8 paired seeds
- p-value
- 0.0081 (permutation test, 20 000 shuffles)
- Smallest detectable effect
- n/a
- Mechanism
- Confirmed ✓
- Practical effect
- Hurts
- Baseline tuning
- swept over 3 configs
Only the built-in dynamics track was tested; matrix-valued multi-cell Bernstein certificates, shared-face constraints, learned context scheduling, longer training, and larger-scale sequence benchmarks were not tested.
How to run: cd /home/maxwelhelp/all/math2nn/experiments/exp1743_bernstein-certified-scheduled-recurrent- && /home/maxwelhelp/main/bin/python3 stage2_bench.py
Verdict computed by deterministic test code from paired-seed statistics — not by the language model.
Stage 2 — Benchmark latest Failed ✗
Agent confidence: 10/10
Implemented the Bernstein-certified scheduled recurrent core on the structurally matched dynamics track with eight paired seeds, equal learning-rate sweeps, and standard benchmark evaluation. The mechanism signature was confirmed: trained-model Bernstein F coefficients were negative and observed transition gain was below the predicted bound. The task result was a significant loss, however: idea mean MSE 0.001449798 versus baseline 0.000545172, paired delta +0.000904626 and permutation p=0.0081, so the idea did not work under the benchmark criterion.
- Baseline
- mean MSE 0.0005451723 across 8 seeds; best lr=0.01
- Idea
- mean MSE 0.0014497980 across 8 seeds; best lr=0.01, alpha=0.08
- Idea wins
- 0/8
- Mechanism signature
- predicted upper bound 0.9880717; observed trained-model transition gain 0.6498447; maximum Bernstein F coefficient -1.2898294; confirmed=true
- Paired delta
- +0.0009046257 (idea minus baseline; lower is better)
- Permutation p value
- 0.0081
Benchmark result
Significantly WORSE than the tuned baseline (+165.9%, p=0.0081, wins 0 / 8 paired seeds).
- Benchmark
- Dynamics forecasting
- Model
- rnn_small
- Paired seeds
- 8
- Baseline mean
- 0.0005
- Idea mean
- 0
- Effect (Δ)
- 0.0009 (+165.9%; negative = idea better)
- Wins
- 0 / 8 paired seeds
- p-value
- 0.0081 (permutation test, 20 000 shuffles)
- Smallest detectable effect
- n/a
- Mechanism
- Confirmed ✓
- Practical effect
- Hurts
- Baseline tuning
- swept over 3 configs
Only the built-in dynamics track was tested; matrix-valued multi-cell Bernstein certificates, shared-face constraints, learned context scheduling, longer training, and larger-scale sequence benchmarks were not tested.
How to run: cd /home/maxwelhelp/all/math2nn/experiments/exp1743_bernstein-certified-scheduled-recurrent- && /home/maxwelhelp/main/bin/python3 stage2_bench.py
Artifacts
- bench_report.json 3.5 KB View Raw
- bernstein_certified_ssm.py 3.6 KB View Raw
- report.md 1.8 KB View
- report_bench_2026-08-31T174317.md 4.5 KB View
- results.json 1.4 KB View Raw
- run_experiment.py 2.1 KB View Raw
- stage2_bench.py 6.7 KB View Raw