Failed on benchmark 2026

Finite-Excitation Latent Replay

Usefulness8/10
Difficulty5/10
Novelty7/10

Source paper: Adaptive Observer of Nonlinear One-Sided Lipschitz Systems Using Estimated State Regressors With Finite Excitation arXiv:2608.30977 · analyzed Sep 1, 2026

AI-generated research hypothesis, automatically tested. Not peer-reviewed.

Idea description

Replace derivative-based latent-dynamics fitting with an integral regression and maintain a history stack selected by the smallest eigenvalue of its information matrix. The model should perform aggressive parameter updates only when the estimated latent regressors are sufficiently exciting, while a perturbation bound prevents false excitation caused by inaccurate hidden-state estimates.

Formulas

$$x(t_i+T)-x(t_i)=\int_{t_i}^{t_i+T}[Ax(t)+Bu(t)+\phi(x(t),u(t))]dt+\Omega_i\theta+r_i,\qquad \Omega_i=\int_{t_i}^{t_i+T}\Phi(x(t),u(t))dt.$$
$$\widehat{G}=\sum_{i=1}^{M}\widehat{\Omega}_i^{\mathsf T}\widehat{\Omega}_i,\qquad G=\sum_{i=1}^{M}\Omega_i^{\mathsf T}\Omega_i,$$
$$\|\widehat{G}-G\|\leq\sum_{i=1}^{M}\left(2\|\Omega_i\|\|\Delta_i\|+\|\Delta_i\|^2\right),\qquad \Delta_i=\widehat{\Omega}_i-\Omega_i,$$
$$\lambda_{\min}(G)\geq\lambda_{\min}(\widehat{G})-\|\widehat{G}-G\|.$$

Mathematical statement

Consider a latent state model \(\dot{x}=Ax+Bu+\phi(x,u)+\Phi(x,u)\theta+Dd(t)\), where \(x\) is the latent state, \(u\) is the input, \(\theta\) is an unknown parameter vector, and \(d\) is a bounded disturbance. Over an interval \([t_i,t_i+T]\), integration gives \(x(t_i+T)-x(t_i)=\int_{t_i}^{t_i+T}[Ax+Bu+\phi(x,u)]dt+\Omega_i\theta+r_i\), where \(\Omega_i=\int_{t_i}^{t_i+T}\Phi(x(t),u(t))dt\) and \(r_i\) contains disturbance and modeling residuals. Using an estimated state produces \(\widehat{\Omega}_i=\Omega_i+\Delta_i\). The true information matrix is \(G=\sum_i\Omega_i^{\mathsf T}\Omega_i\), and the computable matrix is \(\widehat{G}=\sum_i\widehat{\Omega}_i^{\mathsf T}\widehat{\Omega}_i\). If \(\|\Delta_i\|\leq\varepsilon_i\), then \(\|\widehat{G}-G\|\leq\sum_i(2\|\Omega_i\|\varepsilon_i+\varepsilon_i^2)\). Thus \(\lambda_{\min}(G)\geq\lambda_{\min}(\widehat{G})-\|\widehat{G}-G\|\), so positive corrected excitation certifies informative data.

Implementation notes

1. Integration point: use a latent ODE, state-space model, or recurrent model with a dynamics head that is linear in an adapter parameter vector \(\theta\); a neural feature map \(\Phi_\psi(z,u)\) can generate the regressors. Maintain a buffer of windows \((z(t_i),z(t_i+T),u_{i:i+T})\), where \(z\) is the encoder or recurrent hidden state. 2. Pseudocode: for every stored window, numerically integrate the feature matrix using \(\widehat{\Omega}_i=\sum_k\Phi_\psi(z_k,u_k)\Delta t\); form \(\widehat G=\sum_i\widehat\Omega_i^{\mathsf T}\widehat\Omega_i\); estimate latent uncertainty \(\varepsilon_i\) from an ensemble variance, dropout variance, or observer residual; compute \(q=\lambda_{\min}(\widehat G)-\sum_i(2\|\widehat\Omega_i\|\varepsilon_i+\varepsilon_i^2)\). If \(q>\gamma\), update \(\theta\) using the integral-regression residual; otherwise freeze or downweight the dynamics-adapter update. Select history windows greedily by maximizing the increase in \(\lambda_{\min}(\widehat G)\). 3. The integral regression and perturbation inequality are taken from the paper; the true matrix and exact state error are unavailable, so \(\varepsilon_i\) must be estimated empirically and inflated by a safety factor. 4. First cheap experiment: train a two- or four-dimensional latent state-space model on Lorenz-63 or a damped nonlinear oscillator, comparing Adam, ungated integral regression, and excitation-gated replay. Sweep observation noise and window length. The quantitative prediction is that parameter error decreases rapidly after \(q\) becomes positive, with the empirical transition from ill-conditioned to stable identification near \(q=0\). When true states are available for evaluation, measured \(\lambda_{\min}(G)\) should exceed the conservative lower bound \(q\), up to numerical integration error.

Verification

Failed on benchmark

Mechanism evidence: Not confirmed

Practical benchmark: Did not beat baseline

Stage 1 — Mechanism check agent confidence 8/10

Built a NumPy MVP implementing integral regressors, Gramian excitation, perturbation correction, and greedy replay selection in finite_excitation_replay.py. The mechanism checks passed: 0/12 perturbation-bound violations, expected small-error O(epsilon) scaling, and a certificate threshold crossing at epsilon 0.240 observed versus 0.242 interpolated. Replay activated at step 4, but its final parameter error was worse than using all data (0.0541 versus 0.00697), so the mechanism is supported while this toy replay policy did not show an identification win.

Agent confidence
8/10
Baseline
All-candidate least squares: final parameter error 0.00697; best error 0.00417.
Idea
Greedy excitation replay: stack size 8, lambda_min=0.6195, activation step 4, final parameter error 0.0541; best error 0.0287. Bound violations: 0/12; certificate threshold epsilon observed/interpolated: 0.240/0.242.

Limitations: This is a deterministic linear toy identification test, not a neural latent ODE or Lorenz experiment. It uses one random seed, synthetic matrix regressors, known perturbation magnitudes for validation, and a simple sequential greedy stack rather than a full online observer or ensemble uncertainty estimator; runtime, FLOPs, noisy latent-state estimation, and multi-seed statistical significance were not tested.

How to run: python3 finite_excitation_replay.py

Stage 2 — Benchmark vs. tuned baseline

Significantly WORSE than the tuned baseline (+306367.6%, p=0.0081, wins 0 / 8 paired seeds).

Benchmark
Dynamics forecasting
Model
rnn_small
Paired seeds
8
Baseline mean
0.0002
Idea mean
0.7325
Effect (Δ)
0.7323 (+306367.6%; negative = idea better)
Wins
0 / 8 paired seeds
p-value
0.0081 (permutation test, 20 000 shuffles)
Smallest detectable effect
±28523.5%
Mechanism
Not confirmed ✗
Practical effect
Hurts
Baseline tuning
swept over 6 configs
Limitations:

Only the built-in controlled-pendulum dynamics track was tested. The intervention used a fixed hand-designed feature map and empirical constant uncertainty rather than a learned encoder ensemble; no Lorenz, latent ODE, longer horizons, or alternative uncertainty calibration was evaluated. The benchmark harness path was available at /home/maxwelhelp/all/math2nn/bench despite the initially stated absolute location.

How to run: python3 bench_felr.py

Verdict computed by deterministic test code from paired-seed statistics — not by the language model.

Stage 2 — Benchmark latest Failed ✗

Agent confidence: 10/10

Implemented Finite-Excitation Latent Replay on the structurally matched controlled-pendulum dynamics track using the shared rnn_small architecture. The perturbation-corrected excitation certificate never became positive, so the gated system performed no parameter updates and was dramatically worse than Adam. The paired difference was +0.7322945 MSE with permutation p=0.0081; the mechanism signature was not confirmed.

Baseline
Adam sweep best lr=0.01, weight_decay=0.0; 8-seed test MSE mean=0.000239025, std=0.000163569.
Idea
Integral-regression excitation-gated replay, best tested lr=0.001/0.003/0.01 with gamma=0, eps=0.035, replay=4; 8-seed test MSE mean=0.732534, std=0.076278.
Paired delta
idea - baseline = +0.7322945 MSE; 0/8 idea wins; permutation p=0.0081; verdict=idea worse (significant).

Benchmark result

Significantly WORSE than the tuned baseline (+306367.6%, p=0.0081, wins 0 / 8 paired seeds).

Benchmark
Dynamics forecasting
Model
rnn_small
Paired seeds
8
Baseline mean
0.0002
Idea mean
0.7325
Effect (Δ)
0.7323 (+306367.6%; negative = idea better)
Wins
0 / 8 paired seeds
p-value
0.0081 (permutation test, 20 000 shuffles)
Smallest detectable effect
±28523.5%
Mechanism
Not confirmed ✗
Practical effect
Hurts
Baseline tuning
swept over 6 configs
Limitations:

Only the built-in controlled-pendulum dynamics track was tested. The intervention used a fixed hand-designed feature map and empirical constant uncertainty rather than a learned encoder ensemble; no Lorenz, latent ODE, longer horizons, or alternative uncertainty calibration was evaluated. The benchmark harness path was available at /home/maxwelhelp/all/math2nn/bench despite the initially stated absolute location.

How to run: python3 bench_felr.py

Artifacts

⬇ Download all as ZIP 6 files · code, reports and structured results