Parameter-Dependent Lyapunov Neural Dynamics
Implementation & benchmark of arXiv:2608.28349 — Operator-Theoretic Stability and Observer Synthesis for Parameter-Dependent Vlasov--Maxwell Dynamics
Source paper: Operator-Theoretic Stability and Observer Synthesis for Parameter-Dependent Vlasov--Maxwell Dynamics arXiv:2608.28349 ⓘ · analyzed Sep 2, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Replace an unconstrained recurrent or neural-ODE hidden-state evolution with a parameter-conditioned vector field whose Jacobian is contractive in a learned positive-definite metric. A Lyapunov residual is added during training using the current context, time, or operating-condition vector, allowing one model to remain stable across changing regimes rather than only near one nominal point.
Formulas
Mathematical statement
Let $z(t)\in\mathbb{R}^{n}$ be the hidden state, $\theta(t)$ a measurable conditioning parameter, and $\dot z=f_\phi(z,\theta,t)$. The local generator is $A_\phi(z,\theta,t)=\partial f_\phi/\partial z$. Let $P_\psi(\theta,t)=P_\psi(\theta,t)^\top\succ p_{\min}I$ be a parameter-dependent Lyapunov metric, where $p_{\min}>0$. The transferred differential LMI is $\dot P_\psi+A_\phi^\top P_\psi+P_\psi A_\phi+2\alpha P_\psi\preceq0$, with desired decay rate $\alpha>0$. It implies that $V(\delta z,t)=\delta z^\top P_\psi\delta z$ satisfies $\dot V\le-2\alpha V$ for infinitesimal perturbations. For a residual layer $z_{k+1}=z_k+h f_\phi(z_k,\theta_k)$, the finite-step condition is $J_k^\top P_{k+1}J_k\preceq e^{-2\alpha h}P_k$, where $J_k=I+hA_k$.
Implementation notes
1. Integration point: use a residual RNN, neural ODE solver, or latent state-space block. Parameterize $P_\psi(\theta,t)=L_\psi(\theta,t)L_\psi(\theta,t)^\top+p_{\min}I$, where $L_\psi$ is lower triangular with positive diagonal. 2. Pseudocode: compute $z_{k+1}=z_k+h f_\phi(z_k,\theta_k,t_k)$; obtain $A_k$ explicitly for small states or through Jacobian-vector products and power iteration for large states; evaluate $P_k$ and $P_{k+1}$; compute the largest generalized eigenvalue of $(J_k^\top P_{k+1}J_k,e^{-2\alpha h}P_k)$; add its positive part to the task loss; update $\phi$ and $\psi$. 3. Computed from the mechanism: the Lyapunov inequality, decay rate $\alpha$, and metric positivity. Estimated empirically: local Jacobians, parameter derivatives of $P$, and minibatch averages over trajectories. 4. First experiment: train equal-width GRUs and residual MLP dynamics on sequence-copy and Lorenz-63 prediction tasks. Compare vanilla training, spectral normalization, and this penalty at equal optimizer steps; ablate both the Lyapunov term and parameter dependence of $P$. 5. Pre-registered signature: perturbation energy must satisfy $V_k\le e^{-2\alpha kh}V_0$ up to discretization error, and the measured contraction factor must cross one near $\lambda_{\max}(P_k^{-1/2}J_k^\top P_{k+1}J_kP_k^{-1/2})=e^{-2\alpha h}$. Reject the transfer if the empirical boundary differs by more than 20%, or if the Lyapunov residual is positive without reducing perturbation growth versus the ablation.
Verification
Stage 1 · Toy mechanism gate: Passed ✓
Stage 2 · Mechanism transferred to benchmark: Confirmed ✓
Stage 2 · Practical benchmark result: No measurable effect
Methodology: 8 paired seeds, permutation test (p<0.05) against a learning-rate-tuned baseline. How verification works
Stage 1 — Mechanism check agent confidence 8/10
Built a compact parameter-conditioned residual dynamics model with a learned positive-definite metric and finite-step generalized-eigenvalue Lyapunov penalty. The exact 2D check satisfied the finite-step LMI (maximum normalized residual eigenvalue -0.083) and the measured energy ratio 0.797 was below the theoretical bound 0.946. In the learned comparison, the penalty reduced violating transitions from 44.5% to 3.9% and reduced the mean residual eigenvalue from 0.634 to -0.247, but prediction MSE worsened from 0.0199 to 0.0233, so the stability effect is real while there was no accuracy win.
- Agent confidence
- 8/10
- Baseline
- MSE 0.01987; Lyapunov violation fraction 0.445; mean generalized residual eigenvalue 0.634; local contraction ratio mean 0.679
- Idea
- MSE 0.02332; Lyapunov violation fraction 0.039; mean generalized residual eigenvalue -0.247; local contraction ratio mean 0.681
Limitations: Only a tiny 2D one-step residual-dynamics task was tested for 120 optimization steps. The parameter transition used for P_{k+1} was a rolled minibatch condition rather than a generated multi-step trajectory, and no GRU, Lorenz-63, spectral-normalization baseline, long-horizon robustness test, or equal-FLOP study was run.
How to run: python3 experiment.py
Stage 2 — Benchmark vs. tuned baseline (arXiv:2608.28349)
No significant difference vs. the tuned baseline (−-0.0%, p=1, wins 0 / 8 paired seeds).
- Benchmark
- Dynamics forecasting
- Model
- rnn_small
- Paired seeds
- 8
- Baseline mean
- 0.0007
- Idea mean
- 0.0007
- Effect (Δ)
- 0 (−-0.0%; negative = idea better)
- Wins
- 0 / 8 paired seeds
- p-value
- 1 (permutation test, 20 000 shuffles)
- Smallest detectable effect
- ±0.0%
- Mechanism
- Confirmed ✓
- Practical effect
- No effect
- Baseline tuning
- swept over 3 configs
The run used the built-in 800-train/300-test dynamics subset and 10 epochs. The MVP regularizes a two-dimensional hidden-state sub-Jacobian at the final sequence step with local P(theta), rather than a full trajectory-varying P_{k+1}; thus it does not test every possible Lyapunov implementation.
How to run: python3 bench_lyapunov.py
Verdict computed by deterministic test code from paired-seed statistics — not by the language model.
Stage 2 — Benchmark latest Failed ✗
Agent confidence: 9/10
The full registered dynamics-track benchmark completed with the shared rnn_small architecture, matched learning-rate search space, tuned baseline, and 8 paired seeds. The Lyapunov intervention produced exactly the same test MSE as baseline (delta_mean=0, permutation p=1.0), so it did not transfer as a task-metric win; its trained-model signature showed zero observed violations but the positive-part penalty was effectively inactive.
- Baseline
- Test MSE mean 0.0007333773064601701, std 0.00023119481143299165, best lr=0.006.
- Idea
- Test MSE mean 0.0007333773064601701, std 0.00023119481143299165, best lr=0.006 lambda=0.01; delta_mean=0, p=1.0; observed residual eigenvalue mean=-0.4996017814, max=-0.3815609515, violation fraction=0.
Benchmark result
No significant difference vs. the tuned baseline (−-0.0%, p=1, wins 0 / 8 paired seeds).
- Benchmark
- Dynamics forecasting
- Model
- rnn_small
- Paired seeds
- 8
- Baseline mean
- 0.0007
- Idea mean
- 0.0007
- Effect (Δ)
- 0 (−-0.0%; negative = idea better)
- Wins
- 0 / 8 paired seeds
- p-value
- 1 (permutation test, 20 000 shuffles)
- Smallest detectable effect
- ±0.0%
- Mechanism
- Confirmed ✓
- Practical effect
- No effect
- Baseline tuning
- swept over 3 configs
The run used the built-in 800-train/300-test dynamics subset and 10 epochs. The MVP regularizes a two-dimensional hidden-state sub-Jacobian at the final sequence step with local P(theta), rather than a full trajectory-varying P_{k+1}; thus it does not test every possible Lyapunov implementation.
How to run: python3 bench_lyapunov.py
Artifacts
- bench_lyapunov.py 6.5 KB View Raw
- bench_report.json 3.1 KB View Raw
- experiment.py 5.4 KB View Raw
- report.md 1.5 KB View
- report_bench_2026-09-03T003539.md 5.0 KB View
- results.json 0.9 KB View Raw