Hermitian Contraction Regularizer for Complex Neural Dynamics
Implementation & benchmark of arXiv:2608.07551 — Contraction Analysis of Holomorphic Dynamical Systems via the Intrinsic Kobayashi Metric
Source paper: Contraction Analysis of Holomorphic Dynamical Systems via the Intrinsic Kobayashi Metric arXiv:2608.07551 ⓘ · analyzed Sep 1, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Constrain the Jacobian of a complex-valued neural ODE or recurrent state update so that it is contracting in a state-dependent Hermitian metric. The resulting model should forget perturbations and initialization differences exponentially, improving long-horizon rollout stability while retaining coordinate-invariant stability information.
Formulas
Mathematical statement
Let $z\in\mathbb{C}^{n}$ be the hidden state, $\dot z=f_\theta(z,t)$ a holomorphic vector field, and $J(z,t)=\partial f_\theta/\partial z$ its complex Jacobian. Let $H(z,t)=H(z,t)^*\succ0$ be a Hermitian metric and define $V(\delta z,z)=\delta z^*H(z,t)\delta z$ for an infinitesimal displacement $\delta z$. Along $\dot{\delta z}=J\delta z$, the sufficient contraction condition is $\dot H+J^*H+HJ\preceq-2\alpha H$ for rate $\alpha>0$, where $\dot H$ is the directional derivative of $H$ along the state trajectory and $J^*$ is the conjugate transpose. If $mI\preceq H\preceq MI$ on a forward-invariant set, the induced distance contracts at rate $\alpha$ up to the factor $\sqrt{M/m}$.
Implementation notes
Use a complex-valued neural ODE, continuous-time state-space model, or complex RNN with hidden dynamics $\dot z=f_\theta(z,x,t)$. Parameterize the metric as $H_\phi(z)=R_\phi(z)^*R_\phi(z)+\epsilon I$, with $\epsilon>0$, or start with a constant diagonal positive metric for the minimum viable experiment. For each minibatch of states, compute $f$, the complex Jacobian $J$ using automatic differentiation, and the directional derivative $\dot H$; form $C=\dot H+J^*H+HJ+2\alpha H$ and add $\lambda_H\max(0,\lambda_{\max}(H^{-1/2}CH^{-1/2}))^2$ to the task loss. Alternatively reduce the ODE solver step when the largest generalized eigenvalue violates the target bound. Jacobians, matrix products, and eigenvalues are computed directly; the invariant region and global metric bounds $m,M$ are estimated from sampled states or interval bounds. The first cheap experiment should train a two-layer complex neural ODE on damped-oscillator trajectory prediction, comparing ordinary MSE training, spectral-Jacobian regularization, and the Hermitian penalty. Perturb initial states and fit the semilog slope of pairwise distances. The prediction is that the observed slope is no greater than $-\alpha$ after transients, within 20% of the sampled certificate. Sweeping penalty strength should reveal a transition when the maximum sampled generalized eigenvalue crosses zero: beyond that boundary perturbations decay, while below it they can persist or amplify.
Verification
Stage 1 · Toy mechanism gate: Passed ✓
Stage 2 · Mechanism transferred to benchmark: Confirmed ✓
Stage 2 · Practical benchmark result: Inconclusive
Methodology: 8 paired seeds, permutation test (p<0.05) against a learning-rate-tuned baseline. How verification works
Stage 1 — Mechanism check agent confidence 9/10
Built a complex linear-dynamics MVP with a Hermitian contraction certificate and a CUDA mini-training comparison. The certificate matched 2(alpha-gamma), the contraction boundary matched gamma=alpha across five alpha values, perturbation slopes matched -gamma, and the result was invariant under a fixed nonidentity metric. The mechanism is real, but this experiment did not demonstrate a practical improvement over baseline because both models already learned strongly contracting dynamics.
- Agent confidence
- 9/10
- Baseline
- MSE 1.0216e-08; certificate -0.74118; t=8 perturbation ratio 0.172112
- Idea
- MSE 9.0231e-09; certificate -0.74118; t=8 perturbation ratio 0.172109; lambda_H=2.0
- Math predictions
- Certificate agreement was at floating-point precision across 9 gamma values; observed alpha-boundaries matched predictions on all 5 tested alpha values; observed slopes matched -gamma; identity and nonidentity metrics both gave certificate -0.34.
Limitations: The MVP uses constant metrics rather than a learned state-dependent metric, and a 2D complex linear system rather than a nonlinear neural ODE. It does not test nonlinear long-horizon forecasting, adaptive solvers, global metric bounds, or whether regularization rescues an unstable baseline.
How to run: python3 experiment.py
Stage 2 — Benchmark vs. tuned baseline (arXiv:2608.07551)
No significant difference vs. the tuned baseline (+94.7%, p=0.0573, wins 2 / 8 paired seeds).
- Benchmark
- Dynamics forecasting
- Model
- rnn_small
- Paired seeds
- 8
- Baseline mean
- 0.0571
- Idea mean
- 0.1111
- Effect (Δ)
- 0.054 (+94.7%; negative = idea better)
- Wins
- 2 / 8 paired seeds
- p-value
- 0.0573 (permutation test, 20 000 shuffles)
- Smallest detectable effect
- ±71.8%
- Mechanism
- Confirmed ✓
- Practical effect
- Inconclusive
- Baseline tuning
- swept over 3 configs
The completed run used 4 epochs and one sampled state per minibatch after an exact-Jacobian 12-epoch attempt exceeded the time limit. The registered dynamics model is a real-valued GRU, testing H=I rather than a genuinely complex or learned state-dependent Hermitian metric; global contraction bounds and continuous-time ODE rollouts were not tested.
How to run: python3 bench_experiment.py
Verdict computed by deterministic test code from paired-seed statistics — not by the language model.
Stage 2 — Benchmark latest Failed ✗
Agent confidence: 9/10
The Hermitian contraction intervention was evaluated on the structurally matched registered dynamics track using the shared rnn_small architecture. Its trained models showed a local contraction signal, but task MSE was worse than the tuned baseline and the comparison was not a significant win.
- Baseline
- mean test MSE 0.0570859357
- Delta
- +0.0540396322 (idea - baseline)
- Idea
- mean test MSE 0.1111255679
- P value
- 0.05725
Benchmark result
No significant difference vs. the tuned baseline (+94.7%, p=0.0573, wins 2 / 8 paired seeds).
- Benchmark
- Dynamics forecasting
- Model
- rnn_small
- Paired seeds
- 8
- Baseline mean
- 0.0571
- Idea mean
- 0.1111
- Effect (Δ)
- 0.054 (+94.7%; negative = idea better)
- Wins
- 2 / 8 paired seeds
- p-value
- 0.0573 (permutation test, 20 000 shuffles)
- Smallest detectable effect
- ±71.8%
- Mechanism
- Confirmed ✓
- Practical effect
- Inconclusive
- Baseline tuning
- swept over 3 configs
The completed run used 4 epochs and one sampled state per minibatch after an exact-Jacobian 12-epoch attempt exceeded the time limit. The registered dynamics model is a real-valued GRU, testing H=I rather than a genuinely complex or learned state-dependent Hermitian metric; global contraction bounds and continuous-time ODE rollouts were not tested.
How to run: python3 bench_experiment.py
Artifacts
- bench_experiment.py 6.9 KB View Raw
- bench_report.json 3.0 KB View Raw
- experiment.py 4.1 KB View Raw
- report.md 1.5 KB View
- report_bench_2026-09-01T022029.md 4.5 KB View
- results.json 2.8 KB View Raw