△ Mechanism confirmed, baseline not beaten 2026

Hermitian Contraction Regularizer for Complex Neural Dynamics

Implementation & benchmark of arXiv:2608.07551 — Contraction Analysis of Holomorphic Dynamical Systems via the Intrinsic Kobayashi Metric

Usefulness8/10
Difficulty6/10
Novelty7/10

Source paper: Contraction Analysis of Holomorphic Dynamical Systems via the Intrinsic Kobayashi Metric arXiv:2608.07551 ⓘ · analyzed Sep 1, 2026

AI-generated research hypothesis, automatically tested. Not peer-reviewed.

Idea description

Constrain the Jacobian of a complex-valued neural ODE or recurrent state update so that it is contracting in a state-dependent Hermitian metric. The resulting model should forget perturbations and initialization differences exponentially, improving long-horizon rollout stability while retaining coordinate-invariant stability information.

Formulas

$$\dot H(z,t)+J(z,t)^*H(z,t)+H(z,t)J(z,t)\preceq-2\alpha H(z,t),\qquad H(z,t)=H(z,t)^*\succ0.$$
$$V(t)=\delta z(t)^*H(z(t),t)\delta z(t),\qquad \dot V(t)\le-2\alpha V(t),\qquad V(t)\le e^{-2\alpha t}V(0).$$
$$d_H(z_1(t),z_2(t))\le\sqrt{\frac{M}{m}}e^{-\alpha t}d_H(z_1(0),z_2(0)),\qquad mI\preceq H\preceq MI.$$

Mathematical statement

Let $z\in\mathbb{C}^{n}$ be the hidden state, $\dot z=f_\theta(z,t)$ a holomorphic vector field, and $J(z,t)=\partial f_\theta/\partial z$ its complex Jacobian. Let $H(z,t)=H(z,t)^*\succ0$ be a Hermitian metric and define $V(\delta z,z)=\delta z^*H(z,t)\delta z$ for an infinitesimal displacement $\delta z$. Along $\dot{\delta z}=J\delta z$, the sufficient contraction condition is $\dot H+J^*H+HJ\preceq-2\alpha H$ for rate $\alpha>0$, where $\dot H$ is the directional derivative of $H$ along the state trajectory and $J^*$ is the conjugate transpose. If $mI\preceq H\preceq MI$ on a forward-invariant set, the induced distance contracts at rate $\alpha$ up to the factor $\sqrt{M/m}$.

Implementation notes

Use a complex-valued neural ODE, continuous-time state-space model, or complex RNN with hidden dynamics $\dot z=f_\theta(z,x,t)$. Parameterize the metric as $H_\phi(z)=R_\phi(z)^*R_\phi(z)+\epsilon I$, with $\epsilon>0$, or start with a constant diagonal positive metric for the minimum viable experiment. For each minibatch of states, compute $f$, the complex Jacobian $J$ using automatic differentiation, and the directional derivative $\dot H$; form $C=\dot H+J^*H+HJ+2\alpha H$ and add $\lambda_H\max(0,\lambda_{\max}(H^{-1/2}CH^{-1/2}))^2$ to the task loss. Alternatively reduce the ODE solver step when the largest generalized eigenvalue violates the target bound. Jacobians, matrix products, and eigenvalues are computed directly; the invariant region and global metric bounds $m,M$ are estimated from sampled states or interval bounds. The first cheap experiment should train a two-layer complex neural ODE on damped-oscillator trajectory prediction, comparing ordinary MSE training, spectral-Jacobian regularization, and the Hermitian penalty. Perturb initial states and fit the semilog slope of pairwise distances. The prediction is that the observed slope is no greater than $-\alpha$ after transients, within 20% of the sampled certificate. Sweeping penalty strength should reveal a transition when the maximum sampled generalized eigenvalue crosses zero: beyond that boundary perturbations decay, while below it they can persist or amplify.

Verification

Mechanism confirmed, baseline not beaten

Stage 1 · Toy mechanism gate: Passed ✓

Stage 2 · Mechanism transferred to benchmark: Confirmed ✓

Stage 2 · Practical benchmark result: Inconclusive

Methodology: 8 paired seeds, permutation test (p<0.05) against a learning-rate-tuned baseline. How verification works

Stage 1 — Mechanism check agent confidence 9/10

Built a complex linear-dynamics MVP with a Hermitian contraction certificate and a CUDA mini-training comparison. The certificate matched 2(alpha-gamma), the contraction boundary matched gamma=alpha across five alpha values, perturbation slopes matched -gamma, and the result was invariant under a fixed nonidentity metric. The mechanism is real, but this experiment did not demonstrate a practical improvement over baseline because both models already learned strongly contracting dynamics.

Agent confidence
9/10
Baseline
MSE 1.0216e-08; certificate -0.74118; t=8 perturbation ratio 0.172112
Idea
MSE 9.0231e-09; certificate -0.74118; t=8 perturbation ratio 0.172109; lambda_H=2.0
Math predictions
Certificate agreement was at floating-point precision across 9 gamma values; observed alpha-boundaries matched predictions on all 5 tested alpha values; observed slopes matched -gamma; identity and nonidentity metrics both gave certificate -0.34.

Limitations: The MVP uses constant metrics rather than a learned state-dependent metric, and a 2D complex linear system rather than a nonlinear neural ODE. It does not test nonlinear long-horizon forecasting, adaptive solvers, global metric bounds, or whether regularization rescues an unstable baseline.

How to run: python3 experiment.py

Stage 2 — Benchmark vs. tuned baseline (arXiv:2608.07551)

No significant difference vs. the tuned baseline (+94.7%, p=0.0573, wins 2 / 8 paired seeds).

Benchmark
Dynamics forecasting
Model
rnn_small
Paired seeds
8
Baseline mean
0.0571
Idea mean
0.1111
Effect (Δ)
0.054 (+94.7%; negative = idea better)
Wins
2 / 8 paired seeds
p-value
0.0573 (permutation test, 20 000 shuffles)
Smallest detectable effect
±71.8%
Mechanism
Confirmed ✓
Practical effect
Inconclusive
Baseline tuning
swept over 3 configs
Limitations:

The completed run used 4 epochs and one sampled state per minibatch after an exact-Jacobian 12-epoch attempt exceeded the time limit. The registered dynamics model is a real-valued GRU, testing H=I rather than a genuinely complex or learned state-dependent Hermitian metric; global contraction bounds and continuous-time ODE rollouts were not tested.

How to run: python3 bench_experiment.py

Verdict computed by deterministic test code from paired-seed statistics — not by the language model.

Stage 2 — Benchmark latest Failed ✗

Agent confidence: 9/10

The Hermitian contraction intervention was evaluated on the structurally matched registered dynamics track using the shared rnn_small architecture. Its trained models showed a local contraction signal, but task MSE was worse than the tuned baseline and the comparison was not a significant win.

Baseline
mean test MSE 0.0570859357
Delta
+0.0540396322 (idea - baseline)
Idea
mean test MSE 0.1111255679
P value
0.05725

Benchmark result

No significant difference vs. the tuned baseline (+94.7%, p=0.0573, wins 2 / 8 paired seeds).

Benchmark
Dynamics forecasting
Model
rnn_small
Paired seeds
8
Baseline mean
0.0571
Idea mean
0.1111
Effect (Δ)
0.054 (+94.7%; negative = idea better)
Wins
2 / 8 paired seeds
p-value
0.0573 (permutation test, 20 000 shuffles)
Smallest detectable effect
±71.8%
Mechanism
Confirmed ✓
Practical effect
Inconclusive
Baseline tuning
swept over 3 configs
Limitations:

The completed run used 4 epochs and one sampled state per minibatch after an exact-Jacobian 12-epoch attempt exceeded the time limit. The registered dynamics model is a real-valued GRU, testing H=I rather than a genuinely complex or learned state-dependent Hermitian metric; global contraction bounds and continuous-time ODE rollouts were not tested.

How to run: python3 bench_experiment.py

Artifacts

Implementation overview ⬇ Download all as ZIP 6 files · code, reports and structured results