Duality-Calibrated Jacobian Spectrum
Source paper: Duality between the level statistics of Hermitian and non-Hermitian random matrices arXiv:2609.00162 ⓘ · analyzed Sep 2, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Regularize the state-transition or input-output Jacobian of a recurrent, state-space, or implicit neural network so that its complex eigenvalue cloud belongs to a selected non-Hermitian symmetry class and has the corresponding unfolded pair statistics. Combine this statistical-shape constraint with an explicit spectral-abscissa or spectral-radius margin, preventing the network from obtaining good average singular values while remaining highly non-normal and transiently unstable.
Formulas
Mathematical statement
The paper distinguishes Hermitian matrices \(\mathcal H=\mathcal H^\dagger\) from non-Hermitian matrices \(H\), and defines non-Hermitian time-reversal constraints by \(\mathcal T_+H^*\mathcal T_+^{-1}=H\), with unitary \(\mathcal T_+\) and \(\mathcal T_+\mathcal T_+^*=\pm1\), or by \(\mathcal C_+H^{\mathrm T}\mathcal C_+^{-1}=H\), with unitary \(\mathcal C_+\) and \(\mathcal C_+\mathcal C_+^*=\pm1\). These constraints generate distinct universal complex-eigenvalue pair statistics through analytic continuation of the corresponding Hermitian replica sigma model. For a neural state map \(x_{t+1}=f_\theta(x_t,u_t)\), let \(J_t=\partial f_\theta/\partial x_t\), let \(z_i\) be its eigenvalues, and let \(\tilde z_i\) be locally unfolded eigenvalues obtained by dividing distances by the estimated local spectral density. Define \(g_\theta(r)\) as the empirical radial pair-correlation function of \(\tilde z_i\), and \(g_c(r)\) as the class-specific universal curve read from the paper. Optimize the task loss plus a correlation penalty and a spectral-radius margin.
Implementation notes
1. Integration point: apply the method to the recurrent transition matrix of an RNN or SSM, or to minibatch Jacobians of an implicit layer. Start with state widths 64 to 256, where dense eigendecomposition is affordable. 2. Pseudocode: for each batch, compute \(J_t\) by automatic differentiation; for small states, calculate all eigenvalues \(z_i\); estimate the two-dimensional spectral density with a Gaussian kernel; locally unfold eigenvalue coordinates using that density; bin pair distances to obtain \(g_\theta(r)\); evaluate the selected class curve \(g_c(r)\); add the displayed correlation and stability penalties to the task loss; then backpropagate. For larger states, estimate leading eigenvalues with Arnoldi and use randomized Jacobian-vector products. 3. The paper supplies the symmetry classes and universal target statistics; the finite-width density, eigenvalues, and pair histogram are estimated empirically. 4. First experiment: use a small long-horizon sequence-prediction task and compare a vanilla RNN, spectral-radius regularization alone, and this method at equal parameter count and optimizer budget. Ablate the pair-statistics term while retaining the radius margin. Measure rollout loss, transient amplification, and distance to the target correlation curve. 5. Pre-register the signature: increasing \(\lambda_g\) must reduce correlation error monotonically, and the result must remain similar for widths 64, 128, and 256. At matched measured \(\rho(J)\), transient amplification should be lower than with radius-only control. Reject the transfer if pair-correlation error fails to decrease by 30%, long-horizon error fails to improve by 10% over the radius-only baseline, or the inferred class statistics vary substantially with width.
Verification
This idea has not been verified yet.
Verification happens in two stages: Stage 1 — a mechanism check on a toy system confirms the claimed mathematical phenomenon reproduces; Stage 2 — a benchmark implements the idea on a real (small) neural network task and compares it against a tuned baseline over 8 paired seeds with a permutation test.
Artifacts
Artifacts unavailable.