# Bethe-Salpeter Instability Monitor

- ID: 1793
- Canonical URL: https://synthcore.org/idea/1793/bethe-salpeter-instability-monitor
- API JSON: https://synthcore.org/api/idea/1793.json
- API Markdown: https://synthcore.org/api/idea/1793.md
- Verification status: failed_benchmark
- Source: [arXiv:2608.04497](https://arxiv.org/abs/2608.04497)
- Category: dynamics
- Solves: stability, scalability
- ML areas: rnn, ssm, training-dynamics, optimizer
- Math tags: statistical-mechanics, dynamical-systems, linear-algebra, spectral-theory, control-theory
- Ratings: usefulness 7/10; difficulty 5/10; novelty 8/10

## Idea description

Add a response-spectrum monitor to recurrent, state-space, or deep-equilibrium networks by treating products of hidden features as composite observables. Estimate the full susceptibility and a bare susceptibility, reconstruct an irreducible interaction vertex, and damp the state update whenever the leading Bethe–Salpeter eigenvalue approaches one. This targets collective failure modes that ordinary single-feature Jacobian checks can miss.

## Mathematical statement

For composite observables \(z_a(x)\), where index \(a\) labels a feature pair, spatial location, channel, or low-rank tensor component, define the connected susceptibility \(\chi_{ab}=\mathbb{E}[(z_a-\mathbb{E}z_a)(z_b-\mathbb{E}z_b)]\). Let \(\chi_0\) be a bare susceptibility estimated from products of two-point feature covariances or a frozen linearized model. The irreducible vertex is \(\Gamma=\chi_0^{-1}-\chi^{-1}\). Define the symmetrized Bethe–Salpeter kernel \(K=\chi_0^{1/2}\Gamma\chi_0^{1/2}\). The response grows strongly when its largest eigenvalue \(\rho(K)\) approaches one. Use the criterion \(\rho(K)\leq 1-\delta\), with safety margin \(\delta>0\), to set the relaxation coefficient of the iterative neural update.

## Key formulas

- $$\chi_{ab}=\mathbb{E}\left[(z_a-\mathbb{E}z_a)(z_b-\mathbb{E}z_b)\right],\qquad \Gamma=\chi_0^{-1}-\chi^{-1}.$$
- $$\chi=(\chi_0^{-1}-\Gamma)^{-1},\qquad K=\chi_0^{1/2}\Gamma\chi_0^{1/2}.$$
- $$\rho(K)\to 1^-\quad\Longrightarrow\quad \|\chi\|\sim \frac{1}{1-\rho(K)}.$$
- $$x_{t+1}=x_t+\alpha_t\left(F_\theta(x_t)-x_t\right),\qquad \alpha_t=\alpha_0\min\left(1,\frac{1-\delta}{\max(\rho(K_t),\epsilon)}\right).$$

## Implementation notes

First integrate this into a recurrent layer, SSM transition, or deep-equilibrium fixed-point solver. During each monitoring interval, form composite observables using random projections, for example \(z_a=(u_a^\top h)(v_a^\top h)\), where \(h\) is the hidden state and \(u_a,v_a\) are fixed Gaussian vectors; use 128–512 projections for an MVP. Maintain an exponential moving average of the mean and covariance \(\chi\). Estimate \(\chi_0\) from the covariance of the individual projected features, add ridge \(\epsilon I\), and compute matrix-vector products with \(K=\chi_0^{1/2}(\chi_0^{-1}-\chi^{-1})\chi_0^{1/2}\). Estimate the largest eigenvalue using 5–10 Lanczos iterations, then set the relaxation coefficient to \(\alpha_t=\alpha_0\min(1,(1-\delta)/(\rho(K_t)+\epsilon))\). The paper supplies the susceptibility/vertex identity, ladder reconstruction, and unity-eigenvalue instability criterion; the covariances and eigenvalue are estimated empirically with shrinkage and low-rank methods. First test a 2-layer GRU or 1D SSM on copy and adding tasks at sequence lengths 1,000–10,000, comparing undamped and monitored updates. The prediction is \(\|\chi\|\propto(1-\rho(K))^{-1}\), with divergence beginning when measured \(\rho(K)\) reaches one within approximately 20 percent.

## Verification

- Status: failed_benchmark
- Mechanism evidence: yes
- Mechanism confirmed: no
- Practical verdict: harms
- Verdict: Built a self-contained Bethe–Salpeter monitor MVP plus controlled numerical verification and a small recurrent fixed-point experiment. The controlled sweep confirmed eigenvalue recovery to 5.6e-16 absolute error, inverse-gap response scaling within 0.81% over rho=0..0.95, and the zero-vertex limit exactly. In the fair recurrent toy run, monitored relaxation reduced final squared state error from 0.1363 to 9.33e-6, indicating a promising stabilization signal, though this comparison is secondary to the verified mechanism.

### Mechanism check

- Verdict: Built a self-contained Bethe–Salpeter monitor MVP plus controlled numerical verification and a small recurrent fixed-point experiment. The controlled sweep confirmed eigenvalue recovery to 5.6e-16 absolute error, inverse-gap response scaling within 0.81% over rho=0..0.95, and the zero-vertex limit exactly. In the fair recurrent toy run, monitored relaxation reduced final squared state error from 0.1363 to 9.33e-6, indicating a promising stabilization signal, though this comparison is secondary to the verified mechanism.
- Confidence: 8/10
- Limitations: The recurrent experiment uses a lightweight scalar proxy for the full empirical Bethe–Salpeter covariance rather than Lanczos/random-projection monitoring at production scale. It tests neither GRU/SSM copy or adding tasks nor sequence lengths 1,000–10,000, has no multi-seed statistics, and does not test behavior after rho exceeds one.

### Practical benchmark

- Paired seeds: 8
- Baseline mean: 0
- Idea mean: 0
- p-value: 0.0081
- Paired wins: 0/8
- Benchmark verdict: idea worse (significant)

## Artifacts

- [bethe_monitor_experiment.py](https://synthcore.org/code/669/bethe_monitor_experiment.py)
- [report.md](https://synthcore.org/code/669/report.md)
- [report_bench_2026-08-31T213123.md](https://synthcore.org/code/669/report_bench_2026-08-31T213123.md)
- [results.json](https://synthcore.org/code/669/results.json)
- [stage2_bench.py](https://synthcore.org/code/669/stage2_bench.py)
- [stage2_report.json](https://synthcore.org/code/669/stage2_report.json)
- [Download all files as ZIP](https://synthcore.org/download/669)

## Disclaimer

AI-generated research hypothesis, automatically tested. Not peer-reviewed.