# Pullback random-attractor monitor

- ID: 2811
- Canonical URL: https://synthcore.org/idea/2811/pullback-random-attractor-monitor
- API JSON: https://synthcore.org/api/idea/2811.json
- API Markdown: https://synthcore.org/api/idea/2811.md
- Verification status: unverified
- Source: [arXiv:2608.29149](https://arxiv.org/abs/2608.29149)
- Category: regularization
- Solves: stability, accuracy, generalization
- ML areas: rnn, ssm, world-model, training-dynamics, regularization
- Math tags: dynamical-systems, stochastic-processes, numerical-analysis, control-theory
- Ratings: usefulness 7/10; difficulty 4/10; novelty 8/10

## Idea description

Use the random-attractor construction as a training and inference diagnostic: initialize latent trajectories far in the past with different states but the same recent noise sequence, then measure whether they contract toward the same current set. This detects whether a stochastic recurrent model has a bounded, reproducible random attractor or instead exhibits discretization-induced divergence and spurious long-term modes.

## Mathematical statement

Let $\Phi_h(\omega,z)$ be the stochastic neural one-step map, $\theta_{-n}\omega$ denote the noise sequence shifted $n$ steps into the past, and $B$ be a bounded set of initial latent states. The pullback image is $A_{n,h}(\omega)=\Phi_h^n(\theta_{-n}\omega,B)$. A random attractor is a family of compact sets $A_h(\omega)$ satisfying invariance $\Phi_h(\omega,A_h(\omega))=A_h(\theta_1\omega)$ and pullback attraction $\operatorname{dist}(A_{n,h}(\omega),A_h(\omega))\to0$. A negative top Lyapunov exponent predicts exponential contraction of the image diameter, $D_{n,h}\approx D_{0,h}e^{\lambda_hnh}$, until the attractor's intrinsic diameter is reached.

## Key formulas

- $$A_{n,h}(\omega)=\Phi_h^n(\theta_{-n}\omega,B),$$
- $$\Phi_h(\omega,A_h(\omega))=A_h(\theta_1\omega),\qquad \operatorname{dist}\!\left(A_{n,h}(\omega),A_h(\omega)\right)\xrightarrow[n\to\infty]{}0,$$
- $$D_{n,h}(\omega)=\max_{i,j}\left\|\Phi_h^n(\theta_{-n}\omega,z_i)-\Phi_h^n(\theta_{-n}\omega,z_j)\right\|\approx D_{0,h}e^{\lambda_hnh}\quad(\lambda_h<0).$$

## Implementation notes

Apply this monitor to a stochastic RNN, state-space world model, or diffusion latent transition model during validation and optionally as a regularizer. The same noise realization must be replayed across different initial states; otherwise ordinary noise variability is confused with pullback attraction. Sample a noise block $\omega_{-n:-1}$ and $K$ initial states $z_{-n}^{(i)}$ from a fixed bounded ball. Run every state through the identical sequence of stochastic updates and compute the pairwise diameter, or an RMS approximation, after every step. Repeat for several noise blocks and record $D_{n,h}$. If a stable attractor is desired, add $L_{\mathrm{attr}}=\sum_{r=r_0}^{R}[\log D_{r+1,h}-\log D_{r,h}-\widehat\lambda_hh]_+^2$, where $[x]_+=\max(x,0)$. Trajectories and diameters are directly computed; the attractor is approximated by the terminal point cloud $A_{R,h}$; the decay exponent is fitted by regressing $\log D_{n,h}$ against $nh$. First experiment: use a two-dimensional noisy RNN on a synthetic damped oscillator with 32 initial states and 128-step histories, comparing Euler-Maruyama at several step sizes with a semi-implicit update. The prediction is exponential pullback contraction whose fitted slope matches the independently measured $\widehat\lambda_h$. Near the stability boundary, the contraction time should grow approximately as $1/|\lambda_h|$; a coarse solver with a spurious positive exponent should show persistent or increasing diameter.

## Disclaimer

AI-generated research hypothesis, automatically tested. Not peer-reviewed.