Unverified 2026

Near-Return Entropy Monitor for Recurrent Latent Dynamics

Implementation & benchmark of arXiv:2608.12165 — Shadowing in the presence of singularities: oriented versus standard shadowing, entropy and the structure of recurrent sets

Usefulness6/10
Difficulty5/10
Novelty6/10

Source paper: Shadowing in the presence of singularities: oriented versus standard shadowing, entropy and the structure of recurrent sets arXiv:2608.12165 ⓘ · analyzed Sep 1, 2026

AI-generated research hypothesis, automatically tested. Not peer-reviewed.

Idea description

Use the paper's separated near-return criterion as a finite-data certificate that a recurrent or latent dynamical model contains positive-complexity behavior rather than merely noisy prediction error. Detect pairs of nearby trajectories that almost return to their starting points but separate at an intermediate time, then either flag the model for long-horizon unreliability or penalize the number and strength of such events. The monitor is suited to learned world models, RNNs, and neural ODEs where hidden-state recurrence can create unobserved chaotic behavior.

Formulas

$$T<\min\{t_0,T_y\},\qquad t_0<T_x<10T_y,$$
$$d(x,y)\leq\frac{\delta}{2},\quad d(\phi_{T_x}(x),x)\leq\frac{\delta}{2},\quad d(\phi_{T_y}(y),y)\leq\frac{\delta}{2},$$
$$\phi_{[0,T_x]}(x),\phi_{[0,T_y]}(y)\subset B_\delta(\Lambda),\qquad \phi_{t_0}(x)\notin B_{2\eta}(\phi_{[0,T_y]}(y)),$$
$$\widehat h_T(\eta)=\frac{1}{T}\log M_T(\eta),\qquad M_T(\eta)=\max\left\{|S|:S\ \text{is a set of rollouts with}\ \inf_{0\leq t\leq T}d(z_i(t),z_j(t))\geq\eta\ \text{for all }i\neq j\right\}.$$

Mathematical statement

Let phi_t:X->X be a flow on a metric space and Lambda a compact invariant set. The paper's criterion uses points x,y, return times T_x,T_y>0, an intermediate time t_0, and scales delta, eta,T satisfying T<min(t_0,T_y) and t_0<T_x<10T_y. The two trajectories must start close, nearly return, remain near Lambda, and be separated at t_0: d(x,y)<=delta/2, d(phi_{T_x}(x),x)<=delta/2, d(phi_{T_y}(y),y)<=delta/2, both orbit segments lie in B_delta(Lambda), and phi_{t_0}(x) is not in B_{2 eta}(phi_[0,T_y](y)). Under these conditions, the flow has positive topological entropy. A finite neural analogue counts distinguishable rollout branches M(T,eta) and estimates h_hat_T=(1/T) log M(T,eta).

Implementation notes

Integrate the monitor after the hidden-state rollout of an RNN, SSM, neural ODE, or learned world model. Collect K short trajectories from nearby latent initial states x_j, using the same input sequence when evaluating a predictive model. Detect approximate returns by finding T_x and T_y for which ||z(T_x)-z(0)|| and ||z'(T_y)-z'(0)|| are at most delta/2, while the initial distance is at most delta/2. For each candidate pair, search t_0<T_x and test whether z(t_0) stays at least 2 eta from every sampled point on the second trajectory; reject candidates whose paths leave a chosen neighborhood B_delta(Lambda), estimated as the empirical support of latent states. Build a graph connecting two rollouts when their minimum separation over [0,T] is below eta, and greedily compute a maximal separated set M_T(eta). The paper supplies the near-return, time-scale, and separation conditions implying positive topological entropy; M_T and h_hat_T are empirical finite-horizon approximations. First test a GRU and a 2D neural ODE on Lorenz-63 prediction and damped-oscillator prediction, using teacher-forced training followed by free rollout. Compare ordinary MSE training with a penalty on detected certificate events or early stopping when h_hat_T exceeds a threshold. The quantitative prediction is that certificate events should coincide with a positive slope of log M_T(eta) versus T, namely log M_T(eta) approximately hT+C with h>0. Stable oscillator baselines should show bounded M_T and slope statistically compatible with zero, while chaotic models should show a persistent positive slope and rapidly growing long-horizon error.

Verification

This idea has not been verified yet.

Verification happens in two stages: Stage 1 — a mechanism check on a toy system confirms the claimed mathematical phenomenon reproduces; Stage 2 — a benchmark implements the idea on a real (small) neural network task and compares it against a tuned baseline over 8 paired seeds with a permutation test.

Artifacts

Artifacts unavailable.