# Zonotope-Bounded Latent State Space

- ID: 1704
- Canonical URL: https://synthcore.org/idea/1704/zonotope-bounded-latent-state-space
- API JSON: https://synthcore.org/api/idea/1704.json
- API Markdown: https://synthcore.org/api/idea/1704.md
- Verification status: beats_baseline
- Source: [arXiv:2608.02308](https://arxiv.org/abs/2608.02308)
- Category: dynamics
- Solves: stability, accuracy, generalization
- ML areas: rnn, ssm, world-model, training-dynamics
- Math tags: control-theory, dynamical-systems, linear-algebra, spectral-theory
- Ratings: usefulness 8/10; difficulty 6/10; novelty 7/10

## Idea description

Replace a point hidden state in a recurrent or state-space neural network with a zonotope representing all latent states consistent with bounded process and observation errors. Propagate the zonotope through the learned dynamics and intersect it with the set implied by the next observation, producing a corrected uncertainty tube rather than an unconstrained open-loop hidden trajectory. This should improve long-horizon prediction under distribution shift and expose a sharp failure boundary when the reachable-set width grows beyond the observation-correction capacity.

## Mathematical statement

Use the discrete latent model $x_{k+1}=Ax_k+Bu_k+w_k$ and observation model $y_k=Cx_k+v_k$, where $x_k\in\mathbb{R}^{n}$ is the latent state, $u_k$ is the input, $y_k$ is the observed target or feature, $A,B,C$ are learned matrices, and bounded errors satisfy $w_k\in\mathcal{W}=\{w:|w_i|\leq\epsilon_{w,i}\}$ and $v_k\in\mathcal{V}=\{v:|v_i|\leq\epsilon_{v,i}\}$. Represent uncertainty by a zonotope $\mathcal{X}_k=c_k\oplus G_k[-1,1]^r$, with center $c_k$, generator matrix $G_k$, and $r$ independent bounded directions. The exact linear reachable prediction is $\mathcal{X}_{k+1|k}=Ac_k+Bu_k\oplus AG_k[-1,1]^r\oplus\mathcal{W}$. A measurement-consistency set is $\mathcal{Y}_{k+1}=\{x:|Cx-y_{k+1}|\leq\epsilon_v\}$. The corrected estimate is $\mathcal{X}_{k+1|k+1}=\mathcal{X}_{k+1|k}\cap\mathcal{Y}_{k+1}$. For a neural implementation, use a differentiable conservative box or zonotope over-approximation of this intersection. The key quantitative condition is bounded-error consistency: a trajectory is admissible only if every observed residual satisfies $|y_k-Cx_k|\leq\epsilon_v$ for some $x_k\in\mathcal{X}_k$; long-horizon instability is detected through growth of the zonotope width, such as $\|G_k\|$ or coordinate radius $r_k=|G_k|\mathbf{1}$.

## Key formulas

- $$\mathcal{X}_k=c_k\oplus G_k[-1,1]^r,\qquad \mathcal{W}=\{w\in\mathbb{R}^n:|w_i|\leq\epsilon_{w,i}\}.$$
- $$\mathcal{X}_{k+1|k}=A\mathcal{X}_k+Bu_k\oplus\mathcal{W}=(Ac_k+Bu_k)\oplus AG_k[-1,1]^r\oplus\mathcal{W}.$$
- $$\mathcal{Y}_{k+1}=\{x\in\mathbb{R}^n:|Cx-y_{k+1}|\leq\epsilon_v\},\qquad \mathcal{X}_{k+1|k+1}=\mathcal{X}_{k+1|k}\cap\mathcal{Y}_{k+1}.$$
- $$r_{k+1}\lesssim |A|r_k+\epsilon_w,\qquad \text{stable uncertainty tube if }\rho(|A|)<1\text{, where }r_k=|G_k|\mathbf{1}.$$

## Implementation notes

1. Integration point: implement a linear or mildly nonlinear latent SSM inside an RNN or world model. The encoder maps an input window to an initial center $c_0$; a learned diagonal or low-rank generator $G_0$ represents encoder uncertainty. Use $x_{k+1}=Ax_k+Bu_k$ for the first MVP, with spectral normalization or direct parameterization $A=\alpha\bar A/\max(1,\rho(|\bar A|))$ to control open-loop growth. 2. Pseudocode: initialize $(c,G)$; for each time step compute `c_pred=A@c+B@u`; compute `G_pred=concat(A@G, diag(eps_w))`; decode the center and interval $Cc_pred\pm |C||G_pred|$; form the observation-compatible interval by intersecting it with `[y-eps_v,y+eps_v]`; contract the latent box using one step of interval Gauss-Seidel or a pseudoinverse correction; train the decoder prediction loss plus `lambda_width * sum(abs(G))` only when the observation-consistent intersection is nonempty. 3. Computed from the paper's mechanism: Minkowski propagation, bounded-error observation intersection, and reachability consistency. Estimated empirically: $\epsilon_w$ and $\epsilon_v$ from high quantiles of training residuals, generator reduction, and the contraction update. 4. First cheap experiment: compare a vanilla GRU, a deterministic linear SSM, and the zonotope SSM on Lorenz-63 or a noisy pendulum with bounded uniform disturbances, followed by a small permuted-MNIST sequence task. Train all models with equal parameter counts and evaluate 1-, 10-, 25-, and 50-step forecasts. The quantitative prediction is that forecast interval width follows $r_k\approx |A|^k r_0+\sum_{j=0}^{k-1}|A|^j\epsilon_w$; when the largest eigenvalue magnitude crosses one, open-loop width changes from bounded to exponentially growing. With correction, the width should contract after informative observations, and at least 95% of held-out trajectories should remain inside the predicted interval if the disturbance bounds are calibrated correctly. Measure the empirical boundary in a sweep over the spectral radius and compare it with $\rho(|A|)=1$ within 20%.

## Verification

- Status: beats_baseline
- Mechanism evidence: yes
- Mechanism confirmed: no
- Practical verdict: helps
- Verdict: Built and ran a scalar zonotope latent-state MVP with exact Minkowski propagation and exact observation-set intersection. The mechanism manifested: the stability boundary occurred at |a|=1, stable radii matched eps_w/(1-|a|) within 0.006%, unstable log-growth slopes matched log|a| within 0.06%, and corrected radii never exceeded the predicted observation cap eps_v while maintaining 100% coverage. The corrected interval also covered all held-out trajectories, whereas the open-loop point baseline had horizon-25 MAE 0.2183; this verifies the mechanism but not a trained neural-network win.

### Mechanism check

- Verdict: Built and ran a scalar zonotope latent-state MVP with exact Minkowski propagation and exact observation-set intersection. The mechanism manifested: the stability boundary occurred at |a|=1, stable radii matched eps_w/(1-|a|) within 0.006%, unstable log-growth slopes matched log|a| within 0.06%, and corrected radii never exceeded the predicted observation cap eps_v while maintaining 100% coverage. The corrected interval also covered all held-out trajectories, whereas the open-loop point baseline had horizon-25 MAE 0.2183; this verifies the mechanism but not a trained neural-network win.
- Confidence: 9/10
- Limitations: Only a scalar linear system was tested; no multidimensional generator reduction, differentiable neural implementation, learned A/B/C, GRU comparison, Lorenz or pendulum task, distribution shift, speed comparison, or training experiment was evaluated. The observation model used C=1, making the eps_v radius cap exact.

### Practical benchmark

- Paired seeds: 8
- Baseline mean: 0
- Idea mean: 0
- p-value: 0.0081
- Paired wins: 8/8
- Benchmark verdict: idea better (significant)

## Artifacts

- [bench_report.json](https://synthcore.org/code/547/bench_report.json)
- [report.md](https://synthcore.org/code/547/report.md)
- [report_bench_2026-08-31T173356.md](https://synthcore.org/code/547/report_bench_2026-08-31T173356.md)
- [stage2_zonotope_bench.py](https://synthcore.org/code/547/stage2_zonotope_bench.py)
- [zonotope_experiment.py](https://synthcore.org/code/547/zonotope_experiment.py)
- [zonotope_results.json](https://synthcore.org/code/547/zonotope_results.json)
- [Download all files as ZIP](https://synthcore.org/download/547)

## Disclaimer

AI-generated research hypothesis, automatically tested. Not peer-reviewed.