Latent Reference Governor for Safe SSMs
Implementation & benchmark of arXiv:2607.12178 — Dynamically Feasible Planning and Control in Complex Environments: a Scalable Systematic Approach
Source paper: Dynamically Feasible Planning and Control in Complex Environments: a Scalable Systematic Approach arXiv:2607.12178 ⓘ · analyzed Aug 30, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Insert a reference governor between a neural model's raw latent command and a linear state-space update, so that hidden states and outputs remain inside a prescribed union of polytopes. At every step, choose the largest interpolation toward the desired command whose predicted trajectory remains in the offline safe set. This can prevent hidden-state explosions and invalid latent trajectories without globally shrinking the model's weights.
Formulas
Mathematical statement
Use the discrete-time latent model \(x_{k+1}=Ax_k+Bv_k\) and observable output \(y_k=Cx_k+Dv_k\), where \(x_k\in\mathbb{R}^{n_x}\) is the SSM hidden state, \(v_k\in\mathbb{R}^{n_v}\) is a controllable latent command, and \(y_k\in\mathbb{R}^{n_y}\) is the constrained latent output. Let the non-convex admissible region be \(\mathcal{Y}=\bigcup_{j=1}^M\{y:H_jy\leq h_j\}\). The safe-command set is \(\mathcal{O}_\infty=\{(x,v):y_t\in\mathcal{Y}\ \forall t\geq 0\}\) under constant command \(v\). Given desired command \(r_k\), use \(v_k=v_{k-1}+\alpha_k(r_k-v_{k-1})\), with the largest \(\alpha_k\in[0,1]\) for which \((x_k,v_k)\in\mathcal{O}_\infty\). If \(A\) is Schur stable, \(\rho(A)<1\), and \(r_k\) is strictly admissible, the reference-governor construction guarantees constraint satisfaction and convergence of \(v_k\) to \(r_k\). In a neural implementation, the guarantee is exact only for the identified linear model, so model mismatch must be measured and compensated with constraint margins.
Implementation notes
1. Integration point: use a diagonal or low-dimensional linear SSM block inside an RNN, sequence model, or latent world model. Let its hidden state be \(x_k\) and expose a trainable command \(r_k\) produced by the neural network. Keep the learned state matrices \(A,B,C,D\) fixed during the first experiment, or update their estimates slowly during training. Define axis-aligned or general polytopes for allowable hidden coordinates, output magnitudes, or task-specific latent regions. 2. Pseudocode: precompute an approximate safe set by sampling candidate constant commands \(v\), propagating \(x_{t+1}=Ax_t+Bv\) for \(T\) steps, and retaining candidates satisfying every polytope constraint. Optionally fit a polyhedral union to the retained samples. At inference, compute \(r_k\), search \(\alpha\) on a grid such as \(\{0,0.01,\ldots,1\}\), predict the trajectory for each candidate using the displayed flow equation, reject candidates violating any polytope, and apply the largest surviving \(\alpha\); then update the SSM state. 3. Computed versus estimated: \(A,B,C,D\) and the finite-horizon safe set are computed or fitted offline; the infinite-horizon condition is approximated by checking until \(T\) such that \(\lVert A^T\rVert\) is below a tolerance. Estimate model mismatch by comparing predicted and actual hidden states, and shrink each polytope by a margin proportional to a high quantile of this error. 4. First cheap experiment: use a 2D linear SSM driven by an MLP on a synthetic Adding or Copy task, comparing an unconstrained SSM, a spectral-normalized SSM, and the governor-SSM. Sweep the spectral radius and command jump size. The predicted signature is zero constraint violations for exact-model trajectories initialized in the computed safe set, a sharp failure boundary near \(\rho(A)=1\), and monotone convergence of \(\lVert r_k-v_k\rVert\) toward zero for strictly admissible targets. With finite-horizon approximation, violation probability should decrease as \(T\) increases and \(\lVert A^T\rVert\) decreases.
Verification
This idea has not been verified yet.
Verification happens in two stages: Stage 1 — a mechanism check on a toy system confirms the claimed mathematical phenomenon reproduces; Stage 2 — a benchmark implements the idea on a real (small) neural network task and compares it against a tuned baseline over 8 paired seeds with a permutation test.
Artifacts
Artifacts unavailable.