Riccati-Gated Observation Skipping
Implementation & benchmark of arXiv:2609.02010 — Efficient Sensor Fusion Through Covariance-Constrained Observation Decimation (CCOD)
Source paper: Efficient Sensor Fusion Through Covariance-Constrained Observation Decimation (CCOD) arXiv:2609.02010 ⓘ · analyzed Sep 3, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Add an uncertainty-aware observation scheduler to a neural state-space model or recurrent world model. Between expensive observation-encoder updates, propagate the latent state using the learned dynamics; periodically compute a decimated Riccati prediction and choose the largest skip length whose predicted covariance remains below a task-specific bound. This replaces a fixed observation stride with a principled, state-dynamics-dependent schedule.
Formulas
Mathematical statement
Let the latent state satisfy z_(t+1) = f_theta(z_t,u_t) + w_t, with observation y_t = h_theta(z_t) + v_t, process-noise covariance Q positive semidefinite, and observation-noise covariance R positive definite. Around the current latent trajectory, define A as the Jacobian of f_theta with respect to z and H as the Jacobian of h_theta with respect to z. For an integer skip factor d, the equivalent dynamics over d prediction steps are A_d = A^d and Q_d = sum from j=0 to d-1 of A^j Q (A^j)^T. The predicted steady-state prior covariance P_d is the stabilizing solution of the decimated discrete algebraic Riccati equation P_d = A_d P_d A_d^T - A_d P_d H^T (H P_d H^T + R)^(-1) H P_d A_d^T + Q_d. Choose the maximum d such that a scalar uncertainty functional g(P_d), such as the largest eigenvalue or trace, is no greater than a threshold tau. The construction assumes that the local pair (A_d,H) is detectable and that the neural dynamics are approximately linear over the skip interval.
Implementation notes
1. Exact integration point: use a recurrent state-space model with latent update z_(t+1) = f_theta(z_t,u_t) and an expensive observation pathway e_t = Encoder_phi(y_t). Run the observation pathway only when the scheduler requests an update; otherwise roll out f_theta for d steps. Maintain a diagonal covariance P for the first implementation, then test a low-rank-plus-diagonal version. 2. Pseudocode: at every scheduling time, evaluate the latent Jacobian A using automatic differentiation, estimate H from the observation head, and estimate Q from the moving covariance of one-step latent residuals z_(t+1) - f_theta(z_t,u_t). Estimate R from sensor residuals or learn a positive diagonal parameter. For each candidate d from 1 through d_max, compute A_d by repeated multiplication, accumulate Q_d using Q_d <- Q_d + A^(d-1) Q (A^(d-1))^T, solve the Riccati equation by fixed-point iteration, and select the largest feasible d. During skipped steps, propagate P <- A P A^T + Q. After an observation, apply P_plus <- P - P H^T (H P H^T + R)^(-1) H P. 3. Taken directly from the paper are the equivalent matrices, covariance propagation rule, Riccati equation, and covariance-threshold decision. Estimated empirically are local Jacobians, Q, R, and the threshold tau; tau can be calibrated from validation prediction-error quantiles. 4. First cheap experiment: train a GRU or diagonal neural state-space model on Moving-MNIST or Lorenz-96 sequences, using an observation encoder at every frame as baseline. Compare fixed strides d = 1, 2, 4, and 8 against Riccati-gated skipping at equal latent dimensions. Measure encoder calls, rollout error, and empirical latent error covariance. The quantitative prediction is that the selected stride decreases sharply as the largest eigenvalue of A approaches one, and predicted versus empirical g(P_d) should agree within approximately 20 percent when local linearization is accurate. If measured g(P_d) exceeds tau, the next observation interval must use a smaller d.
Verification
Stage 1 · Toy mechanism gate: Failed ✗
Stage 2 · Mechanism transferred to benchmark: Not tested
Stage 2 · Practical benchmark result: Not run
Methodology: Toy-system gate first; the benchmark stage runs only after a pass. How verification works
Stage 1 — Mechanism check agent confidence 9/10
Built a NumPy MVP implementing decimated dynamics/noise covariance, fixed-point Riccati prediction, covariance-threshold stride selection, and a nonlinear toy rollout. The core math was numerically validated: predicted versus empirical largest covariance eigenvalues differed by at most 0.41%, and uncertainty increased with skip length; near-unit dynamics reduced the selected maximum stride from 16 to 14. However, in the toy experiment the adaptive scheduler always selected stride 8, matching fixed stride 8 exactly, so no adaptive performance win or dynamic scheduling benefit was demonstrated.
- Agent confidence
- 9/10
- Baseline
- Stride 1: RMSE 0.1647 +/- 0.0068, 240 encoder calls; fixed stride 4: RMSE 0.1939 +/- 0.0121, 60 calls; fixed stride 8: RMSE 0.2024 +/- 0.0134, 30 calls.
- Idea
- Riccati adaptive: RMSE 0.2024 +/- 0.0134, 30 encoder calls, mean stride 8.0; identical to fixed stride 8 in this stationary toy setup. Math check maximum relative covariance error: 0.0041.
Limitations: This is a known-dynamics, two-dimensional toy system rather than a trained neural state-space model; Jacobian, Q, and R estimation were not learned. The dynamics and uncertainty were stationary, so the adaptive scheduler had no opportunity to vary its stride during a rollout. No GPU, encoder wall-clock timing, Moving-MNIST, or low-rank covariance variant was tested.
How to run: python3 riccati_skip_experiment.py
Verdict computed by deterministic test code from paired-seed statistics — not by the language model.
Artifacts
- report.md 1.6 KB View
- results.json 5.0 KB View Raw
- riccati_skip_experiment.py 6.2 KB View Raw