Prescribed-Performance Hidden-State Observer
Implementation & benchmark of arXiv:2608.15758 — Output Feedback Adaptive Performance Control
Source paper: Output Feedback Adaptive Performance Control arXiv:2608.15758 ⓘ · analyzed Sep 1, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Add an auxiliary prescribed-performance observer to a recurrent or state-space neural network so that latent prediction errors are estimated from observable output residuals rather than relying only on backpropagation through long histories. The observer uses a transformed normalized innovation and gains that change with the desired error envelope, allowing fast early correction without permanently using a large unstable gain. It can operate online during inference or provide an auxiliary consistency loss during training.
Formulas
Mathematical statement
Let $e_1(t)=y(t)-y_d(t)$ be the observable scalar output-tracking error, let $\hat e_i$ estimate the $i$th error derivative or latent error coordinate, and let $r(t)=(r(0)-r_\infty)e^{-l_ot}+r_\infty$ be the prescribed envelope, with $r_\infty>0$ and $l_o>0$. Define the normalized innovation $\xi=(e_1-\hat e_1)/r(t)$ and transformed innovation $T(\xi)=\log((1+\xi)/(1-\xi))$ for $|\xi|<1$. The PPO dynamics are $\dot{\hat e}_i=\hat e_{i+1}+\gamma_i r(t)T(\xi)/r_\infty^i$ for $i<n$ and $\dot{\hat e}_n=\gamma_n r(t)T(\xi)/r_\infty^n$, where every gain $\gamma_i>0$. The neural discrete implementation uses Euler integration and targets the safety condition $|e_1-\hat e_1|<r(t)$.
Implementation notes
Integrate the method into a GRU, small diagonal state-space model, or recurrent world model that produces prediction $\hat y_k$ and hidden state $h_k$. Define $e_{1,k}=y_k-\hat y_k$ and maintain observer variables $\hat e_{1:n,k}$ outside the main network. Optionally correct the recurrent state with $h_{k+1}=F_\theta(h_k,x_k)+K_\theta(\hat e_{1,k}-e_{1,k})$. At each step initialize or update $r_k=(r_0-r_\infty)e^{-l_ok}+r_\infty$, calculate $\xi_k=(e_{1,k}-\hat e_{1,k})/r_k$, clamp it to $[-1+\epsilon,1-\epsilon]$, compute $T_k=\log((1+\xi_k)/(1-\xi_k))$, and apply the discrete observer equations above. Add the envelope barrier to the task loss; if derivative labels are unavailable, omit the derivative matching term and retain the barrier and one-step output consistency. The formula, transformed innovation, and gain scaling come from the paper; $n$, gains, envelope parameters, and correction gain are hyperparameters estimated by validation. First test on Mackey--Glass prediction and noisy sinusoid tracking with a one-layer GRU against a vanilla GRU and fixed-gain observer. Sweep $l_o$ and $\gamma_i$. Measure normalized error, long-horizon RMSE, transformed-innovation magnitude, and first envelope violation. The prediction is a sharp degradation boundary as $l_o$ or gains increase: stable runs keep $|e_1-\hat e_1|/r_k<1$, while unstable runs show rapidly increasing transformed innovation. Reducing $r_\infty$ should improve accuracy only until this boundary.
Verification
Stage 1 · Toy mechanism gate: Failed ✗
Stage 2 · Mechanism transferred to benchmark: Not tested
Stage 2 · Practical benchmark result: Not run
Methodology: Toy-system gate first; the benchmark stage runs only after a pass. How verification works
Stage 1 — Mechanism check agent confidence 9/10
Built a NumPy PPO observer with shrinking prescribed envelope, transformed innovation, Euler updates, gain sweep, and a small noisy-sinusoid GRU comparison. The toy check clearly reproduced the claimed behavior: modest gains kept normalized innovation below 0.18, while gains at least 5 reached the clamp and generated large estimates. However, PPO-corrected GRU RMSE was 1.672 versus 0.274 raw GRU and 0.221 for the fixed observer, so no predictive win was observed.
- Agent confidence
- 9/10
- Baseline
- Raw GRU RMSE 0.2743; fixed-gain observer RMSE 0.2207; toy fixed observer max normalized innovation 0.1764
- Idea
- PPO toy max normalized innovation 0.0526 with 0 violations; gain sweep reached |xi|=0.999999 for gains >=5; GRU-corrected RMSE 1.6721, mean |xi| 0.8831, 0 envelope violations
Limitations: Only one fixed random seed, one noisy sinusoid task, one small GRU, and a limited gain sweep were tested. The implementation uses an output-residual correction rather than training the PPO jointly as an auxiliary loss, and no Mackey-Glass, long-horizon rollout, FLOP, or multi-seed study was performed.
How to run: python3 ppo_observer_experiment.py
Verdict computed by deterministic test code from paired-seed statistics — not by the language model.
Artifacts
- ppo_observer_experiment.py 6.1 KB View Raw
- report.md 1.4 KB View
- results.json 1.2 KB View Raw