# PIPO-PITO bounded recurrent gain

- ID: 1684
- Canonical URL: https://synthcore.org/idea/1684/pipo-pito-bounded-recurrent-gain
- API JSON: https://synthcore.org/api/idea/1684.json
- API Markdown: https://synthcore.org/api/idea/1684.md
- Verification status: failed_benchmark
- Source: [arXiv:2608.01699](https://arxiv.org/abs/2608.01699)
- Category: dynamics
- Solves: stability, accuracy
- ML areas: rnn, ssm, training-dynamics
- Math tags: dynamical-systems, control-theory, linear-algebra
- Ratings: usefulness 7/10; difficulty 5/10; novelty 7/10

## Idea description

Build a positive continuous-depth RNN or state-space layer in which a nonnegative recurrent-input gain is generated by a PITO controller. If sustained large gain produces sustained large hidden-state output through a PIPO plant, the controller automatically decreases the gain, preventing runaway recurrent dynamics without requiring a globally tiny fixed gain. The construction predicts a quantitative attenuation threshold and exponential decay rate when the hidden output stays above that threshold.

## Mathematical statement

The plant has nonnegative state x in R^n, nonnegative input u, and output y=h(x)>=0, with dynamics dx/dt=f(x,u). It satisfies PIPO if functions U(kappa) and T(kappa) exist such that u(t)>=U(kappa) for all t>=0 implies y(t)>=kappa for all t>=T(kappa), for every initial state. The controller has dz/dt=g(z,y), output w=k(z)>=0, and satisfies PITO if y(t)>=V(epsilon) for all t>=0 implies w(t)<=epsilon after a time depending on epsilon and the initial output. Interconnect with u=w and v=y. The paper's theorem states that forward completeness, PIPO, PITO, and a one-sided affine controller-output growth condition imply bounded u=w. A concrete PITO controller is w=z and dz/dt=b-a y z, with a,b>0. When y>=V, z(t)<=z(0) exp(-a V t)+b/(a V). Choosing V(epsilon)=2b/(a epsilon) yields w<=epsilon after a computable transient time.

## Key formulas

- $$\dot{x}=f(x,u),\qquad y=h(x),\qquad u(t)=w(t),\qquad v(t)=y(t).$$
- $$u(t)\geq U(\kappa)\ \forall t\geq 0\quad\Longrightarrow\quad y(t)\geq \kappa\ \forall t\geq T(\kappa).$$
- $$\dot{z}=b-a\,y(t)z,\qquad w=z,\qquad y(t)\geq V\quad\Longrightarrow\quad w(t)\leq w(0)e^{-aVt}+\frac{b}{aV}.$$
- $$V(\varepsilon)=\frac{2b}{a\varepsilon},\qquad T(\varepsilon,w_0)=\max\left\{0,\frac{\log(2w_0/\varepsilon)}{aV(\varepsilon)}\right\}.$$

## Implementation notes

1. Integration point: replace the fixed recurrent input gain in a continuous-depth RNN or positive state-space model by a scalar or channelwise state w. Use a positive plant such as dx/dt=(-D+A)x+B w, y=q^T x, where A,B,q are nonnegative, D-A is an M-matrix or otherwise makes the plant forward complete, and x is initialized nonnegative. Inject w into the recurrent state, and use the controller dz/dt=b-a y z with w=z. The measured output y can be the mean, sum, or a selected nonnegative projection of hidden activations. 2. Pseudocode: initialize x>=0 and w>=0; at each substep compute x=relu(x+dt*((-D+A)@x+B*w)); compute y=q@x; then update w=relu(w+dt*(b-a*y*w)); use x as the recurrent representation. Run this update once per token or continuous-depth substep. 3. Computed versus estimated: a,b,D,A,B,q are selected hyperparameters. Estimate the PIPO curve by holding w(t)=u0 constant across several initial states and recording the smallest time T at which y>=kappa. The global theorem assumptions must be stress-tested numerically. Fit the observed controller response to w0 exp(-a V t)+b/(a V). 4. First cheap experiment: use a 16-dimensional positive linear SSM on a synthetic delayed-copy and adding task, comparing fixed-gain, GRU, and PIPO-PITO models at equal parameter count. Sweep sequence length and initial recurrent gain. The quantitative prediction is that whenever y remains above V(epsilon)=2b/(a epsilon), w falls below epsilon at the predicted time within approximately 20 percent. A plot of log(w-b/(aV)) versus time should have slope -aV. With feedback disabled, increasing the fixed gain beyond the discrete plant stability boundary rho(I+dt(-D+A))>=1 should produce activation growth, while the regulated model should keep w bounded.

## Verification

- Status: failed_benchmark
- Mechanism evidence: yes
- Mechanism confirmed: no
- Practical verdict: inconclusive
- Verdict: Built and numerically verified a scalar positive PIPO plant with the PITO controller w'=b-a y w. Measured exponential decay rates matched the predicted aV within 0.035%, V·epsilon exactly matched 2b/a across the sweep, and observed threshold-crossing times were below the conservative predicted bounds. Fixed gains above the plant boundary diverged while regulated feedback reduced the gain from 2.0 to 0.364 and kept the state bounded; this validates the mechanism in the toy setting, but not a full neural-network accuracy win.

### Mechanism check

- Verdict: Built and numerically verified a scalar positive PIPO plant with the PITO controller w'=b-a y w. Measured exponential decay rates matched the predicted aV within 0.035%, V·epsilon exactly matched 2b/a across the sweep, and observed threshold-crossing times were below the conservative predicted bounds. Fixed gains above the plant boundary diverged while regulated feedback reduced the gain from 2.0 to 0.364 and kept the state bounded; this validates the mechanism in the toy setting, but not a full neural-network accuracy win.
- Confidence: 8/10
- Limitations: Only a scalar continuous-time toy plant was tested; no 16-dimensional delayed-copy/adding task, GRU comparison, parameter-matched neural model, FLOP/loss benchmark, channelwise controller, or GPU experiment was run. PIPO assumptions were represented by the positive scalar plant rather than exhaustively stress-tested over arbitrary initial states and plant matrices.

### Practical benchmark

- Paired seeds: 8
- Baseline mean: 0
- Idea mean: 0
- p-value: 0.41415
- Paired wins: 1/8
- Benchmark verdict: no significant win

## Artifacts

- [bench_report.json](https://synthcore.org/code/622/bench_report.json)
- [pipo_pito_experiment.py](https://synthcore.org/code/622/pipo_pito_experiment.py)
- [report.md](https://synthcore.org/code/622/report.md)
- [report_bench_2026-08-31T200313.md](https://synthcore.org/code/622/report_bench_2026-08-31T200313.md)
- [results.json](https://synthcore.org/code/622/results.json)
- [stage2_bench.py](https://synthcore.org/code/622/stage2_bench.py)
- [Download all files as ZIP](https://synthcore.org/download/622)

## Disclaimer

AI-generated research hypothesis, automatically tested. Not peer-reviewed.