Stabilize-then-optimize: Feedback transformations as preconditioners in optimal control
arXiv:2607.11835
2026
Dynamics
2 ideas extracted · analyzed Aug 30, 2026
What the math gives to ML
The paper gives a constructive preconditioning principle: before optimizing controls, apply a state-feedback coordinate change so that the uncontrolled state-to-control propagation is replaced by a closed-loop propagation with a much smaller operator norm. In the scalar recurrence example, the finite-horizon propagation norm grows as O(a^N) for an unstable multiplier a>1, while feedback can replace a by a stable closed-loop multiplier. This transfers naturally to recurrent and state-space neural networks by separating each recurrent update into a stabilizing feedback term K h_t and a learned residual/control v_t, then training in residual coordinates. A second transfer is to use the resulting control-to-state norm as a conditioning signal for adaptive gradient scaling.
Ideas from this paper
✗ Failed on benchmark
2026
Reparameterize a recurrent or state-space layer so that its hidden-state update contains an explicit stabilizing feedback controller, while the neural network learns only a residual control in the feedback coordinates. Choose K to reduce finite-horizon state-propagation amplification, suppressing exploding hidden states and gradients on long sequences.
Useful7/10
Difficulty5/10
Novelty5/10
Unverified
2026
Use the feedbacked control-to-state norm as a conditioning diagnostic to adapt the optimizer step applied to recurrent residual outputs. When the estimated horizon amplification is large, reduce or precondition the residual-control update; when feedback makes it small, permit larger updates.
Useful6/10
Difficulty4/10
Novelty6/10