Stabilize-then-optimize: Feedback transformations as preconditioners in optimal control

arXiv:2607.11835 2026 Dynamics 2 ideas extracted · analyzed Aug 30, 2026

What the math gives to ML

The paper gives a constructive preconditioning principle: before optimizing controls, apply a state-feedback coordinate change so that the uncontrolled state-to-control propagation is replaced by a closed-loop propagation with a much smaller operator norm. In the scalar recurrence example, the finite-horizon propagation norm grows as O(a^N) for an unstable multiplier a>1, while feedback can replace a by a stable closed-loop multiplier. This transfers naturally to recurrent and state-space neural networks by separating each recurrent update into a stabilizing feedback term K h_t and a learned residual/control v_t, then training in residual coordinates. A second transfer is to use the resulting control-to-state norm as a conditioning signal for adaptive gradient scaling.

Ideas from this paper

Failed on benchmark 2026

Feedback-preconditioned recurrent dynamics

Reparameterize a recurrent or state-space layer so that its hidden-state update contains an explicit stabilizing feedback controller, while the neural network learns only a residual control in the feedback coordinates. Choose K to reduce finite-horizon state-propagation amplification, suppressing exploding hidden states and gradients on long sequences.

Useful7/10
Difficulty5/10
Novelty5/10
Paper: Stabilize-then-optimize: Feedback transformations as preconditioners in optimal control arXiv:2607.11835
Unverified 2026

Norm-aware feedback learning-rate preconditioner

Use the feedbacked control-to-state norm as a conditioning diagnostic to adapt the optimizer step applied to recurrent residual outputs. When the estimated horizon amplification is large, reduce or precondition the residual-control update; when feedback makes it small, permit larger updates.

Useful6/10
Difficulty4/10
Novelty6/10
Paper: Stabilize-then-optimize: Feedback transformations as preconditioners in optimal control arXiv:2607.11835