Stabilizer Design for Policy Iteration in Stochastic Linear Quadratic Control: A Spectrum-Assignment Approach
arXiv:2608.05953
2026
Dynamics
1 ideas extracted · analyzed Aug 31, 2026
What the math gives to ML
The paper develops a stability certificate for stochastic linear dynamics with state- and control-dependent multiplicative noise, where ordinary Hurwitz stability of the drift is insufficient. Its transferable asset is the stochastic Lyapunov operator, which combines drift contraction and diffusion amplification into one matrix inequality. A practical neural-network adaptation is to use this operator as a continuation-based initializer and regularizer for linear recurrent or state-space modules: first stabilize the drift-only system, then gradually increase the modeled multiplicative-noise strength while preserving a Lyapunov margin. This is most natural for architectures with an explicit linear state transition and could improve robustness against noisy or perturbed hidden dynamics.
Ideas from this paper
Unverified
2026
Initialize and train a linear recurrent or state-space transition using the stochastic Lyapunov operator rather than only constraining the drift matrix to be Hurwitz. Start from a controller that stabilizes the drift-only dynamics, then continuously increase the multiplicative-noise coefficient and update the controller while enforcing a positive-definite Lyapunov certificate. The resulting module should avoid exploding hidden states when process noise depends on the hidden state or input.
Useful5/10
Difficulty5/10
Novelty6/10