Learning neural controllers for nonlinear systems from data
arXiv:2608.29303
2026
Dynamics
3 ideas extracted · analyzed Sep 1, 2026
What the math gives to ML
The paper offers a constructive pipeline for learning feedback policies for unknown nonlinear dynamics: identify a model from offline data, jointly synthesize a neural controller and neural Lyapunov function, enforce inputs with hard saturation, and certify the result using SMT plus local Lyapunov analysis. The transferable asset is a closed-loop certificate that turns policy learning into a falsifiable decrease-condition problem. A strong neural-network transfer is to train policies or recurrent state updates together with an energy function whose one-step change is negative on a specified region, while explicitly accounting for model-identification error. The most useful experimental signature is a certified region of attraction and a sharp failure boundary when the Lyapunov decrease margin becomes nonpositive.
Ideas from this paper
✗ Mechanism failed
2026
Train a neural policy together with a positive neural Lyapunov function so that the learned closed-loop transition decreases the function at every sampled state in a prescribed operating region. This converts policy learning from an unconstrained reward problem into a constrained dissipativity problem and provides an inference-time monitor that can reject or damp actions when the certificate is violated.
Useful8/10
Difficulty5/10
Novelty6/10
✗ Mechanism failed
2026
Require Lyapunov decrease not only under the nominal learned transition, but throughout a bounded uncertainty set around that transition. The policy is therefore optimized against identification error and distribution shift rather than trusting a potentially overconfident world model.
Useful7/10
Difficulty6/10
Novelty7/10
Unverified
2026
Build actuator or parameter constraints directly into the neural controller using a differentiable hard-saturation map rather than penalizing violations after the fact. This makes the Lyapunov certificate apply to the actual bounded controller and prevents training from exploiting unrealistically large actions.
Useful6/10
Difficulty3/10
Novelty4/10