Learning neural controllers for nonlinear systems from data

arXiv:2608.29303 2026 Dynamics 3 ideas extracted · analyzed Sep 1, 2026

What the math gives to ML

The paper offers a constructive pipeline for learning feedback policies for unknown nonlinear dynamics: identify a model from offline data, jointly synthesize a neural controller and neural Lyapunov function, enforce inputs with hard saturation, and certify the result using SMT plus local Lyapunov analysis. The transferable asset is a closed-loop certificate that turns policy learning into a falsifiable decrease-condition problem. A strong neural-network transfer is to train policies or recurrent state updates together with an energy function whose one-step change is negative on a specified region, while explicitly accounting for model-identification error. The most useful experimental signature is a certified region of attraction and a sharp failure boundary when the Lyapunov decrease margin becomes nonpositive.

Ideas from this paper

Mechanism failed 2026

Lyapunov-Certified Policy Training

Train a neural policy together with a positive neural Lyapunov function so that the learned closed-loop transition decreases the function at every sampled state in a prescribed operating region. This converts policy learning from an unconstrained reward problem into a constrained dissipativity problem and provides an inference-time monitor that can reject or damp actions when the certificate is violated.

Useful8/10
Difficulty5/10
Novelty6/10
Paper: Learning neural controllers for nonlinear systems from data arXiv:2608.29303
Mechanism failed 2026

Robust Lyapunov Training Under Model Error

Require Lyapunov decrease not only under the nominal learned transition, but throughout a bounded uncertainty set around that transition. The policy is therefore optimized against identification error and distribution shift rather than trusting a potentially overconfident world model.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Learning neural controllers for nonlinear systems from data arXiv:2608.29303
Unverified 2026

Hard-Saturated Neural Feedback

Build actuator or parameter constraints directly into the neural controller using a differentiable hard-saturation map rather than penalizing violations after the fact. This makes the Lyapunov certificate apply to the actual bounded controller and prevents training from exploiting unrealistically large actions.

Useful6/10
Difficulty3/10
Novelty4/10
Paper: Learning neural controllers for nonlinear systems from data arXiv:2608.29303