Learning to control switching nonlinear systems with Koopman operator regression
arXiv:2607.11344
2026
Dynamics
1 ideas extracted · analyzed Aug 30, 2026
What the math gives to ML
The paper's transferable asset is a hybrid Koopman representation: nonlinear state evolution is approximated by a linear operator whose matrix depends on a discrete action. This creates a compact, explicitly multi-step-predictable world model without requiring a fully nonlinear recurrent predictor, while retaining action-conditioned switching structure. The most promising neural-network use is to replace or augment a learned latent dynamics model with one Koopman matrix per action and train the encoder jointly using short-horizon prediction plus long-horizon rollout losses. The resulting model can support cheap planning, stable imagination, and interpretable diagnosis of which action causes instability.
Ideas from this paper
Unverified
2026
Encode observations into a latent state in which each discrete action applies a separate linear Koopman transition matrix. Train the encoder and matrices from replay data, then use repeated matrix multiplication for multi-step prediction instead of recursively evaluating a nonlinear dynamics network. This is especially suitable for discrete-action model-based RL, where action-conditioned linear operators provide cheap rollouts and expose unstable action/state combinations.
Useful6/10
Difficulty5/10
Novelty6/10