Beyond linear subspaces: Nonlinear moment matching meets quadratic manifolds
arXiv:2608.19486
2026
Architecture
1 ideas extracted · analyzed Sep 1, 2026
What the math gives to ML
The paper provides a constructive quadratic-manifold reduction framework in which a state is represented by a linear term plus a quadratic Kronecker feature, and projection matrices are chosen to preserve nonlinear moments and the center-manifold mapping of a dynamical system. The transferable asset is not merely a larger decoder, but an explicit low-dimensional manifold whose tangent and curvature can represent transport-dominated or otherwise poorly linearly compressible trajectories. A practical neural analogue is a quadratic bottleneck decoder or latent dynamical model, trained with both reconstruction loss and a center-manifold invariance residual so that the quadratic coordinates preserve steady-state responses rather than only pointwise state error.
Ideas from this paper
✗ Failed on benchmark
2026
Replace a conventional linear decoder in an autoencoder or latent state-space model with an explicit quadratic manifold decoder, allowing a small latent vector to represent curved and transport-like state trajectories. Add a dynamics-aware invariance loss that penalizes the discrepancy between the time derivative of the quadratic manifold and the neural dynamics evaluated on that manifold.
Useful7/10
Difficulty5/10
Novelty6/10