Dynamic Universal Approximation via Signature Controlled Differential Equations

arXiv:2607.13886 2026 Architecture 1 ideas extracted · analyzed Aug 30, 2026

What the math gives to ML

The paper provides a principled way to turn history-dependent dynamics into ordinary controlled differential equations whose state is a path signature, rather than relying on an ad hoc recurrent memory. Its transferable asset is the separation between the control path, the accumulated signature state, and a vector field acting on that state; this gives a continuous-time memory module with explicit truncation and stability knobs. A practical neural adaptation is a truncated signature-controlled CDE in which the signature state summarizes all iterated interactions of the input history up to degree N, while a learned vector field predicts the hidden-state derivative. The main experiment should test whether increasing signature depth improves long-range-memory tasks at comparable parameter count and whether the resulting dynamics are more stable than a standard neural CDE or RNN.

Ideas from this paper

Unverified 2026

Signature-memory neural CDE

Replace an unconstrained recurrent memory with a truncated path-signature state that is updated continuously from the input control path. Feed this structured state to a learned vector field, allowing the model to represent path-dependent dynamics through iterated integrals of the entire history rather than only the latest hidden state.

Useful6/10
Difficulty5/10
Novelty5/10
Paper: Dynamic Universal Approximation via Signature Controlled Differential Equations arXiv:2607.13886