Rough differential equations on manifolds via natural bundles

arXiv:2609.01190 2026 Architecture 1 ideas extracted · analyzed Sep 2, 2026

What the math gives to ML

The paper provides a coordinate-invariant way to evolve states under highly irregular drivers by augmenting ordinary vector fields with second-order branched rough-velocity coefficients. Its transferable asset is the local Davie expansion: a state transition uses both first-order driver increments and independent second-order iterated increments, with a remainder controlled by a fractional power of a path control. This suggests a rough residual or state-space block that explicitly models order-dependent interactions between input increments, while using the paper's jet composition rule to preserve behavior under smooth reparameterizations of the hidden state. The strongest initial test is a second-order sequence model on irregularly sampled or noisy streams, compared against a neural CDE or GRU block at equal parameter count and FLOPs.

Ideas from this paper

Unverified 2026

Branched Rough Residual Block

Replace a standard recurrent or neural-CDE Euler transition with a second-order rough transition that receives both first-order increments of the input path and learned second-order branched increments. Unlike a geometric signature block, the second-order coefficients are independent learned maps rather than being forced to equal derivatives or shuffle-symmetric combinations of first-order vector fields, allowing the model to represent order-sensitive and non-geometric interactions in irregular…

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Rough differential equations on manifolds via natural bundles arXiv:2609.01190