Diffusion limits of cyclic finite-velocity random motions along vector fields
arXiv:2608.22514
2026
Dynamics
1 ideas extracted · analyzed Aug 29, 2026
What the math gives to ML
The paper identifies a transferable mechanism by which rapidly switched finite-velocity dynamics converge to diffusions whose drift depends not only on individual vector fields but also on their cyclic order. The key asset for neural networks is the survival of noncommutativity under fine-scale composition: composing two learned transformations in opposite orders produces a controllable Lie-bracket drift, while randomized run times supply diffusion-like regularization. A practical use is a cyclic stochastic residual block whose learned vector fields are constrained to have zero mean and whose order is treated as an architectural parameter, enabling richer dynamics than an ordinary residual layer at comparable width.
Ideas from this paper
✓✓ Beats tuned baseline
2026
Replace one deterministic residual update with a short cyclic composition of learned vector fields evaluated for randomized, short run times. Because finite compositions of noncommuting flows generate directional-derivative and Lie-bracket terms, changing the cycle order gives the network an explicit, low-cost way to learn drift directions that are unavailable from the individual vector fields alone.
Useful6/10
Difficulty5/10
Novelty7/10