On data-driven parameterizations of multidimensional generalized Langevin dynamics in the presence of a quadratic potential

arXiv:2607.05151 2026 Architecture 1 ideas extracted · analyzed Aug 30, 2026

What the math gives to ML

The paper gives a constructive route from empirical velocity autocorrelations to a finite-dimensional Markovian system with auxiliary variables, avoiding explicit inversion of a memory kernel. Its transferable asset is a stable Prony/Ornstein–Uhlenbeck realization: long-range temporal dependence is represented by a small bank of exponentially decaying modes, while the block structure preserves a physically meaningful covariance and can enforce stability. In neural networks, this suggests replacing quadratic-cost temporal attention or unconstrained recurrent memory with data-fitted multi-timescale state-space filters. The most direct experiment is to fit decay modes from feature autocorrelations and compare an O(TK) memory layer against attention or an unconstrained SSM at equal parameter count.

Ideas from this paper

Unverified 2026

Prony Memory Bank for Linear-Time Sequence Modeling

Replace quadratic self-attention over a sequence with a bank of K auxiliary exponentially decaying states whose rates are fitted directly from the empirical autocorrelation of the sequence features. Each mode captures a distinct time scale, so the module can represent short- and long-range dependencies with O(TK) computation and O(K) recurrent memory rather than storing all previous tokens. Constrain decay rates to be positive and use the paper's extended Markovian block structure to obtain a…

Useful7/10
Difficulty5/10
Novelty4/10
Paper: On data-driven parameterizations of multidimensional generalized Langevin dynamics in the presence of a quadratic potential arXiv:2607.05151