Moment-Resolved Readout and Reservoir Diversity in Nonequilibrium Langevin Computing
arXiv:2607.14520
2026
Architecture
1 ideas extracted · analyzed Aug 30, 2026
What the math gives to ML
The paper offers a transferable readout mechanism for stochastic or recurrent neural systems: preserve multiple nonequilibrium response moments instead of compressing each state distribution to its mean. For quartic Langevin units, second- and fourth-order moments capture input-dependent width and tail changes that are invisible to mean-only readout. A second mechanism is heterogeneous reservoir fusion, where independently initialized or trained reservoirs expose complementary features before class-logit compression. The most useful neural-network test is a moment-augmented stochastic recurrent model with controlled noise and forcing, together with ablations that determine whether non-Gaussian moment information predicts gains rather than merely increasing feature count.
Ideas from this paper
Unverified
2026
Replace mean-only readout from a noisy recurrent or Langevin reservoir by concatenating empirical first, second, and fourth raw moments of each hidden coordinate. The second and fourth moments retain input-dependent width and tail information generated by nonlinear confinement, while multiple independently initialized reservoirs can be concatenated before the final linear classifier to preserve complementary features.
Useful6/10
Difficulty5/10
Novelty6/10