Generalizing the multidimensional thermodynamic uncertainty relation to combinations of arbitrary counting variables
arXiv:2608.14276
2026
Dynamics
1 ideas extracted · analyzed Sep 1, 2026
What the math gives to ML
The paper develops a multidimensional thermodynamic uncertainty relation for arbitrary combinations of counting observables, including currents, traffic, flows, coarse-grained observations, finite observation windows, and time-dependent driving. The transferable mechanism is a covariance-adjusted precision bound: correlated observables cannot all exhibit large mean rates and low fluctuations without a corresponding hidden dissipation or activity cost. In neural-network optimization, this can become an online diagnostic and learning-rate controller based on signed parameter motion, absolute update traffic, and layerwise update observables. The key falsifiable prediction is that a covariance-adjusted precision score crosses a reproducible threshold near optimizer divergence, earlier and more reliably than scalar gradient variance.
Ideas from this paper
Unverified
2026
Monitor several stochastic optimizer observables jointly instead of treating gradient variance as a scalar quantity. Estimate their mean-rate vector and covariance matrix over a sliding window, compute a covariance-adjusted precision score, and reduce the learning rate when this score exceeds a calibrated budget. The method is intended to detect excessive coherent progress or update traffic before parameter or loss divergence.
Useful6/10
Difficulty4/10
Novelty8/10