Microscopic Dynamical Entropy I: Quantifying Hamiltonian Irreversibility in Large and Small Systems
arXiv:2607.06787
2026
Regularization
1 ideas extracted · analyzed Aug 30, 2026
What the math gives to ML
The paper constructs an entropy of a subsystem marginal by discarding the environment's conditional microscopic information while retaining a state-dependent conditional phase-space volume. The transferable asset is not Hamiltonian mechanics itself, but the resulting entropy functional: ordinary marginal entropy is corrected by a learned or estimated measure of how much unresolved environment volume is compatible with each representation. This suggests a representation-learning regularizer for latent-variable models that rewards informative, dynamically plausible latents without forcing the latent marginal toward a uniform distribution. Monotonicity is guaranteed only under physical assumptions such as timescale separation, so an ML implementation should treat the quantity as a regularizer or diagnostic rather than assume it is always increasing.
Ideas from this paper
Unverified
2026
Add a Microscopic Dynamical Entropy-inspired regularizer to a VAE or sequential world model. Instead of maximizing only the entropy of the latent marginal, maximize latent marginal entropy plus an estimate of the log-volume of unresolved variables compatible with each latent state, thereby preferring representations that summarize predictable macroscopic structure while assigning nuisance detail to the residual channel.
Useful5/10
Difficulty5/10
Novelty6/10