Retained hidden excess generates memory in price-limited markets

arXiv:2608.08625 2026 Dynamics 1 ideas extracted · analyzed Sep 1, 2026

What the math gives to ML

The paper provides a constructive mechanism by which hard clipping creates memory: the clipped-off latent excess is stored and partially injected into the next time step, even when the external shocks are independent. Its transferable asset is a bounded recurrent unit with an explicit latent overshoot state, rather than a memoryless saturating activation. This can be implemented as a recurrent or state-space neural layer whose output is constrained while retained saturation excess drives future hidden states. The mechanism makes sharp predictions: post-saturation responses have the same sign, scale linearly with the clipping width, repeated same-side saturation approaches a nonzero probability, and opposite-side saturation is power-law suppressed.

Ideas from this paper

Mechanism failed 2026

Retained-Excess Recurrent Unit

Replace a memoryless clipped recurrent output with a clipped observable plus a latent retained overshoot. The network exposes only a bounded output, but stores a fraction of the amount that would have exceeded the bound and feeds it into the next hidden-state update, allowing the model to represent persistent post-saturation effects without making the visible output unstable.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Retained hidden excess generates memory in price-limited markets arXiv:2608.08625