Dynamical principles of habituation across substrates and scales
arXiv:2608.00249
2026
Dynamics
1 ideas extracted · analyzed Aug 31, 2026
What the math gives to ML
The paper identifies a minimal mechanism for habituation: a nonlinear static input-output transformation driven by a linear fading-memory state. Its key negative result is that a linear time-invariant system cannot satisfy both response decrement under repeated stimulation and recovery after stimulus withdrawal, whereas a nonlinear gain or output nonlinearity can. A direct neural-network transfer is a stateful habituating layer that tracks recent feature or token exposure and suppresses its response through a bounded nonlinear gain, while exponential decay produces recovery. The mechanism makes falsifiable predictions about response decay, exponential recovery time, and the contrast with an otherwise matched LTI baseline.
Ideas from this paper
Unverified
2026
Add a per-feature or per-token state that accumulates recent stimulation and decays when stimulation is absent, then use a nonlinear decreasing gain to suppress repeatedly activated features. This creates short-term adaptation without changing the core transformer or recurrent weights: familiar inputs are processed with reduced gain, while novel inputs recover their full response.
Useful7/10
Difficulty4/10
Novelty6/10