Stable Self-Modulating Quantum Fast-Weight Programmers with Bounded Memory Gates
arXiv:2607.02363
2026
Dynamics
1 ideas extracted · analyzed Aug 30, 2026
What the math gives to ML
The paper's transferable contribution is a multiplicative fast-memory update whose recurrent branch is explicitly bounded by a sign-preserving hyperbolic-tangent gate. The important property is not the quantum circuit, but the separation between the accumulated state and the newly generated update: only the old-state multiplier is constrained, preventing repeated input-dependent gains from causing exponential growth over long sequences. This can be transplanted into hypernetworks, fast-weight attention, recurrent adapters, or state-space modules by replacing an unconstrained recurrent memory multiplier with a bounded signed gate while leaving the innovation/update path expressive.
Ideas from this paper
✗ Mechanism failed
2026
Replace an unconstrained input-dependent multiplier on a recurrent fast-weight state with a sign-preserving tanh gate. The new state retains an additive low-rank update and optionally a separately modulated innovation term, but the accumulated-memory branch can never be amplified by a factor whose magnitude exceeds one.
Useful7/10
Difficulty4/10
Novelty5/10