On large networks of integrate-and-fire neurons with short-term synaptic plasticity
arXiv:2607.16017
2026
Dynamics
1 ideas extracted · analyzed Aug 30, 2026
What the math gives to ML
The paper gives a constructive way to analyze recurrent spiking dynamics with synaptic depression by reducing local stability to the zeros of a Laplace-transformed linear-response function. The transferable asset is not the specific neuron model, but the combination of regenerative resets, a hidden fatigue state, and a computable frequency-domain stability test for the closed-loop interaction strength. A practical neural-network adaptation is to add a depression state to a recurrent or state-space layer and regularize the learned recurrent gain so that the empirical characteristic function has no unstable right-half-plane zeros. The paper's auxiliary ODEs also provide a route to estimating response transforms without differentiating through long network trajectories.
Ideas from this paper
Unverified
2026
Augment a recurrent or state-space layer with a bounded synaptic-depression variable that multiplicatively reduces recurrent transmission after activity. During training, estimate the layer's impulse-response transform and penalize characteristic roots approaching the unstable half-plane. This directly targets slow oscillations and exploding recurrent feedback rather than relying only on gradient clipping.
Useful6/10
Difficulty6/10
Novelty7/10