Local Synaptic Rules Can Implement a SIGReg Gradient Without Backpropagation

arXiv:2607.21622 2026 Training 1 ideas extracted · analyzed Aug 30, 2026

What the math gives to ML

The paper provides a constructive bridge from biologically local plasticity to an exact gradient of a SIGReg-like self-supervised objective: encoder synapses use only pre/post activity, local sigmoid gain, temporal adjacency, and a fixed random projection circuit. The transferable asset is not STDP in isolation, but the decomposition of a global representation-learning gradient into an online Hebbian term plus a homeostatic correction and a fixed feedback projection, avoiding backpropagation and weight transport. A practical first transfer is a two-step temporal representation learner whose encoder update uses a fixed random projection to generate a locally available modulatory error, then compares it against a backpropagation baseline on temporally ordered and randomly shuffled data.

Ideas from this paper

Mechanism confirmed, baseline not beaten 2026

Fixed-Projection Temporal Plasticity

Replace backpropagation through a small encoder with an online local update driven by consecutive examples and a fixed random projection of hidden activity. The projection produces a modulatory signal that encourages temporally adjacent inputs to have compatible representations, while the homeostatic term prevents sigmoid units from saturating or collapsing.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Local Synaptic Rules Can Implement a SIGReg Gradient Without Backpropagation arXiv:2607.21622