Local Synaptic Rules Can Implement a SIGReg Gradient Without Backpropagation
arXiv:2607.21622
2026
Training
1 ideas extracted · analyzed Aug 30, 2026
What the math gives to ML
The paper provides a constructive bridge from biologically local plasticity to an exact gradient of a SIGReg-like self-supervised objective: encoder synapses use only pre/post activity, local sigmoid gain, temporal adjacency, and a fixed random projection circuit. The transferable asset is not STDP in isolation, but the decomposition of a global representation-learning gradient into an online Hebbian term plus a homeostatic correction and a fixed feedback projection, avoiding backpropagation and weight transport. A practical first transfer is a two-step temporal representation learner whose encoder update uses a fixed random projection to generate a locally available modulatory error, then compares it against a backpropagation baseline on temporally ordered and randomly shuffled data.
Ideas from this paper
△ Mechanism confirmed, baseline not beaten
2026
Replace backpropagation through a small encoder with an online local update driven by consecutive examples and a fixed random projection of hidden activity. The projection produces a modulatory signal that encourages temporally adjacent inputs to have compatible representations, while the homeostatic term prevents sigmoid units from saturating or collapsing.
Useful7/10
Difficulty5/10
Novelty7/10