Dendritic In-Context Learning in a Single-Layer Spiking Neural Network
arXiv:2607.02283
2026
Architecture
1 ideas extracted · analyzed Aug 30, 2026
What the math gives to ML
The paper identifies a concrete architectural mechanism for in-context learning in spiking networks: a persistent, multidimensional dendritic state whose recurrence performs leaky online Widrow–Hoff least-mean-squares updates. The transferable asset is not spiking itself, but embedding an explicit online optimizer in subthreshold compartment dynamics, eliminating the need for inference-time synaptic plasticity, attention, or deep stacks. This suggests a compact recurrent or neuromorphic module that stores a task-specific linear predictor in dendritic voltage and updates it from each labeled context example. The most direct test is to replace the hidden state of a small SNN or recurrent token processor with this dendritic LMS state and measure Garg-style ICL accuracy, stability across seeds, and energy or latency at fixed parameter count.
Ideas from this paper
✗ Mechanism failed
2026
Give a single spiking layer a persistent vector-valued apical compartment that stores the current online linear predictor for the task. On each labeled context pair, its subthreshold state performs a leaky LMS update; on the query, the state is read without updating, allowing in-context adaptation without attention or inference-time synaptic plasticity.
Useful8/10
Difficulty5/10
Novelty7/10