Dendritic In-Context Learning in a Single-Layer Spiking Neural Network

arXiv:2607.02283 2026 Architecture 1 ideas extracted · analyzed Aug 30, 2026

What the math gives to ML

The paper identifies a concrete architectural mechanism for in-context learning in spiking networks: a persistent, multidimensional dendritic state whose recurrence performs leaky online Widrow–Hoff least-mean-squares updates. The transferable asset is not spiking itself, but embedding an explicit online optimizer in subthreshold compartment dynamics, eliminating the need for inference-time synaptic plasticity, attention, or deep stacks. This suggests a compact recurrent or neuromorphic module that stores a task-specific linear predictor in dendritic voltage and updates it from each labeled context example. The most direct test is to replace the hidden state of a small SNN or recurrent token processor with this dendritic LMS state and measure Garg-style ICL accuracy, stability across seeds, and energy or latency at fixed parameter count.

Ideas from this paper

Mechanism failed 2026

Dendritic LMS State for Spiking ICL

Give a single spiking layer a persistent vector-valued apical compartment that stores the current online linear predictor for the task. On each labeled context pair, its subthreshold state performs a leaky LMS update; on the query, the state is read without updating, allowing in-context adaptation without attention or inference-time synaptic plasticity.

Useful8/10
Difficulty5/10
Novelty7/10
Paper: Dendritic In-Context Learning in a Single-Layer Spiking Neural Network arXiv:2607.02283