Intrinsic-Noise Consolidation: A Doob-Barrier-Conditioned Diffusion Turns Analog Device Noise into a Continual-Learning Resource

arXiv:2607.06924 2026 Regularization 1 ideas extracted · analyzed Aug 30, 2026

What the math gives to ML

The paper converts intrinsic parameter noise into a state-dependent continual-learning force by conditioning each noisy weight trajectory to remain inside a memory-critical interval. The transferable mechanism is a Doob h-transform: its drift correction scales with noise variance, points toward the stored anchor, and becomes very large near the interval boundaries. This differs qualitatively from quadratic EWC or OU anchoring and predicts a falsifiable inverted-U relationship between noise amplitude and memory retention. The most direct neural-network application is a rehearsal-free optimizer rule applied to parameters after each task boundary.

Ideas from this paper

Mechanism confirmed, baseline not beaten 2026

Doob barrier consolidation

Add a Doob-transformed barrier drift to parameters during sequential-task training, conditioning each noisy parameter trajectory to remain within an interval around its previous-task anchor. The correction is weak at the anchor, grows toward the barriers, and increases with the injected noise variance, providing state-dependent protection that quadratic anchoring does not provide.

Useful8/10
Difficulty4/10
Novelty8/10
Paper: Intrinsic-Noise Consolidation: A Doob-Barrier-Conditioned Diffusion Turns Analog Device Noise into a Continual-Learning Resource arXiv:2607.06924