Instantaneous shrinking of supports for stochastic PDEs

arXiv:2609.01984 2026 Regularization 1 ideas extracted · analyzed Sep 3, 2026

What the math gives to ML

The paper identifies a sparsification mechanism in which sublinear multiplicative noise that vanishes at zero can create compact support instantly, despite diffusion and initially noncompact positive data. The transferable asset is an absorbing-boundary dynamic: near zero, the ratio of noise amplitude to signal amplitude diverges, potentially producing exact zeros rather than merely small values. A practical neural analogue is a nonnegative spatial, graph, or token activation field evolved by short stochastic diffusion steps, then used as a sparse representation or routing mask. The key experiment should compare it against dropout, deterministic diffusion, hard-concrete gates, and L1 sparsity at matched accuracy.

Ideas from this paper

Unverified 2026

Noise-Induced Compact-Support Neural Field

Replace ordinary dropout or soft sparsity penalties on a nonnegative spatial or token activation field with sublinear multiplicative stochastic dynamics. The field receives local diffusion or graph smoothing, while noise amplitude u^gamma vanishes at zero but is relatively strong near zero; this creates an absorbing zero state and may produce exact contiguous inactive regions. The module is suitable for feature maps, graph-node fields, token routing scores, or continuous neural operators.

Useful6/10
Difficulty6/10
Novelty8/10
Paper: Instantaneous shrinking of supports for stochastic PDEs arXiv:2609.01984