Instantaneous shrinking of supports for stochastic PDEs
arXiv:2609.01984
2026
Regularization
1 ideas extracted · analyzed Sep 3, 2026
What the math gives to ML
The paper identifies a sparsification mechanism in which sublinear multiplicative noise that vanishes at zero can create compact support instantly, despite diffusion and initially noncompact positive data. The transferable asset is an absorbing-boundary dynamic: near zero, the ratio of noise amplitude to signal amplitude diverges, potentially producing exact zeros rather than merely small values. A practical neural analogue is a nonnegative spatial, graph, or token activation field evolved by short stochastic diffusion steps, then used as a sparse representation or routing mask. The key experiment should compare it against dropout, deterministic diffusion, hard-concrete gates, and L1 sparsity at matched accuracy.
Ideas from this paper
Unverified
2026
Replace ordinary dropout or soft sparsity penalties on a nonnegative spatial or token activation field with sublinear multiplicative stochastic dynamics. The field receives local diffusion or graph smoothing, while noise amplitude u^gamma vanishes at zero but is relatively strong near zero; this creates an absorbing zero state and may produce exact contiguous inactive regions. The module is suitable for feature maps, graph-node fields, token routing scores, or continuous neural operators.
Useful6/10
Difficulty6/10
Novelty8/10