Embedding martingale diffusions as binary posteriors in sequential inference
arXiv:2607.20373
2026
Architecture
1 ideas extracted · analyzed Aug 30, 2026
What the math gives to ML
The paper characterizes a broad, programmable family of bounded stochastic states whose conditional mean is preserved while their variance grows until they reach a binary absorbing decision. This gives neural networks a principled confidence or routing variable: uncertainty can evolve through state-dependent noise without unconstrained logit drift, and computation can terminate when the state becomes decisive. The most direct transfer is an adaptive-depth or MoE controller whose scalar state follows a learned autonomous win-martingale, with volatility controlling how quickly examples commit to an expert or exit. The useful mathematical asset is the combination of boundedness, martingale calibration, state-dependent exploration, and eventual binary absorption.
Ideas from this paper
Unverified
2026
Replace a conventional softmax router or fixed halting score with a scalar confidence state that evolves as a bounded martingale diffusion. The state starts at the network's prior confidence, receives evidence-dependent stochastic increments, and is absorbed at 0 or 1; absorption selects an MoE expert or halts additional transformer blocks. State-dependent volatility lets the model explore aggressively when uncertain and commit rapidly when confident, while the martingale constraint prevents…
Useful6/10
Difficulty5/10
Novelty7/10