From Individual-Based Stochastic Epidemics to Heterogeneous SIR Equations

arXiv:2608.22122 2026 Architecture 1 ideas extracted · analyzed Aug 29, 2026

What the math gives to ML

The paper derives a general response law for persistent heterogeneity: a population exposed to cumulative pressure A responds through the Laplace transform G(A)=E[exp(-A Lambda)], rather than through a single average susceptibility. Its key transferable asset is the exponentially tilted mean susceptibility, which is the negative log-derivative of G and decreases according to the variance of the tilted susceptibility distribution. This gives neural routing or gating modules a principled family of monotone, saturating pressure penalties with power-law-like tails, instead of a fixed softmax penalty or hand-tuned sigmoid. The most direct experiment is a load-aware MoE router whose expert availability is G(A_e), where A_e is an exponentially averaged measure of recent expert utilization.

Ideas from this paper

Failed on benchmark 2026

Laplace-Heterogeneous MoE Routing

Replace the usual hand-designed expert-load penalty with a heterogeneous survival penalty derived from a susceptibility distribution. Each expert receives an availability factor q_e=G(A_e), where A_e is its cumulative recent routing pressure and G_e is a learned or fixed mixture of exponentials; highly used experts are suppressed smoothly, while heterogeneous experts can have different resistance to pressure. The mixture produces adaptive curvature and long-tailed penalties that may reduce…

Useful6/10
Difficulty4/10
Novelty6/10
Paper: From Individual-Based Stochastic Epidemics to Heterogeneous SIR Equations arXiv:2608.22122