Positive Bidiagonal Factorizations for Banded Markov Processes

arXiv:2608.00788 2026 Architecture 1 ideas extracted · analyzed Aug 31, 2026

What the math gives to ML

The paper provides an ordered factorization of a nonnegative banded transition matrix into positive bidiagonal factors, with the factor order retaining structure that is hidden in the multiplied matrix. This gives a cheap, positivity-preserving and row-stochastic parameterization of local neural propagation operators, while allowing arbitrary bandwidth through repeated one-step moves. The most direct transfer is a learnable diffusion or state-space layer whose transition kernel is a product of elementary lower- and upper-neighbor updates, rather than a dense unconstrained matrix. Total nonnegativity and stochasticity provide stability and probabilistic interpretability, while the factorization reduces parameter count and computation.

Ideas from this paper

Unverified 2026

Positive Bidiagonal Diffusion Layer

Replace a learned nonnegative banded transition matrix by an ordered product of learnable stochastic bidiagonal factors. Each factor performs one local left or right transport step, so a product of p lower and q upper factors creates an effective bandwidth of p+q while retaining nonnegative entries, row sums equal to one, and a highly structured propagation kernel.

Useful6/10
Difficulty3/10
Novelty7/10
Paper: Positive Bidiagonal Factorizations for Banded Markov Processes arXiv:2608.00788