The classes of bivariate Schur and Herglotz matrix-valued rational functions: realizations, symmetrizations, and related determinantal representations
arXiv:2609.03054
2026
Architecture
1 ideas extracted · analyzed Sep 4, 2026
What the math gives to ML
The paper gives finite-dimensional state-space realizations for multivariate rational maps whose positivity or contractivity is certified by explicit matrix inequalities. The transferable asset is the positive-real/Herglotz realization: a rational feature mixer can be parameterized so that its symmetric part is positive semidefinite over an entire positive-input domain, rather than merely being stable at sampled training points. A particularly promising neural adaptation is to use such a map inside an implicit resolvent layer, whose accretivity gives a built-in nonexpansive stability mechanism. This could provide a compact alternative to unconstrained token mixers or state-space blocks, especially when feature-dependent rational filtering is desired.
Ideas from this paper
Unverified
2026
Replace an unconstrained token mixer or feed-forward residual map with a feature-conditioned rational operator whose transfer matrix is positive real on the positive orthant. Apply it through a resolvent, rather than an additive residual, so that the accretivity certificate yields a nonexpansive implicit update and suppresses activation explosions.
Useful7/10
Difficulty6/10
Novelty7/10