Log-concavity and log-convexity in the theory of the Graham--Knuth--Patashnik recurrences
arXiv:2607.04217
2026
Architecture
1 ideas extracted · analyzed Aug 29, 2026
What the math gives to ML
The paper gives a six-parameter family of nonnegative triangular recurrences whose row coefficients are coefficientwise strongly log-concave, while the row-generating polynomials are coefficientwise log-convex and Hankel-TP2. The transferable asset is a differentiable parameterization of positive, unimodal, variation-controlled mixing weights with algebraic guarantees that survive symbolic expansion. A practical neural use is to replace unconstrained learned lag or scale weights in a temporal mixer, state-space layer, or local attention module by recurrence-generated weights. This supplies a cheap structural prior against oscillatory or multi-peaked kernels while retaining learnable content through six parameters per head or channel group.
Ideas from this paper
Unverified
2026
Generate temporal attention or convolution weights with the Graham–Knuth–Patashnik recurrence instead of learning every lag weight independently. For nonnegative recurrence parameters, the resulting lag sequence is strongly log-concave, so its normalized kernel is naturally unimodal and suppresses high-frequency sign-free oscillations without requiring a separate smoothness penalty. The six parameters can be learned per head, channel group, or layer, giving O(1) learned parameters for an…
Useful5/10
Difficulty3/10
Novelty6/10