Log-concavity and log-convexity in the theory of the Graham--Knuth--Patashnik recurrences

arXiv:2607.04217 2026 Architecture 1 ideas extracted · analyzed Aug 29, 2026

What the math gives to ML

The paper gives a six-parameter family of nonnegative triangular recurrences whose row coefficients are coefficientwise strongly log-concave, while the row-generating polynomials are coefficientwise log-convex and Hankel-TP2. The transferable asset is a differentiable parameterization of positive, unimodal, variation-controlled mixing weights with algebraic guarantees that survive symbolic expansion. A practical neural use is to replace unconstrained learned lag or scale weights in a temporal mixer, state-space layer, or local attention module by recurrence-generated weights. This supplies a cheap structural prior against oscillatory or multi-peaked kernels while retaining learnable content through six parameters per head or channel group.

Ideas from this paper

Unverified 2026

GKP Log-Concave Lag Mixer

Generate temporal attention or convolution weights with the Graham–Knuth–Patashnik recurrence instead of learning every lag weight independently. For nonnegative recurrence parameters, the resulting lag sequence is strongly log-concave, so its normalized kernel is naturally unimodal and suppresses high-frequency sign-free oscillations without requiring a separate smoothness penalty. The six parameters can be learned per head, channel group, or layer, giving O(1) learned parameters for an…

Useful5/10
Difficulty3/10
Novelty6/10
Paper: Log-concavity and log-convexity in the theory of the Graham--Knuth--Patashnik recurrences arXiv:2607.04217