Uniformly bounded Jacobi spectral features
Source paper: The Koornwinder--Kostenko--Teschl Conjecture for Jacobi Polynomials and the Discrete Laguerre Phase Transition arXiv:2608.30486 ⓘ · analyzed Sep 1, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Replace raw powers or unconstrained polynomial spectral features with normalized Jacobi features whose amplitude is provably bounded on the entire input interval. Use trainable mixtures of these features in a positional encoding, graph spectral layer, or MLP front end, while preserving the theorem's normalization and optionally constraining the learned mixture norm.
Formulas
Mathematical statement
For degree n in the nonnegative integers, parameters alpha,beta >= 0, and x in [-1,1], the paper defines the normalized weighted Jacobi function g_n^(alpha,beta)(x) using the standard Jacobi polynomial P_n^(alpha,beta), the gamma function Gamma, and endpoint weights. Its main theorem states that |g_n^(alpha,beta)(x)| is at most B_n(alpha,beta)=[(n+1)(n+alpha+beta+1)/((n+alpha+1)(n+beta+1))]^(1/4), and B_n(alpha,beta)<=1. Therefore every basis feature is uniformly bounded on the complete input interval, independently of x. If an output channel is z_k(x)=sum_{n=0}^N C_kn g_n^(alpha,beta)(x), then |z_k(x)|<=sum_n |C_kn| because every basis function has magnitude at most one. Enforcing an l1 bound on each coefficient row gives a deterministic activation bound. The theorem assumes alpha,beta>=0 and x in [-1,1]; inputs outside this interval must be normalized or clipped before evaluation.
Implementation notes
1. Integration point: implement a bounded Jacobi feature encoder before a transformer, MLP, or graph neural network. Normalize every scalar coordinate u to x=2(u-u_min)/(u_max-u_min)-1, or for graph spectral inputs use x=2lambda/lambda_max-1, where lambda is a Laplacian eigenvalue. Evaluate degrees n=0,...,N and concatenate the features. 2. Pseudocode: choose fixed alpha,beta>=0 and maximum degree N; for each x, compute P_0^(alpha,beta)(x)=1 and evaluate higher Jacobi polynomials with a stable three-term recurrence; multiply each polynomial by the gamma normalization and endpoint factors in the first formula; stack g=[g_0,...,g_N]; form z=Cg; optionally replace C by the l1-normalized C_tilde defined above; pass z to the downstream network. Use Clenshaw evaluation or recurrence in float32 for moderate N, and avoid explicit polynomial expansion. 3. Compute from the paper: the basis normalization and certified bound B_n. Estimate empirically: actual feature maxima, activation variance, gradient norms, and approximation error on held-out inputs. 4. First experiment: train a small CIFAR-10 MLP or a 2D sinusoidal-regression transformer with degree-32 positional features, comparing raw monomials, unnormalized Jacobi polynomials, Fourier features, and normalized Jacobi features. Measure loss at equal FLOPs, maximum activation and gradient, validation error, and NaN frequency while increasing learning rate. Success means lower activation growth and fewer optimization failures at high degree, with equal or better validation accuracy; separately test whether the l1 coefficient constraint permits a larger stable learning rate.
Verification
This idea has not been verified yet.
Verification happens in two stages: Stage 1 — a mechanism check on a toy system confirms the claimed mathematical phenomenon reproduces; Stage 2 — a benchmark implements the idea on a real (small) neural network task and compares it against a tuned baseline over 8 paired seeds with a permutation test.
Artifacts
Artifacts unavailable.