Unverified 2026

Differentiable Hankel PSD regularizer

Implementation & benchmark of arXiv:2607.17630 — Higher-Order Hankel Obstructions to Free Infinite Divisibility for Beta Distributions

Usefulness5/10
Difficulty4/10
Novelty7/10

Source paper: Higher-Order Hankel Obstructions to Free Infinite Divisibility for Beta Distributions arXiv:2607.17630 ⓘ · analyzed Aug 30, 2026

AI-generated research hypothesis, automatically tested. Not peer-reviewed.

Idea description

Attach finite Hankel positive-semidefiniteness penalties to a neural model that predicts scalar moments, cumulants, or beta-distribution parameters. The exact beta inequality supplies a very cheap first-stage barrier, while eigenvalue penalties on larger Hankel matrices constrain higher-order structure.

Formulas

$$\beta_{p,q}(\mathrm{d}x)=\frac{x^{p-1}(1-x)^{q-1}}{B(p,q)}\mathbf{1}_{(0,1)}(x)\,\mathrm{d}x$$
$$g(p,q)=2s^{3}(s+1)+pq\bigl(s^{3}-7s^{2}-16s-12\bigr),\qquad s=p+q$$
$$H_N(a)_{ij}=a_{i+j},\qquad v^{\mathsf T}H_N(a)v\geq0\quad\forall v\in\mathbb R^N$$
$$\mathcal L_{\mathrm{Hankel}}=\sum_{N=2}^{N_{\max}}w_N\operatorname{softplus}\left(\frac{\epsilon-\lambda_{\min}(H_N(a))}{\tau}\right)+w_g\operatorname{softplus}\left(\frac{-g(p,q)}{\tau_g}\right)$$

Mathematical statement

The paper uses conditional positive definiteness of free cumulants to obtain a hierarchy of necessary Hankel tests. For a scalar sequence a_0,a_1,..., define the N by N Hankel matrix H_N(a) by H_N(a)_{ij}=a_{i+j} for indices i,j from 0 through N-1. Positive semidefiniteness requires v^T H_N(a) v >= 0 for every real vector v, equivalently that the minimum eigenvalue be nonnegative. For the beta distribution beta_{p,q} on [0,1], define s=p+q and r=pq. The paper's explicit first obstruction is g(p,q)=2s^3(s+1)+r(s^3-7s^2-16s-12) >= 0; g<0 certifies that beta_{p,q} is not freely infinitely divisible. This condition is necessary only: g>=0 does not establish free infinite divisibility. In a neural model, use p=softplus(p_0)+epsilon and q=softplus(q_0)+epsilon, where p_0 and q_0 are network outputs, or let the network directly predict a_0 through a_{2N-2}.

Implementation notes

(1) Integration point: add the regularizer to a conditional VAE, scalar density network, or world model whose output is a distribution over a bounded scalar. Start with a beta head: the network emits p_0 and q_0, then compute p=softplus(p_0)+epsilon and q=softplus(q_0)+epsilon. A general version emits moments or free cumulants a_0 through a_{2N_max-2}. (2) Pseudocode: compute s=p+q, r=p*q, and g=2*s**3*(s+1)+r*(s**3-7*s**2-16*s-12). Add w_g*softplus(-g/tau_g) to the task loss. For every selected N, construct H[i,j]=a[i+j], symmetrize it with H=(H+H.T)/2, compute its smallest eigenvalue, and add w_N*softplus((epsilon-lambda_min)/tau). Backpropagate through the eigendecomposition and the network. (3) The exact quantities from the paper are the beta certificate g and the Hankel PSD principle. Estimate the moments or cumulants from the model output; tune epsilon, temperatures, weights, and N_max empirically. If eigenvalue gradients are unstable, use a jittered Cholesky failure penalty or random-vector violations max(0,-v.T@H@v). (4) First experiment: train a small conditional VAE on synthetic mixtures of beta distributions. Compare likelihood-only training, a beta head without constraints, and the constrained head using N=2,3,4. Measure held-out likelihood, moment calibration, negative-eigenvalue frequency, and gradient stability. Success is a lower invalid-distribution rate and better high-order moment calibration at similar likelihood and compute.

Verification

This idea has not been verified yet.

Verification happens in two stages: Stage 1 — a mechanism check on a toy system confirms the claimed mathematical phenomenon reproduces; Stage 2 — a benchmark implements the idea on a real (small) neural network task and compares it against a tuned baseline over 8 paired seeds with a permutation test.

Artifacts

Artifacts unavailable.