Differentiable Hankel PSD regularizer
Implementation & benchmark of arXiv:2607.17630 — Higher-Order Hankel Obstructions to Free Infinite Divisibility for Beta Distributions
Source paper: Higher-Order Hankel Obstructions to Free Infinite Divisibility for Beta Distributions arXiv:2607.17630 ⓘ · analyzed Aug 30, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Attach finite Hankel positive-semidefiniteness penalties to a neural model that predicts scalar moments, cumulants, or beta-distribution parameters. The exact beta inequality supplies a very cheap first-stage barrier, while eigenvalue penalties on larger Hankel matrices constrain higher-order structure.
Formulas
Mathematical statement
The paper uses conditional positive definiteness of free cumulants to obtain a hierarchy of necessary Hankel tests. For a scalar sequence a_0,a_1,..., define the N by N Hankel matrix H_N(a) by H_N(a)_{ij}=a_{i+j} for indices i,j from 0 through N-1. Positive semidefiniteness requires v^T H_N(a) v >= 0 for every real vector v, equivalently that the minimum eigenvalue be nonnegative. For the beta distribution beta_{p,q} on [0,1], define s=p+q and r=pq. The paper's explicit first obstruction is g(p,q)=2s^3(s+1)+r(s^3-7s^2-16s-12) >= 0; g<0 certifies that beta_{p,q} is not freely infinitely divisible. This condition is necessary only: g>=0 does not establish free infinite divisibility. In a neural model, use p=softplus(p_0)+epsilon and q=softplus(q_0)+epsilon, where p_0 and q_0 are network outputs, or let the network directly predict a_0 through a_{2N-2}.
Implementation notes
(1) Integration point: add the regularizer to a conditional VAE, scalar density network, or world model whose output is a distribution over a bounded scalar. Start with a beta head: the network emits p_0 and q_0, then compute p=softplus(p_0)+epsilon and q=softplus(q_0)+epsilon. A general version emits moments or free cumulants a_0 through a_{2N_max-2}. (2) Pseudocode: compute s=p+q, r=p*q, and g=2*s**3*(s+1)+r*(s**3-7*s**2-16*s-12). Add w_g*softplus(-g/tau_g) to the task loss. For every selected N, construct H[i,j]=a[i+j], symmetrize it with H=(H+H.T)/2, compute its smallest eigenvalue, and add w_N*softplus((epsilon-lambda_min)/tau). Backpropagate through the eigendecomposition and the network. (3) The exact quantities from the paper are the beta certificate g and the Hankel PSD principle. Estimate the moments or cumulants from the model output; tune epsilon, temperatures, weights, and N_max empirically. If eigenvalue gradients are unstable, use a jittered Cholesky failure penalty or random-vector violations max(0,-v.T@H@v). (4) First experiment: train a small conditional VAE on synthetic mixtures of beta distributions. Compare likelihood-only training, a beta head without constraints, and the constrained head using N=2,3,4. Measure held-out likelihood, moment calibration, negative-eigenvalue frequency, and gradient stability. Success is a lower invalid-distribution rate and better high-order moment calibration at similar likelihood and compute.
Verification
This idea has not been verified yet.
Verification happens in two stages: Stage 1 — a mechanism check on a toy system confirms the claimed mathematical phenomenon reproduces; Stage 2 — a benchmark implements the idea on a real (small) neural network task and compares it against a tuned baseline over 8 paired seeds with a permutation test.
Artifacts
Artifacts unavailable.