✗ Mechanism failed 2026

Positive Mellin Mixture Gate

Implementation & benchmark of arXiv:2606.31647 — Order-Moment Transport and Hankel Determinants in Special-Function Inequalities

Usefulness6/10
Difficulty4/10
Novelty8/10

Source paper: Order-Moment Transport and Hankel Determinants in Special-Function Inequalities arXiv:2606.31647 ⓘ · analyzed Aug 29, 2026

AI-generated research hypothesis, automatically tested. Not peer-reviewed.

Idea description

Replace a free-form order-dependent gate with a positive mixture of Mellin powers $(1+s)^{-a}$. This gives a small, interpretable module whose response across the order variable is automatically generated by a positive measure and therefore inherits complete monotonicity, log-convexity, and Hankel-moment structure.

Formulas

$$\frac{1}{\Gamma(a)}\int_{0}^{\infty}y^{a-1}e^{-y}g(y)\,\mathrm{d}y=\int_{[0,\infty)}(1+s)^{-a}\,\mathrm{d}\mu(s)$$
$$h(a)=\sum_{\ell=1}^{L}w_\ell(1+s_\ell)^{-a}=\sum_{\ell=1}^{L}w_\ell\exp\!\big[-a\log(1+s_\ell)\big],\qquad w_\ell,s_\ell\geq0$$
$$h(a+k\Delta)=\sum_{\ell=1}^{L}\underbrace{w_\ell(1+s_\ell)^{-a}}_{\text{positive weight}}\underbrace{\left((1+s_\ell)^{-\Delta}\right)^k}_{\text{moment atom}^k}$$
$$H_{ij}=h(a+(i+j)\Delta),\qquad H\succeq0$$

Mathematical statement

Starting from a completely monotone function $g(y)=\int_{[0,\infty)}e^{-sy}\,\mathrm{d}\mu(s)$ with positive measure $\mu$, the paper's gamma-normalization identity is $\frac{1}{\Gamma(a)}\int_0^\infty y^{a-1}e^{-y}g(y)\,\mathrm{d}y=\int(1+s)^{-a}\,\mathrm{d}\mu(s)$. Approximate the measure by atoms $s_\ell\geq0$ with weights $w_\ell\geq0$: $h(a)=\sum_{\ell=1}^{L}w_\ell(1+s_\ell)^{-a}$. Since $(1+s_\ell)^{-a}=\exp[-a\log(1+s_\ell)]$, $h$ is a positive mixture of exponentials in $a$. Here $a>0$ is the ordered conditioning variable, $L$ is the number of atoms, $w_\ell=\operatorname{softplus}(\tilde w_\ell)$ are learned nonnegative weights, and $s_\ell=\operatorname{softplus}(\tilde s_\ell)$ are learned nonnegative rates. For any $a$ and step $\Delta>0$, the sequence $h(a+k\Delta)$ is a moment sequence with atoms $(1+s_\ell)^{-\Delta}$ and weights $w_\ell(1+s_\ell)^{-a}$, so its Hankel matrices are PSD.

Implementation notes

Use this as a drop-in replacement for a scalar gate that currently depends on an ordered control variable. Examples include timestep-dependent residual scaling in diffusion U-Nets, temperature-dependent attention output scaling, layer-index-dependent SSM gains, or curriculum-dependent loss weights. Given a batch feature vector $z$, compute a nonnegative base amplitude $b(z)=\operatorname{softplus}(\mathrm{MLP}(z))$, then compute $h(a)$ from $L=4$ to $16$ learned atoms. Parameterize $w_\ell=\operatorname{softplus}(\tilde w_\ell)$ and $s_\ell=\operatorname{softplus}(\tilde s_\ell)$; return gate $q(a,z)=\operatorname{sigmoid}(c+b(z)h(a))$ or residual multiplier $1+\rho b(z)h(a)$. Pseudocode: inputs $(z,a)$; $b=\operatorname{softplus}(MLP(z))$; for each atom calculate $r_\ell=-a\log1p(s_\ell)$; $h=\sum_\ell\exp(\log w_\ell+r_\ell)$ using log-sum-exp; apply the gate to the selected residual or attention branch. Initialize rates log-uniformly over a range corresponding to the observed $a$ interval and initialize weights so the mean gate is one. The mathematical guarantee is exact for the parameterized gate; rates and weights are learned empirically. Validate first on CIFAR-10 diffusion with a small U-Net, comparing a free two-layer timestep MLP against the Mellin gate at equal parameter count. Measure FID, denoising loss, gradient variance across timesteps, and extrapolation to unseen timesteps. Success is smoother timestep response, lower gradient variance, and equal or better FID without increasing sampling steps.

Verification

Mechanism failed

Stage 1 · Toy mechanism gate: Failed ✗

Stage 2 · Mechanism transferred to benchmark: Not tested

Stage 2 · Practical benchmark result: Not run

Methodology: Toy-system gate first; the benchmark stage runs only after a pass. How verification works

Stage 1 — Mechanism check agent confidence 9/10

Built a Positive Mellin Mixture Gate with nonnegative learned weights and rates, plus numerical checks for the gamma-normalization identity, complete monotonicity, log-convexity, and Hankel PSD structure. The mathematical claims were reproduced strongly: gamma identity error was 4.6e-13, all checked signed derivatives were positive, the minimum Hankel eigenvalue was 4.5e-6, and log-convexity slack was positive. However, in the equal-parameter toy regression the Mellin gate had worse extrapolation MSE than the free order MLP (2.10e-4 vs 5.84e-5), so the proposed practical generalization win was not observed.

Agent confidence
9/10
Baseline
Free order MLP, 37 parameters: train MSE 1.384e-4; held-out order extrapolation MSE 5.837e-5.
Idea
Positive Mellin mixture, 37 parameters: train MSE 1.620e-4; held-out order extrapolation MSE 2.098e-4. Mathematical checks: gamma identity max error 4.552e-13; minimum signed derivative through order 4 = 6.530e-4; minimum 4x4 Hankel eigenvalue = 4.547e-6; minimum log-convexity slack = 3.650e-3.

Limitations: Only a small synthetic scalar gate-fitting experiment was tested; no CIFAR-10 diffusion U-Net, FID, denoising loss, timestep gradient variance, sampling speed, or larger-scale training evaluation was performed. The toy used one fixed random seed and one train/extrapolation split.

How to run: python3 experiment.py

Verdict computed by deterministic test code from paired-seed statistics — not by the language model.

Artifacts

Implementation overview ⬇ Download all as ZIP 3 files · code, reports and structured results