Unverified 2026

Fractional Boolean Sensitivity Regularization

Implementation & benchmark of arXiv:2609.03993 — The Endpoint Fractional Riesz Estimate on the Hamming Cube

Usefulness5/10
Difficulty5/10
Novelty7/10

Source paper: The Endpoint Fractional Riesz Estimate on the Hamming Cube arXiv:2609.03993 · analyzed Sep 4, 2026

AI-generated research hypothesis, automatically tested. Not peer-reviewed.

Idea description

Add a fractional-Laplacian penalty to a neural network evaluated on binary inputs or binary latent gates. For 1 < p < 2, the endpoint inequality implies that controlling fractional spectral energy controls the L_p norm of aggregate coordinate-flip sensitivity, potentially giving a more global robustness objective than explicitly enumerating one-bit perturbations.

Formulas

$$D_j f(x)=\frac{f(x)-f(x^{(j)})}{2},\qquad \Delta f=\sum_{j=1}^{n}D_j f$$
$$\left\|\left(\sum_{j=1}^{n}|D_jf|^{2}\right)^{1/2}\right\|_{p}\lesssim_{p}\|\Delta^{1/p}f\|_{p},\qquad 1<p<2$$
$$f(x)=\sum_{S\subseteq[n]}\widehat f(S)\chi_S(x),\quad \chi_S(x)=\prod_{j\in S}x_j,\quad \Delta^{1/p}f(x)=\sum_{S\ne\varnothing}|S|^{1/p}\widehat f(S)\chi_S(x)$$
$$\mathcal L(\theta)=\mathcal L_{\mathrm{task}}(\theta)+\lambda\,\mathbb E_{x\sim\mathrm{Unif}(\Omega_n)}\left[\left|\Delta^{1/p}f_\theta(x)\right|^p\right]$$

Mathematical statement

The paper defines the Hamming cube Omega_n = {-1,1}^n with normalized counting measure, the coordinate flip x^(j), the discrete derivative D_j f(x) = (f(x) - f(x^(j)))/2, the gradient nabla f = (D_1 f,...,D_n f), and the Laplacian Delta f = sum_j D_j f. Its endpoint theorem states that for every 1 < p < 2, ||(sum_j |D_j f|^2)^(1/2)||_p <= C_p ||Delta^(1/p) f||_p, where C_p depends only on p and not on dimension n. For implementation, expand a scalar network output f_theta on the Walsh basis chi_S(x) = product_{j in S} x_j, for S a subset of {1,...,n}. Because Delta chi_S = |S| chi_S, the fractional operator is Delta^(1/p) f = sum_{S != emptyset} |S|^(1/p) f_hat(S) chi_S, with the constant mode removed because its Laplacian eigenvalue is zero. Use the computable regularizer R_frac = E_x[|Delta^(1/p) f_theta(x)|^p]. The theorem supplies the dimension-free sensitivity-control relation; the exact constant C_p is not required during optimization.

Implementation notes

Integrate the method at the model-output interface for a classifier or encoder whose input is x in {-1,1}^n, including binary feature vectors, token-presence indicators, or hard binary routing gates. Do not apply it directly to continuous hidden activations unless those activations are first discretized. For a first implementation with n <= 14, enumerate all cube points or use a fixed random subset, evaluate the scalar output f_theta(x), apply a fast Walsh-Hadamard transform to obtain the coefficients f_hat(S), multiply coefficient S by |S|^(1/p) for every nonempty S and set the constant coefficient to zero, then apply the inverse transform. Use the following loop: y = model(theta, x_cube); coeff = FWHT(y); coeff[0] = 0; for each spectral index S, set coeff[S] = coeff[S] * popcount(S)**(1/p); z = IFWHT(coeff); loss = task_loss + lambda * mean(abs(z)**p); backpropagate and update theta. For larger n, retain only low-order Walsh subsets or estimate coefficients by Monte Carlo sampling of chi_S(x); validate the approximation against exact transforms on small n. The paper supplies the sensitivity-to-fractional-energy inequality, while the Walsh diagonalization and truncation are implementation choices. Begin with a two-layer MLP on a synthetic parity-plus-noise task or binarized MNIST using n = 12 or 16 input bits. Compare ordinary cross-entropy, explicit one-bit-flip augmentation, and this penalty at matched FLOPs. Measure clean accuracy, accuracy under one-, two-, and four-bit flips, empirical sensitivity E[(sum_j |D_j f|^2)^(p/2)], and training loss at equal step count. Success means lower flip sensitivity and improved corrupted accuracy at comparable clean accuracy, or matching robustness with fewer explicit perturbation evaluations.

Verification

This idea has not been verified yet.

Verification happens in two stages: Stage 1 — a mechanism check on a toy system confirms the claimed mathematical phenomenon reproduces; Stage 2 — a benchmark implements the idea on a real (small) neural network task and compares it against a tuned baseline over 8 paired seeds with a permutation test.

Artifacts

Artifacts unavailable.