Unverified 2026

Porous Fourier concentration regularizer

Implementation & benchmark of arXiv:2607.11534 — Fractal uncertainty principle over $\mathbb{Q}_p$

Usefulness5/10
Difficulty4/10
Novelty7/10

Source paper: Fractal uncertainty principle over $\mathbb{Q}_p$ arXiv:2607.11534 ⓘ · analyzed Aug 30, 2026

AI-generated research hypothesis, automatically tested. Not peer-reviewed.

Idea description

Add a loss that prevents an intermediate feature map from being simultaneously concentrated inside a porous spatial region and a porous frequency region. The regularizer is based on the fractal uncertainty inequality: if frequency support is restricted to a porous set Y, then the fraction of feature energy inside a porous spatial set X is at most C h^beta; violations of this bound are penalized.

Formulas

$$\operatorname{supp}\widehat{f}\subseteq Y\quad\Longrightarrow\quad\|\mathbf{1}_{X}f\|_{L^{2}(\mathbb{R})}\leq Ch^{\beta}\|f\|_{L^{2}(\mathbb{R})}.$$
$$\mathcal{L}_{\mathrm{FUP}}(z)=\left[\log\frac{\|M_Xz\|_2^2+\varepsilon}{C h^{2\beta}(\|z\|_2^2+\varepsilon)}\right]_+^2.$$
$$\mathcal{L}_{\mathrm{support}}(z)=\frac{\|(I-M_Y)Fz\|_2^2}{\|Fz\|_2^2+\varepsilon},\qquad F_{k,n}=N^{-1/2}e^{-2\pi i kn/N}.$$
$$\mathcal{L}=\mathcal{L}_{\mathrm{task}}+\lambda_{\mathrm{support}}\mathcal{L}_{\mathrm{support}}+\lambda_{\mathrm{FUP}}\mathcal{L}_{\mathrm{FUP}}.$$

Mathematical statement

The paper's central theorem states that for nu>0 there are constants C=C(nu)<infinity and beta=beta(nu)>0 such that, for 0<h<1, if X is a subset of [-1,1] that is nu-porous from scales h to 1 and Y is a subset of [-h^{-1},h^{-1}] that is nu-porous from scales 1 to h^{-1}, then every f in L2(R) satisfying supp(f-hat) subseteq Y obeys ||1_X f||_{L2(R)} <= C h^beta ||f||_{L2(R)}. Here f-hat is the Fourier transform, 1_X is the indicator of X, h is the spatial-frequency scale ratio, nu controls the size of holes in the porous sets, and C and beta depend only on nu. A set is treated as porous over a scale range when every interval at each scale in that range contains a subinterval of relative size at least nu that is excluded from the set. For a discrete feature vector z in R^N, let F be the unitary N-point DFT, M_X and M_Y be soft diagonal masks for porous spatial and frequency sets, and epsilon>0 a numerical stabilizer. Use the adapted violation loss L_FUP=[log((||M_X z||^2+epsilon)/(C h^(2 beta)(||z||^2+epsilon)))]_+^2, together with L_support=||(I-M_Y)Fz||^2/(||Fz||^2+epsilon) to encourage frequency concentration. The discrete soft-mask version is an empirical surrogate, not a direct consequence of the continuous theorem.

Implementation notes

Integrate the regularizer at the output of a convolutional block or on the token sequence entering a token-mixing layer. For a feature channel z of length N, compute the unitary FFT u=Fz. Construct M_X as a fixed or randomly translated spatial mask with holes at dyadic scales h, 2h, ..., 1; construct M_Y analogously in frequency coordinates over the reciprocal scale range. Use binary masks initially, then optionally replace them with sigmoid edges so gradients are smooth. For every selected feature channel, compute r_X=(||M_X z||_2^2+epsilon)/(||z||_2^2+epsilon) and r_Y=||(I-M_Y)u||_2^2/(||u||_2^2+epsilon). Add max(0, log(r_X/(C h^(2 beta))))^2 plus r_Y to the task loss and backpropagate through the FFT. Start with h=1/8, nu approximately 0.2, C=1, beta=0.1, lambda_support=0.01, and lambda_FUP=0.001; sweep these values because the theorem does not provide directly usable numerical constants. The mathematical quantities are the energy ratio and uncertainty threshold; C, beta, and the discrete porous masks are empirical approximations. First test on CIFAR-10 with a small ResNet-18 against the baseline and an ordinary high-frequency penalty at equal training FLOPs. Measure clean accuracy, corruption accuracy, localized-occlusion robustness, and the joint spatial-frequency concentration ratio on held-out examples. Success means similar clean accuracy with lower corruption or occlusion degradation and reduced joint concentration; failure is substantial accuracy loss or optimization instability.

Verification

This idea has not been verified yet.

Verification happens in two stages: Stage 1 — a mechanism check on a toy system confirms the claimed mathematical phenomenon reproduces; Stage 2 — a benchmark implements the idea on a real (small) neural network task and compares it against a tuned baseline over 8 paired seeds with a permutation test.

Artifacts

Artifacts unavailable.