Unverified 2026

Hadamard fractal Fourier encoding

Implementation & benchmark of arXiv:2607.15743 — Spectral eigenvalue set of self-similar measures associated with product-form Hadamard triples

Usefulness5/10
Difficulty4/10
Novelty5/10

Source paper: Spectral eigenvalue set of self-similar measures associated with product-form Hadamard triples arXiv:2607.15743 ⓘ · analyzed Aug 30, 2026

AI-generated research hypothesis, automatically tested. Not peer-reviewed.

Idea description

Construct positional features from a self-similar digit system whose Fourier characters are orthogonal under a prescribed nonuniform measure, rather than sampling frequencies independently. Use several admissible multiplier values to create frequency bands while preserving the underlying Hadamard structure, giving a deterministic multiscale encoding with a better-conditioned feature Gram matrix on fractal or highly clustered coordinates.

Formulas

$$\phi_d(x)=\frac{1}{N}(x+d),\qquad \mu=\frac{1}{\#\mathcal D}\sum_{d\in\mathcal D}\mu\circ\phi_d^{-1}.$$
$$H_{d,l}=\frac{1}{\sqrt{q}}\exp\!\left(2\pi i\frac{dl}{N}\right),\qquad H^*H=I_q,\quad q=\#\mathcal D.$$
$$\Lambda_J=\left\{\sum_{j=0}^{J-1}l_jN^j:\ l_j\in\mathcal L\right\},\qquad \gamma_\lambda(x)=e^{2\pi i\lambda x}.$$
$$V^{(s)}(\mu,\mathcal T_*)=\left\{\Lambda:t\Lambda\text{ is a spectrum of }\mu\ \forall t\in\mathcal T_*,\ \dim_{Be}(\Lambda)=s\right\},\qquad 0\le s\le\frac{\log q}{\log N}.$$

Mathematical statement

The paper studies the self-similar probability measure defined by the iterated maps \(\phi_d(x)=N^{-1}(x+d)\), with digit set \(\mathcal D\) of size \(q=\#\mathcal D\), equivalently \(\mu=q^{-1}\sum_{d\in\mathcal D}\mu\circ\phi_d^{-1}\). A digit-frequency set \(\mathcal L\) is a Hadamard complement when the matrix \(H_{d,l}=q^{-1/2}e^{2\pi i dl/N}\), for \(d\in\mathcal D\) and \(l\in\mathcal L\), is unitary; this gives exact cancellation of distinct Fourier characters on each refinement level. The resulting spectrum is represented by finite base-\(N\) digit sums \(\lambda=\sum_{j=0}^{J-1}l_jN^j\), where every \(l_j\in\mathcal L\). The paper defines \(V^{(s)}(\mu,\mathcal T_*)=\{\Lambda:t\Lambda\text{ is a spectrum of }\mu\ \forall t\in\mathcal T_*,\ \dim_{Be}(\Lambda)=s\}\), and proves continuum many such spectra for every \(s\in[0,\log q/\log N]\). Here \(N\) is the dilation base, \(\mathcal D\) is the spatial digit set, \(\mathcal L\) is the frequency digit set, \(\Lambda\) is the generated frequency set, \(\mathcal T_*\) is the admissible multiplier set, and \(\dim_{Be}\) is box-counting dimension. The neural adaptation uses the unitary Hadamard condition to control feature correlations and selected multipliers \(t\in\mathcal T_*\) to generate valid frequency bands.

Implementation notes

Integrate this at the input embedding of a coordinate MLP, NeRF, or implicit image representation. Normalize each scalar coordinate to the interval containing the target support. Choose a small base \(N\), spatial digit set \(\mathcal D\), and frequency digit set \(\mathcal L\) with equal cardinality \(q\); enumerate small integer candidates until \(\|H^*H-I_q\|_F<10^{-6}\), where \(H_{d,l}=q^{-1/2}\exp(2\pi i dl/N)\). For depth \(J\), generate frequencies by the recursion \(\Lambda_0=\{0\}\) and \(\Lambda_{j+1}=\{\lambda+lN^j:\lambda\in\Lambda_j,\ l\in\mathcal L\}\). For each selected multiplier \(t\), produce real features \([\cos(2\pi t\lambda x),\sin(2\pi t\lambda x)]\) and concatenate them before the MLP. Pseudocode: initialize an empty list; for each \(j=0,\ldots,J-1\), append \(\lambda+lN^j\) for all current \(\lambda\) and \(l\); then evaluate the trigonometric features. The Hadamard test and digit recursion are computed exactly from the paper. Estimate practical conditioning using \(G=\Phi^T\Phi/B\), where \(\Phi_{n,k}=\cos(2\pi\lambda_kx_n)\) and corresponding sine columns. Start with 1D fractal regression using a four-layer ReLU MLP, comparing against dyadic positional encoding and Gaussian random Fourier features at equal feature count. Track validation MSE, the condition number of \(G\), early loss descent at equal FLOPs, and high-frequency reconstruction error. A positive result is a lower condition number plus faster loss reduction or 1--2 dB higher PSNR at equal parameter count, especially when training coordinates are sampled from a clustered distribution approximating \(\mu\).

Verification

This idea has not been verified yet.

Verification happens in two stages: Stage 1 — a mechanism check on a toy system confirms the claimed mathematical phenomenon reproduces; Stage 2 — a benchmark implements the idea on a real (small) neural network task and compares it against a tuned baseline over 8 paired seeds with a permutation test.

Artifacts

Artifacts unavailable.