Critical 2d Intensity Bottleneck
Implementation & benchmark of arXiv:2608.15003 — The Minimum Number of Measurements for Almost-Everywhere Complex Phase Retrieval
Source paper: The Minimum Number of Measurements for Almost-Everywhere Complex Phase Retrieval arXiv:2608.15003 ⓘ · analyzed Sep 1, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Replace a complex latent vector x in C^d by squared magnitudes of m learned complex linear projections. Set m equal to 2d: the paper proves that m less than or equal to 2d minus 1 cannot generically preserve the latent up to global phase, whereas m equal to 2d is generically sufficient, giving a principled minimal width for a phase-invariant neural bottleneck.
Formulas
Mathematical statement
Let T be the unit circle in C, defined by T = {omega in C : |omega| = 1}, and define x equivalent to y when y = omega x for some omega in T. The quotient space Q_d = C^d/T contains complex vectors modulo global phase. For measurement vectors F = (f_j) from C^d, define the intensity map M_F from Q_d to R^m by M_F([x]) = (|<x,f_j>|^2) for j from 1 to m. Phase retrieval almost everywhere means that the inverse fiber M_F^{-1}(M_F([x])) equals the singleton {[x]} for almost every [x]. The paper proves that if m is less than or equal to 2d minus 1, no measurement family F has this property, while generic F with m equal to 2d does. The neural adaptation uses z in C^d, learnable F, and b_j = |<z,f_j>|^2, thereby retaining z modulo only the unavoidable global phase.
Implementation notes
Integrate this at the latent bottleneck of a complex-valued autoencoder, VAE, or complex feature extractor. Let the preceding network output z in C^d, represented by two real tensors zr and zi with shape [batch, d]. Store a learnable complex measurement matrix F with shape [m, d], initialize it with independent complex Gaussian entries, and row-normalize it. Compute u = einsum('bd,md->bm', z, conjugate(F)) and b = real(u times conjugate(u)); optionally apply log1p(b) followed by per-channel normalization before feeding b to the decoder. Use m = 2d for the proposed bottleneck. If the decoder must reconstruct a complex vector, compare against a canonical-phase target: rotate each target so its largest-magnitude coordinate is real and positive, because the measurements identify only the equivalence class [z]. The core pseudocode is: u = z @ conjugate(F).T; b = real(u * conjugate(u)); output = decoder(log1p(b)); loss = task_loss(output, target) plus beta times reconstruction_loss(output, target). The theorem determines the width threshold, while F is learned by ordinary backpropagation. First test a small complex autoencoder on synthetic Gaussian complex vectors and CIFAR-10 features with d equal to 8, 16, and 32, comparing m = 2d - 1, 2d, and 2d + 4 against a standard 2d-real-coordinate bottleneck at comparable storage. Record reconstruction MSE, downstream accuracy, activation memory, and optimization stability. The expected falsifiable result is a sharp reconstruction gap for 2d - 1 and recovery of the overcomplete baseline at m = 2d. Also compare frozen random F with learned F to separate identifiability from optimization effects.
Verification
This idea has not been verified yet.
Verification happens in two stages: Stage 1 — a mechanism check on a toy system confirms the claimed mathematical phenomenon reproduces; Stage 2 — a benchmark implements the idea on a real (small) neural network task and compares it against a tuned baseline over 8 paired seeds with a permutation test.
Artifacts
Artifacts unavailable.