Near-Optimal Lower Bounds on One-Bit Compressed Sensing of Approximately Sparse Signals
arXiv:2607.06750
2026
Theory
1 ideas extracted · analyzed Aug 30, 2026
What the math gives to ML
The paper establishes an information-theoretic resolution floor for recovering approximately sparse vectors after one-bit linear measurements: increasing ambient dimension or decoder capacity cannot overcome the loss caused by sign quantization at fixed measurement count. The transferable asset is the explicit scaling law between effective sparsity, number of binary measurements, and achievable uniform Euclidean error, including the continuous interpolation between exact sparsity and ℓ1-type approximate sparsity. In neural networks, this can become a principled bit-budget rule and an impossibility-aware training target for binary latent bottlenecks, sign-activated encoders, and compressed communication layers rather than relying on arbitrary latent widths.
Ideas from this paper
Unverified
2026
Use the paper's one-bit compressed-sensing lower bound to choose the number of binary latent measurements and to set a nonzero achievable-error floor during training. A sign bottleneck should not be given an unrealistically small bit budget: for approximately sparse latents, the target reconstruction error scales no faster than a power of effective sparsity divided by the number of sign measurements.
Useful5/10
Difficulty4/10
Novelty7/10