TOPIQ: Statistical Error Propagation for Quantity-of-Interest Prediction under Lossy Compression
arXiv:2608.26912
2026
Theory
1 ideas extracted · analyzed Aug 29, 2026
What the math gives to ML
The paper provides an operator-composable representation of compressed-data uncertainty, carrying not only the mean and variance of a signal but also compression bias, error variance, and signal-error coupling. Its key transferable asset is second-order propagation through nonlinear functions, which can turn cheap compression metadata into approximate prediction bias and uncertainty for an entire MLP or other differentiable computation graph. A practical neural-network adaptation is compression-aware inference: propagate a five-component moment tuple alongside activations, correct nonlinear means using curvature, and expose a calibrated output interval without Monte Carlo decompression or repeated forward passes. The same machinery can also select compression tolerances by constraining predicted QoI uncertainty.
Ideas from this paper
✗ Mechanism failed
Re-invented
2026
Represent each compressed input or activation as a tuple containing its clean mean, clean variance, compression bias, compression-error variance, and signal-error covariance. Propagate this tuple through affine layers exactly and through activations with a second-order Taylor correction, producing an approximate prediction mean and uncertainty from one compressed forward pass. This can replace repeated decompression or Monte Carlo perturbation when serving neural networks over lossy scientific…
Useful7/10
Difficulty5/10
Novelty6/10