TOPIQ: Statistical Error Propagation for Quantity-of-Interest Prediction under Lossy Compression

arXiv:2608.26912 2026 Theory 1 ideas extracted · analyzed Aug 29, 2026

What the math gives to ML

The paper provides an operator-composable representation of compressed-data uncertainty, carrying not only the mean and variance of a signal but also compression bias, error variance, and signal-error coupling. Its key transferable asset is second-order propagation through nonlinear functions, which can turn cheap compression metadata into approximate prediction bias and uncertainty for an entire MLP or other differentiable computation graph. A practical neural-network adaptation is compression-aware inference: propagate a five-component moment tuple alongside activations, correct nonlinear means using curvature, and expose a calibrated output interval without Monte Carlo decompression or repeated forward passes. The same machinery can also select compression tolerances by constraining predicted QoI uncertainty.

Ideas from this paper

Mechanism failed Re-invented 2026

Moment-Tuple Propagation for Compressed Neural Inference

Represent each compressed input or activation as a tuple containing its clean mean, clean variance, compression bias, compression-error variance, and signal-error covariance. Propagate this tuple through affine layers exactly and through activations with a second-order Taylor correction, producing an approximate prediction mean and uncertainty from one compressed forward pass. This can replace repeated decompression or Monte Carlo perturbation when serving neural networks over lossy scientific…

Useful7/10
Difficulty5/10
Novelty6/10
Paper: TOPIQ: Statistical Error Propagation for Quantity-of-Interest Prediction under Lossy Compression arXiv:2608.26912