One-Shot Information Theory via the Pairwise Error Probability: Lossy, Joint Source-Channel, Erasure, and Multiuser Coding

arXiv:2608.15169 2026 Theory 1 ideas extracted · analyzed Sep 1, 2026

What the math gives to ML

The paper isolates a rank-based primitive: compare a candidate against a randomized reference candidate, define its pairwise error probability (PEP), and obtain an exactly uniform score for a reference draw even when model scores contain ties. The tail-quantile inverse map converts this scalar PEP into a measurable rank threshold, allowing arbitrary score scales to be replaced by distribution-calibrated acceptance regions. A transferable neural-network use is calibrated selective prediction, retrieval, or generative decoding: convert logits or compatibility scores into randomized PEP values and use fixed thresholds to control abstention or candidate-list size. The main benefit is an exact finite-sample calibration target under a chosen reference distribution, rather than a direct improvement to representation quality.

Ideas from this paper

Unverified 2026

Uniform PEP selective decoding

Replace raw neural scores with randomized pairwise-error probabilities relative to a reference candidate distribution. Use a fixed PEP threshold to accept, abstain, or form a variable-size candidate list; exact uniformity under the reference law makes the threshold interpretable independently of the model's score scale and robust to ties.

Useful5/10
Difficulty4/10
Novelty5/10
Paper: One-Shot Information Theory via the Pairwise Error Probability: Lossy, Joint Source-Channel, Erasure, and Multiuser Coding arXiv:2608.15169