Learning LDPC codes with quantized density evolution over relaxed protographs
arXiv:2607.08484
2026
Architecture
1 ideas extracted · analyzed Aug 30, 2026
What the math gives to ML
The transferable asset is a principled relaxation of a discrete graph or connectivity design problem: each binary protograph entry is treated as a Bernoulli probability, while the objective is evaluated on the corresponding ensemble rather than only on a rounded architecture. This can turn expensive discrete search over sparse neural connectivity, graph structure, or expert-routing patterns into deterministic gradient optimization, provided the network dynamics admit a tractable mean-field or message-passing expectation. The safest neural use is a graph-neural-network architecture-search module in which relaxed edge probabilities are trained jointly with weights, then thresholded and re-evaluated on sampled binary graphs to test whether the relaxed objective predicts discrete performance.
Ideas from this paper
Unverified
2026
Replace a binary neural connectivity mask by independent Bernoulli edge probabilities and optimize a deterministic expected message-passing objective before discretization. The resulting module can search sparse GNN edges or expert-to-token routes without repeatedly sampling many discrete architectures during training.
Useful5/10
Difficulty5/10
Novelty5/10