Sharp Asymptotics for the Largest Component in the Subcritical Regime of Preferential Attachment Without Vertex Growth

arXiv:2607.00731 2026 Architecture 1 ideas extracted · analyzed Aug 30, 2026

What the math gives to ML

The paper gives a sharp, explicit law for the largest connected component in a degree-biased random graph before its percolation transition: with edge count m=m_c(1-epsilon), the largest component has scale epsilon^{-2} log(epsilon^3 n). This can transfer to sparse neural connectivity, where preferentially sampled edges create hub-like communication patterns without crossing into a giant connected component. The most promising use is to generate sparse attention or message-passing masks from a target component-size budget, then add a few explicit global-token links if cross-component communication is needed.

Ideas from this paper

Unverified 2026

Subcritical Preferential Sparse Attention

Construct a sparse attention or message-passing mask by sampling edges with preferential weights (d_u+alpha)(d_v+alpha), while keeping the edge count below the predicted connectivity threshold. This creates hub-like local communication patterns but prevents one giant component from forcing dense information mixing, reducing attention cost and potentially mitigating oversmoothing.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Sharp Asymptotics for the Largest Component in the Subcritical Regime of Preferential Attachment Without Vertex Growth arXiv:2607.00731