Sharp Asymptotics for the Largest Component in the Subcritical Regime of Preferential Attachment Without Vertex Growth
arXiv:2607.00731
2026
Architecture
1 ideas extracted · analyzed Aug 30, 2026
What the math gives to ML
The paper gives a sharp, explicit law for the largest connected component in a degree-biased random graph before its percolation transition: with edge count m=m_c(1-epsilon), the largest component has scale epsilon^{-2} log(epsilon^3 n). This can transfer to sparse neural connectivity, where preferentially sampled edges create hub-like communication patterns without crossing into a giant connected component. The most promising use is to generate sparse attention or message-passing masks from a target component-size budget, then add a few explicit global-token links if cross-component communication is needed.
Ideas from this paper
Unverified
2026
Construct a sparse attention or message-passing mask by sampling edges with preferential weights (d_u+alpha)(d_v+alpha), while keeping the edge count below the predicted connectivity threshold. This creates hub-like local communication patterns but prevents one giant component from forcing dense information mixing, reducing attention cost and potentially mitigating oversmoothing.
Useful5/10
Difficulty5/10
Novelty7/10