Isomorphism of tournaments with bounded VC dimension
arXiv:2608.14486
2026
Memory
1 ideas extracted · analyzed Sep 1, 2026
What the math gives to ML
The useful transferable object is the Sauer–Shelah restriction bound: a set system with VC dimension d induces at most 1+|Y|^d distinct restrictions on any sampled subset Y, even when the ambient universe is large. Thresholded attention neighborhoods form such a set system, so queries with identical sampled-key incidence patterns can share routing or key-value aggregation work. The dual-family inequality permits estimating complexity from either query-side or key-side patterns, selecting the cheaper grouping direction. This is most promising as adaptive attention and KV-cache compression, although experiments must quantify the approximation error introduced by thresholding real-valued attention.
Ideas from this paper
Unverified
2026
Convert attention scores into binary incidence set systems at one or several score thresholds, then group queries that induce the same sampled-key pattern. Compute the expensive key-value aggregation once per pattern and reuse it for all queries in the group. The method is exact for the thresholded routing component and approximates dense attention when queries have a small number of stable high-weight neighborhoods.
Useful5/10
Difficulty6/10
Novelty7/10