Almost-linear Zarankiewicz bounds in $1$-semi-equational theories

arXiv:2608.25464 2026 Architecture 1 ideas extracted · analyzed Aug 29, 2026

What the math gives to ML

The paper provides incidence bounds that turn a structural restriction on learned relations—being free of a fixed complete bipartite or multipartite pattern—into an almost-linear edge budget. For a binary relation represented by a Boolean combination of m structured predicates, the number of active edges is only linear up to a polylogarithmic factor, rather than quadratic. This suggests sparse attention or retrieval layers whose connectivity is generated by hierarchical, laminar predicates and explicitly prevented from forming large bicliques. The theorem does not guarantee that such sparsification preserves task accuracy, so the right test is whether the resulting mask achieves lower attention FLOPs at matched perplexity or accuracy.

Ideas from this paper

Unverified 2026

Biclique-free hierarchical attention

Replace dense token-to-token attention by a learned binary relation generated from a small number of hierarchical predicates, while rejecting masks that contain a fixed K_{t,t} biclique. The paper's incidence bound predicts near-linear active edges for these structured relations, giving sparse attention with a measurable worst-case complexity target rather than relying only on average sparsity.

Useful6/10
Difficulty6/10
Novelty6/10
Paper: Almost-linear Zarankiewicz bounds in $1$-semi-equational theories arXiv:2608.25464