Nyström Error Beyond $M$-Matrices: A Minimal Diagonally Dominant Obstruction

arXiv:2607.19282 2026 Memory 1 ideas extracted · analyzed Aug 30, 2026

What the math gives to ML

The paper identifies a concrete failure mode for column-selected Nyström approximation: diagonal dominance without the sign restriction of an M-matrix does not guarantee diminishing returns, and a signed three-node interaction is already sufficient. This matters for low-rank attention, kernel transformers, and inducing-point methods, where greedy landmark selection is often assumed to improve monotonically. The transferable asset is a cheap diagnostic and pairwise-lookahead selection rule based on the exact Schur-complement residual, rather than trusting one-step greedy gains. The method is most promising for small or medium landmark budgets, where evaluating a restricted set of candidate pairs is affordable.

Ideas from this paper

Unverified 2026

Signed-triangle Nyström lookahead

Replace one-step greedy landmark selection in Nyström attention or kernel compression with a restricted pairwise-lookahead rule. The lookahead is motivated by the paper's explicit obstruction: a signed triangle can make individual column gains exhibit increasing rather than diminishing returns, so the best next column need not belong to the best pair.

Useful5/10
Difficulty5/10
Novelty4/10
Paper: Nyström Error Beyond $M$-Matrices: A Minimal Diagonally Dominant Obstruction arXiv:2607.19282