Tight Conic Relaxations for Rank-one Doubly Nonnegative Matrix Completion
arXiv:2607.16796
2026
Architecture
1 ideas extracted · analyzed Aug 30, 2026
What the math gives to ML
The paper gives constructive tightness conditions for recovering a nonnegative rank-one matrix from sparse entries, expressed through the bipartite sparsity graph, local ratios, and cumulative differences around cycles. The transferable asset is a cycle-consistency certificate: multiplicative ratios along a sparse graph determine whether missing entries can be completed by a single pair of nonnegative factors. This can be used to initialize or compress nonnegative attention, router, or embedding matrices by replacing an expensive dense parameterization with graph-observed entries plus rank-one completion. The most practical first test is a cycle-certified low-rank parameterization for attention or MoE routing, with the paper's ratio bounds used as a stability diagnostic and adaptive regularizer rather than solving a full SDP during every training step.
Ideas from this paper
Unverified
2026
Represent a nonnegative attention or routing score matrix by two nonnegative vectors, X = uv^T, and learn only entries on a sparse bipartite graph of important query-key or token-expert interactions. Complete the remaining entries multiplicatively and monitor cycle residuals as a certificate of whether the sparse representation is compatible with rank one. Use local ratio violations to trigger additional edges or relax the rank-one approximation only where needed.
Useful6/10
Difficulty5/10
Novelty6/10