Polyhedral degree-budget regularizer
Implementation & benchmark of arXiv:2608.20778 — Resistance Curvature: Recognition, Polyhedral Structure, and Graph Products
Source paper: Resistance Curvature: Recognition, Polyhedral Structure, and Graph Products arXiv:2608.20778 ⓘ · analyzed Sep 1, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Train a graph neural network with a learnable fractional graph mask constrained toward the tree-double-matching polytope. This gives the model a global connectivity constraint while penalizing attention patterns that concentrate too many incident edges on individual vertices.
Formulas
Mathematical statement
The feasible region is Theta(G)=P(G) intersection 2M(G). A point x in P(G) satisfies the spanning-tree mass constraint x(E)=n-1 and rank inequalities x(E(S))<=|S|-1, which discourage allocating all mask mass inside a disconnected or overly concentrated subgraph. Membership in 2M(G) includes the local degree constraints x(E(v))<=2 and scaled matching odd-set constraints. For a neural mask a_e, use a differentiable penalty relaxation: enforce total mask mass near n-1, penalize violated subset rank inequalities, and penalize degree budgets above two. Since enumerating every subset S is infeasible, use an active-set approximation containing neighborhoods, connected components, and empirically discovered violated cuts. This transfers the paper's polyhedral structure directly as a global sparsity-and-connectivity regularizer rather than as an ordinary L1 penalty.
Implementation notes
Insert the mask directly before aggregation in a GNN or graph transformer. For each edge e=(u,v), compute a raw score q_e from the endpoint embeddings and set a_e=epsilon+(1-2epsilon)sigmoid(q_e), so every edge remains numerically available while the learned values become sparse. Add L_poly to the task loss. In every minibatch, evaluate the global mass constraint and all vertex degree constraints. Maintain an active subset family C for rank inequalities: initialize C with local neighborhoods and connected components, then every K optimization steps identify the most violated cuts using a min-cut or separation routine, add the five worst violations, and remove constraints that remain inactive for several epochs. Anneal alpha, beta, and gamma from zero during the first 10% of training to avoid early optimization collapse. The exact computed object is a penalty relaxation of Theta(G); the finite active set is an empirical approximation to all cut constraints. Test a 3-layer GraphSAGE and GAT on Cora, PubMed, and ogbn-arxiv against standard attention, L1 edge sparsity, and top-k pruning at matched average edge count. Record accuracy, peak GPU memory, effective edge count, connected components after thresholding, maximum mask degree, and training variance. The target is equal accuracy with n-1 to 2(n-1) effective edges and fewer disconnected supports than L1 or top-k baselines.
Verification
This idea has not been verified yet.
Verification happens in two stages: Stage 1 — a mechanism check on a toy system confirms the claimed mathematical phenomenon reproduces; Stage 2 — a benchmark implements the idea on a real (small) neural network task and compares it against a tuned baseline over 8 paired seeds with a permutation test.
Artifacts
Artifacts unavailable.