Unverified
2026
Replace repeated fine-scale message passing on a recursively constructed graph by a finite-state compositional module that summarizes each cell through boundary connectivity states. Child summaries are combined only through admissible configurations, so the network can represent globally consistent paths and forests without enumerating full walks. The same update map is shared across all hierarchy levels, giving logarithmic-depth computation in the graph diameter and a strong inductive bias for…
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Add a structural penalty to a learned hypergraph or sparse routing graph that measures the gap between its conjugate vertex-degree spectrum and the squared spectrum of its up-Laplacian. The paper's identity says this gap equals twice the number of failed elementary shifts, so minimizing it encourages an ordered incidence structure rather than merely matching degree statistics or sparsity.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace a learned nonnegative banded transition matrix by an ordered product of learnable stochastic bidiagonal factors. Each factor performs one local left or right transport step, so a product of p lower and q upper factors creates an effective bandwidth of p+q while retaining nonnegative entries, row sums equal to one, and a highly structured propagation kernel.
Useful6/10
Difficulty3/10
Novelty7/10
Unverified
2026
Replace dense attention or strictly local windows with a refreshed sparse communication graph whose edge lengths follow a truncated power law. For sequence positions or image patches at distance $r$, sample edges with probability proportional to $(1+r)^{-(d+\alpha)}$; in the regime $0<\alpha<d$, repeated layers should spread information across the sequence much faster than a local window while using only $O(nk)$ edges per layer. The main test is whether this preserves long-range accuracy at…
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace dense spatial attention on a 2D feature grid by attention from every non-landmark token to a small periodic set of landmark tokens. Choose landmarks using the paper's residue construction so that every non-landmark token has at least one landmark exactly k Manhattan steps away. Use this guaranteed edge as a sparse global-information route, combined with a cheap local convolution or residual path for accuracy.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Construct one reference Lanczos basis for a symmetric propagation operator H, then derive several seed-specific spectral responses for Q_a(H)x_0 through finite-band polynomial connectors. With degree-r seeds, each transformed basis vector uses at most 2r+1 neighboring reference basis vectors, avoiding a separate Lanczos factorization for every seed.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Add a metric-aware front end that represents an arbitrary object x by its distances to a fixed set of reference objects rather than forcing x into a Euclidean or Hilbert embedding. Feed the resulting profile through a learned projection and concatenate it with the ordinary neural representation. This should be useful for graphs, trees, distributions, and sets where generic vectorization loses geometry or requires an expensive object-specific encoder.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Turn a small base message-passing graph into a family of larger graphs by replicating every base node across a finite fiber and wiring replicas with permutations derived from a group extension. Use one shared local neural update on every lifted copy, so parameter count stays that of the base graph while the lifted graph supplies additional global paths and larger effective receptive fields.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace random or degree-based graph positional anchors with a greedy set chosen to maximize the entropy of the graph's Weisfeiler-Lehman equivalence partition. Give each selected anchor a unique trainable embedding, then run several WL-inspired refinement rounds to produce positional cell features. The resulting positional signal should distinguish nodes that ordinary message passing treats identically while using only a small anchor budget.
Useful6/10
Difficulty4/10
Novelty5/10
Unverified
2026
Represent a multiparameter feature stream as a direct sum of interval modules over the nonempty-subset lattice of several corruption, scale, or context variables. Each learned channel is active only on a connected order-convex region of the lattice, replacing a dense bank of unrelated per-condition adapters with reusable feature channels having explicit parameter-space lifetimes.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Treat the hidden-state Jacobian of an RNN, SSM, or graph neural network as a directed matrix-weighted network and decompose repeated block couplings into scalar interaction layers. Use layer-specific structural controllability to select input, skip, reset, or readout channels that can reach all hidden dimensions, and reject architectures with structurally unreachable states before training.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace a dense token or state-mixing matrix with an inverse-capacitance operator whose couplings decay with graph distance, while introducing trainable heterogeneous diagonal capacitances to break spatial symmetries. The layer is cheap because the capacitance matrix is sparse and banded, but its inverse produces global responses with controllable locality.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Build a refined Freudenthal-Kuhn simplicial graph over mesh vertices or geometric samples and inject its piecewise-linear metric into attention logits. Refinement is increased until the explicit distortion target is met, making attention scores less sensitive to arbitrary mesh resolution, triangulation, or local curvature.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Represent each Euclidean input point by its responses to randomly sampled half-spaces, then center those responses by the minibatch or source-distribution half-space occupancy. Use squared distances between these representations as a geometry-preserving substitute for raw Euclidean distances in graph-NN edge construction, cross-domain retrieval, or geometry-aware attention. The layer can compare point clouds from different ambient dimensions because each domain has its own half-space dictionary…
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Compress representations of graph fragments according to their empirical edge-connection rank instead of using a generic hidden dimension. For fragments with t open ends, learn only the quotient space of boundary behaviors that remain distinguishable after gluing, producing a compositional graph network whose boundary-state dimension is capped by an estimated R^t.
Useful6/10
Difficulty7/10
Novelty7/10
Unverified
2026
Replace node-restricted graph prototypes by centers that may lie at arbitrary coordinates on graph edges. For each prototype, hold its assigned points and shortest-path branches fixed, then update its edge coordinate by an exact clipped weighted least-squares formula; recompute branch changes only at arc bottleneck points. This creates a graph-aware vector-quantization or retrieval module that can represent semantic locations between existing nodes.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Construct a graph on tokens using a cheap similarity or k-nearest-neighbor rule, partition it into small-radius pieces, and use one pooled state per piece for cross-piece communication. The paper's bound guarantees that the total number of vertices exposed by all one-hop piece neighborhoods is at most 4n, so the routing graph can have linear rather than quadratic communication budget. The approximation is controlled by increasing the number of within-piece basis summaries rather than making…
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace fixed sparse masks with a stochastic birth-death process for neural connections or spatial units. A diffusing morphogen-like utility field controls where connections are added or removed, while a local simple-point test rejects removals or additions that would disconnect a layer or alter a prescribed computational topology. This creates an adaptive sparse architecture with a tunable compact-to-branched transition rather than unconstrained magnitude pruning.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Turn the paper's graphon refinement operation into an adaptive mixture-of-experts or relational-attention router whose number of blocks is learned rather than fixed. Split a block when its members produce incompatible constraint gradients, and merge blocks when their relation rows are statistically indistinguishable, yielding a compact architecture that grows only where the data require extra structure.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Turn stochastic edge thinning into a mass-aware graph sparsifier: first form retained connected blobs, then connect blob summaries using the rank-one shortcut probability from the paper. Choose the retention rate below the explicit subcritical threshold so the contracted graph remains a collection of small decorations around leading blobs, reducing message-passing cost without creating an artificial giant component.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Construct a sparse routing or graph-neural architecture whose activation gates satisfy a hard-core constraint: neighboring sites, experts, or token groups cannot be active simultaneously. Compare the same local routing rule on bipartite and random regular interaction graphs; the graph structure should change the maximum usable activation dimension and may also change optimization stability.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace ordinary graph propagation, which repeatedly revisits the edge it just traversed, with a directed-edge non-backtracking operator. Normalize its learned gain using an estimate of the Hashimoto spectral radius so that feature magnitudes neither explode on high-growth graphs nor vanish on sparse graphs.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Give each query-token pair a positive adaptive edge weight that evolves by a multiplicative rule instead of relying only on instantaneous dot-product attention logits. Edges whose aggregate interaction is useful can grow, while overloaded or incompatible neighborhoods can shrink. Sparse initialization is preserved because an edge initialized at zero remains zero under the multiplicative dynamics.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Add a learned scalar ordering to a directed graph attention layer and retain only forward edges, producing a DAG attention mask without requiring a supplied topological order. Train the ordering with a differentiable surrogate for weighted surplus, and regularize it toward the paper's explicit half-weight-minus-l2 certificate. This supplies a principled alternative to random masking or unconstrained bidirectional graph attention when causal or hierarchical information flow is desirable.
Useful6/10
Difficulty5/10
Novelty8/10