Architecture ideas

Research ideas extracted from mathematics papers, categorized as Architecture.

Unverified 2026

Spherical Height-Routed Multiscale Network

Replace an unconstrained deep routing tree by a q-ary descendant hierarchy with an explicit even height h=0,2,4,... labeling feature scale or computation depth. Train the router so that empirical occupancy of heights follows the exact even-sector law from the Nagao quotient, preventing concentration at shallow layers or unstable overuse of very deep paths.

Useful5/10
Difficulty5/10
Novelty6/10
Paper: $K$-spherical horospherical averages on the Nagao quotient: tree combinatorics and exact discrepancy arXiv:2607.08704
Unverified 2026

Ensemble-Averaged Sparse Graph Search

Replace a binary neural connectivity mask by independent Bernoulli edge probabilities and optimize a deterministic expected message-passing objective before discretization. The resulting module can search sparse GNN edges or expert-to-token routes without repeatedly sampling many discrete architectures during training.

Useful5/10
Difficulty5/10
Novelty5/10
Paper: Learning LDPC codes with quantized density evolution over relaxed protographs arXiv:2607.08484
Unverified 2026

Charge-conserving Z3 neural block

Represent each feature as belonging to one of three \(\mathbb{Z}_3\) charge sectors and constrain every linear and multiplicative operation to obey charge addition modulo 3. Add invariant cubic gates such as \(x_1x_2x_3\) or \(x_q^3\), which can express the same phase-insensitive interaction selected by the paper's three-photon drive. This should improve data efficiency and exact cyclic-augmentation consistency when the task has a genuine ternary symmetry.

Useful5/10
Difficulty4/10
Novelty6/10
Paper: Quantum and Classical Potts Criticality in Driven-Dissipative Bosonic Lattices arXiv:2607.08425
Unverified 2026

Compact Abelian Graph Positional Codes

Replace one-hot node IDs or large positional encodings in a GNN with coordinates from a compact abelian Cayley graph. The coordinates preserve graph-shortest-path geometry exactly, while Fourier characters of cyclic factors provide smooth neural features with fewer channels.

Useful5/10
Difficulty7/10
Novelty7/10
Paper: Dimension and Order Bounds for Isometric Embeddings of Graphs into Abelian Cayley Graphs, and the Abelian Dividend arXiv:2607.07939
Unverified 2026

Masked Universal Host Layer

Represent many related sparse graph or attention patterns inside one fixed host connectivity pattern and activate each target instance with binary directional masks. The learned edge transformation and sparse-kernel layout are shared across instances, while the mask selects the target graph, enabling one compiled operator to process heterogeneous structures.

Useful5/10
Difficulty5/10
Novelty5/10
Paper: A universal emulator for planar Ising lattices arXiv:2607.05308
Unverified 2026

Matroid-rank interaction bottleneck

Construct a candidate feature for every edge pair or structured token pair, then retain a numerically independent subset under a feature-Jacobian matroid. The neural layer computes only the selected interactions, preserving directions that add new information rather than pruning solely by magnitude or attention score.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Analytic Spread via Linear Matroids arXiv:2607.07458
Unverified 2026

Four-Root Ternary Mixer

Replace a generic three-input concatenation MLP with a permutation-symmetric mixer built from the four signed combinations x+y-z, x-y+z, -x+y+z, and -x-y-z. Apply a shared truncated exponential to these combinations and aggregate symmetric pairwise products, producing controlled quadratic and higher-order interactions without materializing a full trilinear tensor.

Useful5/10
Difficulty4/10
Novelty7/10
Paper: On $η$-periodic Formal Ternary Laws arXiv:2607.06795
Unverified 2026

Random-label irregular sparse attention

Construct a sparse attention mask from a fixed regular candidate graph and one scalar random label per token, retaining edge $(u,v)$ when $x_u+x_v\geq\tau$. Unlike independent random pruning, this produces correlated neighborhoods and a controllable distribution of token degrees, potentially giving some tokens broad receptive fields while retaining a fixed sparse budget.

Useful5/10
Difficulty3/10
Novelty7/10
Paper: Irregular subgraph in a regular graph arXiv:2607.06465
Unverified 2026

Patterned-Walk Graph Signature

Augment a graph neural network or graph transformer with counts of cyclic walks whose successive steps are required to be graph edges or graph non-edges according to a binary pattern. These features encode induced-subgraph structure that ordinary adjacency powers miss, and can be concatenated to the graph-level token or used as an auxiliary prediction target.

Useful5/10
Difficulty4/10
Novelty7/10
Paper: Generalized spectral closedness of $\mathcal{F}$-free graph classes arXiv:2607.06455
Unverified 2026

Cyclic Non-Backtracking Mixer

Replace a dense token or channel mixing matrix by a fixed sparse directed graph whose states are ordered pairs of symbols and whose transitions advance through a cyclic phase. Each state has exactly two allowed successors, obtained by appending a symbol different from the previous two, producing a strongly connected, vertex-transitive sparse mixer with shared local dynamics. The prescribed phase structure prevents arbitrary short-cycle routing and can act as an anti-collapse inductive bias in…

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Long Directed Cycles in Vertex-Transitive Digraphs arXiv:2607.05807
Unverified 2026

Rigidity-Calibrated Set Attention

Augment pairwise attention on a set of n tokens with a rigidity operator derived from normalized pairwise directions. The operator couples infinitesimal node displacements through changes in pairwise distances, while the complete-graph theorem provides a geometry-independent eigenvalue target n/2 after spherical centering and normalization.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: The Second Largest Eigenvalue of Stiffness Matrices of Normalized Complete Frameworks arXiv:2607.05472
Unverified 2026

Microscopic Boundary Pooling

Replace uniform set or point-cloud pooling with a microscopic weighting computed from pairwise feature-space distances. The resulting signed pooling vector should retain boundary and geometrically isolated points that ordinary mean pooling suppresses, potentially improving recognition when class information is concentrated on shape extremities or rare local configurations.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: The microscopic weighting on a metric space arXiv:2607.05349
Unverified 2026

Noncommutative path-word pooling

Replace ordinary bag-of-events pooling for an ordered trajectory, graph walk, or token event stream with a reduced-word representation in a free group. Each event contributes a signed group word, and the model aggregates signed differences (w-1), preserving order-sensitive information while making explicitly paired local events cancel.

Useful5/10
Difficulty6/10
Novelty8/10
Paper: Homotopy index polynomials for knotoids arXiv:2607.04737
Unverified 2026

Matroid-circuit equivariant message passing

Represent each matroid circuit as a structured hyperedge and perform message passing from circuit embeddings back to their constituent elements. Tie all circuit-update parameters that lie in the same automorphism orbit, so relabelings preserving the matroid produce exactly relabeled hidden states rather than requiring the network to learn this symmetry from data.

Useful5/10
Difficulty5/10
Novelty6/10
Paper: Encoding matroids into quantum states arXiv:2607.02736
Unverified 2026

Subcritical Preferential Sparse Attention

Construct a sparse attention or message-passing mask by sampling edges with preferential weights (d_u+alpha)(d_v+alpha), while keeping the edge count below the predicted connectivity threshold. This creates hub-like local communication patterns but prevents one giant component from forcing dense information mixing, reducing attention cost and potentially mitigating oversmoothing.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Sharp Asymptotics for the Largest Component in the Subcritical Regime of Preferential Attachment Without Vertex Growth arXiv:2607.00731
Unverified 2026

PED finite-state graph layer

Add a finite-state message-passing layer that tracks local configurations corresponding to perfect edge domination or dominating induced matchings instead of transmitting unconstrained node embeddings alone. On graphs with a tree, series-parallel, or small-separator decomposition, the layer produces an exact or differentiable partition function over globally valid edge configurations, which can be used as node features, an auxiliary loss, or a structural prior.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Counting perfect edge dominating sets: extremal results and linear-time algorithms arXiv:2607.03894
Unverified 2026

Leading-Term Strand Router

Build a sparse neural mixing layer from colored directed strands rather than a dense all-to-all matrix. Feature channels are assigned ordered colors, local trivalent junctions conserve every color, and an edge width is the weighted sum of the colors carried by that edge; a differentiable penalty favors monotone, crossing-free routings that define a canonical leading term. This creates a structured routing prior that can be compared directly against dense attention and unconstrained sparse…

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Leading term strandings for webs arXiv:2608.27425
Unverified 2026

Boxicity-guided constraint attention

Replace an unconstrained pairwise attention score with an intersection of coordinate-wise threshold or interval compatibility heads. Each head is a supergraph that permits pairs satisfying one constraint, while the final attention edge exists only when every head permits the pair. This provides an interpretable inductive bias for multi-constraint relations and prevents the model from approximating a conjunction using a single unstable nonlinear score.

Useful5/10
Difficulty5/10
Novelty8/10
Paper: Boxicity and Threshold Dimension of Zero Divisor Graphs arXiv:2608.27381
Unverified 2026

Joint Bochner-Riesz Bilinear Graph Layer

Replace an unconstrained bilinear feature interaction with a joint spectral filter that only allows pairs of graph or spherical frequencies satisfying a soft radius constraint. The smooth factor attenuates interactions near and beyond the cutoff instead of making the hard low-pass decision used by ordinary spectral truncation, which should reduce high-frequency aliasing and unstable feature products.

Useful5/10
Difficulty6/10
Novelty6/10
Paper: Bilinear Bochner--Riesz Means on the Complex Sphere arXiv:2608.25884
Unverified 2026

Möbius-compressed circular latent states

Represent a population of N circular latent states using a three-parameter Möbius transformation applied to fixed uniform reference phases, rather than learning N unrelated angles. The resulting states remain on the circle by construction and can model concentrated or nearly uniform phase populations through a single concentration parameter.

Useful5/10
Difficulty4/10
Novelty7/10
Paper: Unstable Manifolds for the Kuramoto Model: Convergence to the Ott-Antonsen Manifold arXiv:2608.24453
Unverified 2026

Reliability-gated Laplacian positional encodings

Construct metric-graph Laplacian positional encodings only at frequencies whose empirical eigenvalues are statistically stable under the paper’s $(n v_\mu(h))^{-1/2}$ law. Use local ball-mass estimates and empirical eigengaps to gate or downweight unreliable eigenvectors, preventing small-sample spectral noise from entering a GNN or graph transformer.

Useful5/10
Difficulty4/10
Novelty5/10
Paper: Spectral stability of empirical metric-measure Laplacians arXiv:2608.23150
Unverified 2026

Conservative amortized collision layer

Add a learned stochastic pair-interaction layer to a particle graph neural network, with a conditional normalizing flow generating the post-interaction relative state. Parameterize the update in center-of-mass and invariant relative coordinates so every sampled interaction preserves pair momentum and kinetic energy exactly. The flow learns the transition law directly from observed scattering or trajectory data, replacing repeated numerical collision solves or unconstrained message-passing…

Useful5/10
Difficulty6/10
Novelty6/10
Paper: A particle method for the Boltzmann equation via amortized sampling from Green's function of the lifted linear operator arXiv:2608.22880
Unverified 2026

S3-Holonomy Message Passing

Build a graph neural network on the dual graph of a triangulated surface whose messages are transported by \(\mathfrak{S}_3\) permutation matrices associated with adjacent-face color transports. This removes dependence on arbitrary local color-label choices and gives the network an explicit representation of noncontractible topology through holonomy around cycles.

Useful5/10
Difficulty5/10
Novelty6/10
Paper: Congruence classes of monodromies of even triangulations arXiv:2608.22814
Unverified 2026

Pole-Tuned Graph Residual Layer

Use the graph Laplacian spectrum to set the mixing and correction coefficients of a two-state graph-propagation block. Balancing the contraction of low-frequency consensus modes against high-frequency disagreement modes may reduce oversmoothing and make deep graph-neural networks less sensitive to manually selected residual coefficients.

Useful5/10
Difficulty6/10
Novelty5/10
Paper: Optimal Parameter Design for DIGing on Minimizing Unweighted Sum of Squares arXiv:2607.25463