Architecture ideas

Attention variants, state-space and recurrent cells, normalization and token-mixing schemes — each tested against the standard block it replaces.

Unverified 2026

Matroid-circuit equivariant message passing

Represent each matroid circuit as a structured hyperedge and perform message passing from circuit embeddings back to their constituent elements. Tie all circuit-update parameters that lie in the same automorphism orbit, so relabelings preserving the matroid produce exactly relabeled hidden states rather than requiring the network to learn this symmetry from data.

Useful5/10
Difficulty5/10
Novelty6/10
Paper: Encoding matroids into quantum states arXiv:2607.02736
Unverified 2026

Smooth-Plus-Boundary-Lifting Network

Represent the prediction as a sum of a smooth interior branch and a fractional boundary branch: u_theta(x)=u_int_theta(x)+d(x)^a u_bd_theta(x). This mirrors the paper's direct-sum solution structure and allocates separate network capacity to the globally regular component and the boundary layer.

Useful5/10
Difficulty5/10
Novelty8/10
Paper: The structure of solution spaces for fractional-order operators, with gradient estimates arXiv:2607.02312
Unverified 2026

Tree-Cone Distribution Head

Represent a neural network's categorical output over a rooted tree using cumulative probability mass on each rooted subtree. Train pairs of examples with a stochastic-dominance loss that compares these subtree masses, avoiding enumeration of all upper sets and making hierarchical monotonicity explicit. This is suitable for taxonomies, severity levels, hierarchical intents, and structured world-model states.

Useful5/10
Difficulty3/10
Novelty4/10
Paper: Characterizing finite posets whose probabilistic powerdomain are RB-domains arXiv:2607.02231
Unverified 2026

Rank-safe Bernoulli layer initialization

Use the Bernoulli corank asymptotic to choose sparsity for binary or sparse linear layers and reject initial matrices with excessive numerical rank deficiency. The layer should also explicitly prevent zero columns, because the paper's probability law indicates that zero-column events are a leading mechanism behind large corank in the sparse regime.

Useful5/10
Difficulty4/10
Novelty5/10
Paper: Rank deficiency of Bernoulli random matrices for growing corank arXiv:2607.00495
Unverified 2026

SURE-Adaptive Derivative Front End

Prepend an adaptive Savitzky-Golay derivative bank to a temporal neural network. For each input channel and derivative order, select the local window by minimizing Stein's unbiased risk estimate, then concatenate the raw signal with the estimated derivatives. This supplies denoised velocity and acceleration features without requiring clean derivative targets or forcing the backbone to learn unstable finite-difference filters.

Useful5/10
Difficulty3/10
Novelty6/10
Paper: PDE Identification Using Noise Adaptive Differentiation in Strong Form (S-IDENT) arXiv:2606.31776
Unverified 2026

PED finite-state graph layer

Add a finite-state message-passing layer that tracks local configurations corresponding to perfect edge domination or dominating induced matchings instead of transmitting unconstrained node embeddings alone. On graphs with a tree, series-parallel, or small-separator decomposition, the layer produces an exact or differentiable partition function over globally valid edge configurations, which can be used as node features, an auxiliary loss, or a structural prior.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Counting perfect edge dominating sets: extremal results and linear-time algorithms arXiv:2607.03894
Unverified 2026

Simplex-Complexity Depth Diagnostic

Estimate the simplex-based ratio of a target or learned convex piecewise-linear polytope and use the theorem \(\rho_\Delta(P)\le 2^d-1\) to choose a minimum useful ReLU depth. During training, monitor whether the learned polytope is approaching a high-\(\rho\) target; if it is, widen the model without increasing depth only when the diagnostic indicates that depth is the bottleneck.

Useful5/10
Difficulty5/10
Novelty9/10
Paper: A simplex-based measure of symmetry arXiv:2607.03815
Unverified 2026

Leading-Term Strand Router

Build a sparse neural mixing layer from colored directed strands rather than a dense all-to-all matrix. Feature channels are assigned ordered colors, local trivalent junctions conserve every color, and an edge width is the weighted sum of the colors carried by that edge; a differentiable penalty favors monotone, crossing-free routings that define a canonical leading term. This creates a structured routing prior that can be compared directly against dense attention and unconstrained sparse…

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Leading term strandings for webs arXiv:2608.27425
Unverified 2026

Boxicity-guided constraint attention

Replace an unconstrained pairwise attention score with an intersection of coordinate-wise threshold or interval compatibility heads. Each head is a supergraph that permits pairs satisfying one constraint, while the final attention edge exists only when every head permits the pair. This provides an interpretable inductive bias for multi-constraint relations and prevents the model from approximating a conjunction using a single unstable nonlinear score.

Useful5/10
Difficulty5/10
Novelty8/10
Paper: Boxicity and Threshold Dimension of Zero Divisor Graphs arXiv:2608.27381
Unverified 2026

Hyperbola-Tangent Quadratic Features

Add a bank of quadratic features encoding tangent contact with the reciprocal manifold x1 x2 = 1, rather than forcing a generic MLP to discover this interaction from arbitrary monomials. For positive bounded feature pairs, each feature is nonnegative and becomes exactly zero at a selected reciprocal operating point. The module can be used either as an input feature expansion or as a regularizer encouraging learned gates and scales to follow a reciprocal geometry.

Useful5/10
Difficulty3/10
Novelty7/10
Paper: Quadratic Convexification of a Square Truncated by a Hyperbola arXiv:2608.26639
Unverified 2026

Joint Bochner-Riesz Bilinear Graph Layer

Replace an unconstrained bilinear feature interaction with a joint spectral filter that only allows pairs of graph or spherical frequencies satisfying a soft radius constraint. The smooth factor attenuates interactions near and beyond the cutoff instead of making the hard low-pass decision used by ordinary spectral truncation, which should reduce high-frequency aliasing and unstable feature products.

Useful5/10
Difficulty6/10
Novelty6/10
Paper: Bilinear Bochner--Riesz Means on the Complex Sphere arXiv:2608.25884
Unverified 2026

Collision-free ternary attention

Represent a sparse higher-order attention head by a 3-uniform hypergraph whose hyperedge $(v,x,y)$ allows anchor token $v$ to aggregate a pairwise interaction between tokens $x$ and $y$. During mask construction, greedily reject edges that would create a $4$-cycle in the link graph $L(v)$, so the same pair of source tokens cannot reach an anchor through multiple redundant pairings. This produces a diversity-constrained sparse attention pattern with an explicit, measurable collision bound.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Regularity method for hypergraphs with $4$-cycle-free links arXiv:2608.24740
Unverified 2026

Polynomial Band-Pass Feature Mixer

Add a norm-controlled feature mixer that applies a polynomial spectral filter to the channel covariance of a transformer or MLP block. A quadratic filter centered at \(\rho\) suppresses covariance eigenmodes far from the target and preserves modes near it, providing a tunable alternative to purely variance-maximizing mixing or standard normalization.

Useful5/10
Difficulty5/10
Novelty6/10
Paper: Spectral Selection in Sphere-Constrained Flows Generated by Polynomials of the Dirichlet Laplacian arXiv:2608.24444
Unverified 2026

Branching-Pressure Router

Replace a generic MoE router entropy bonus with a branching-pressure objective that values routes according to both their stochastic entropy and their number of valid fine-grained continuations. The module can be implemented as a hierarchical router: a coarse state chooses a base transition, while a validity mask determines how many valid expert or latent branches lift that transition.

Useful5/10
Difficulty5/10
Novelty6/10
Paper: The entropy of Gromov-Thurston manifolds and branched coverings arXiv:2608.24220
Unverified 2026

Dimension-aware power-mean fusion

Use the paper's dimension-dependent exponent transformation to fuse nonnegative outputs from several branches. Instead of selecting an arbitrary generalized-mean exponent, choose the output exponent q=Q_d(p) induced by an input exponent p, making the fusion rule explicitly sensitive to the dimension of the barycentric variables.

Useful5/10
Difficulty3/10
Novelty5/10
Paper: Borell--Brascamp--Lieb inequality with finitely many output functions arXiv:2608.23963
Unverified 2026

Reliability-gated Laplacian positional encodings

Construct metric-graph Laplacian positional encodings only at frequencies whose empirical eigenvalues are statistically stable under the paper’s $(n v_\mu(h))^{-1/2}$ law. Use local ball-mass estimates and empirical eigengaps to gate or downweight unreliable eigenvectors, preventing small-sample spectral noise from entering a GNN or graph transformer.

Useful5/10
Difficulty4/10
Novelty5/10
Paper: Spectral stability of empirical metric-measure Laplacians arXiv:2608.23150
Unverified 2026

Fisher-Geometry Expert Menu

Construct a finite menu of experts or LoRA adapters by quantizing the oracle action manifold under a task-aware Fisher-information distortion rather than Euclidean parameter distance. The router can choose an installed expert after observing the input, but only k experts are stored or evaluated. The paper's frontier rate gives a falsifiable accuracy-versus-menu-size prediction.

Useful5/10
Difficulty6/10
Novelty4/10
Paper: Pre-Disclosure Experiment Menus: Oracle-Relative Risk and Joint Sample--Menu Asymptotics arXiv:2608.22905
Unverified 2026

Conservative amortized collision layer

Add a learned stochastic pair-interaction layer to a particle graph neural network, with a conditional normalizing flow generating the post-interaction relative state. Parameterize the update in center-of-mass and invariant relative coordinates so every sampled interaction preserves pair momentum and kinetic energy exactly. The flow learns the transition law directly from observed scattering or trajectory data, replacing repeated numerical collision solves or unconstrained message-passing…

Useful5/10
Difficulty6/10
Novelty6/10
Paper: A particle method for the Boltzmann equation via amortized sampling from Green's function of the lifted linear operator arXiv:2608.22880
Unverified 2026

S3-Holonomy Message Passing

Build a graph neural network on the dual graph of a triangulated surface whose messages are transported by \(\mathfrak{S}_3\) permutation matrices associated with adjacent-face color transports. This removes dependence on arbitrary local color-label choices and gives the network an explicit representation of noncontractible topology through holonomy around cycles.

Useful5/10
Difficulty5/10
Novelty6/10
Paper: Congruence classes of monodromies of even triangulations arXiv:2608.22814
Unverified 2026

Complex Phase-Corrected State Integrator

Use the complex-conjugate palindromic coefficient that cancels the leading temporal phase defect of oscillatory modes. Implement complex arithmetic directly or use an exactly equivalent doubled-real state, then project the final state to its real component for real-valued prediction tasks.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Sharp CFL stability and temporal-dispersion optimization of symmetric splitting schemes for time-domain Maxwell equations arXiv:2608.22315
Unverified 2026

Pole-Tuned Graph Residual Layer

Use the graph Laplacian spectrum to set the mixing and correction coefficients of a two-state graph-propagation block. Balancing the contraction of low-frequency consensus modes against high-frequency disagreement modes may reduce oversmoothing and make deep graph-neural networks less sensitive to manually selected residual coefficients.

Useful5/10
Difficulty6/10
Novelty5/10
Paper: Optimal Parameter Design for DIGing on Minimizing Unweighted Sum of Squares arXiv:2607.25463
Unverified 2026

Critical Interface State-Space Pooling

Add a fixed or weakly learned interface-localized branch to a sequence model. Set the critical mass term to zero and make the transport coefficient change sign across a learnable interface, producing a localized mode that pools information near a detected transition rather than averaging uniformly over the sequence.

Useful4/10
Difficulty5/10
Novelty8/10
Paper: Critical Topological Photonics in Synthetic Dimensions arXiv:2608.21791
Unverified 2026

m-Binomial Global Mixer

Insert a fixed or lightly gated lower-triangular binomial-transform layer into a sequence model to create global interactions across positions without forming attention logits. For a sequence of length N, mix each output position with all earlier positions using coefficients determined by an integer m; initialize the layer fixed and optionally learn a diagonal channel gate or a small mixture over m values.

Useful4/10
Difficulty5/10
Novelty8/10
Paper: $m$-Bell and $m$-Stirling numbers: Iterated binomial transforms, hyper-Bessel functions, and moments of the Conway--Maxwell--Poisson distribution arXiv:2608.12011
Unverified 2026

Reaction-Closed Sparse Routing

Represent the active experts or channels of a sparse layer by a presence set and impose a reaction-style dependency graph on possible support changes. During a growth phase, activate only the least support set closed under enabled dependencies; during later pruning, allow trajectory-dependent removals but never add structurally unreachable experts. This should reduce routing churn and dead experts while preserving adaptive sparsity.

Useful4/10
Difficulty5/10
Novelty7/10
Paper: A Structural Theory of Admissible Transitions in Biological Reaction Networks arXiv:2608.27201