Architecture ideas

Research ideas extracted from mathematics papers, categorized as Architecture.

Unverified 2026

Patterned-Walk Graph Signature

Augment a graph neural network or graph transformer with counts of cyclic walks whose successive steps are required to be graph edges or graph non-edges according to a binary pattern. These features encode induced-subgraph structure that ordinary adjacency powers miss, and can be concatenated to the graph-level token or used as an auxiliary prediction target.

Useful5/10
Difficulty4/10
Novelty7/10
Paper: Generalized spectral closedness of $\mathcal{F}$-free graph classes arXiv:2607.06455
Unverified 2026

Peel-and-pass polynomial latent dynamics

Replace step-by-step hidden-state storage in a latent ODE, state-space model, or world model with a polynomial trajectory represented independently on short time blocks. At the end of each block, pass the next hidden state by summing temporal coefficients, allowing training and inference to discard the completed block while retaining a mathematically exact block interface.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Sparse space-time spectral methods can time-step by peel and pass arXiv:2607.06449
Unverified 2026

Rigidity-Calibrated Set Attention

Augment pairwise attention on a set of n tokens with a rigidity operator derived from normalized pairwise directions. The operator couples infinitesimal node displacements through changes in pairwise distances, while the complete-graph theorem provides a geometry-independent eigenvalue target n/2 after spherical centering and normalization.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: The Second Largest Eigenvalue of Stiffness Matrices of Normalized Complete Frameworks arXiv:2607.05472
Unverified 2026

Cyclotomic p-Cap Layer

Replace an ordinary token aggregation step with a p-replica cyclic-equivariant block. Features are copied into p replicas, processed by shared operators, coupled through a cap-like bilinear interaction, and projected onto cyclic invariants. An auxiliary commutation loss enforces that applying the operator before or after the p-fold lift gives similar outputs.

Useful5/10
Difficulty5/10
Novelty8/10
Paper: Noncommutative Cartier Formulae arXiv:2607.05360
Unverified 2026

Microscopic Boundary Pooling

Replace uniform set or point-cloud pooling with a microscopic weighting computed from pairwise feature-space distances. The resulting signed pooling vector should retain boundary and geometrically isolated points that ordinary mean pooling suppresses, potentially improving recognition when class information is concentrated on shape extremities or rare local configurations.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: The microscopic weighting on a metric space arXiv:2607.05349
Unverified 2026

Piecewise-Symmetric Tensor Layer

Replace an unconstrained order-k weight tensor with a sum of components that are symmetric only within selected contiguous index blocks. This preserves interactions between blocks while tying parameters under within-block permutations, providing a tunable middle ground between a fully dense tensor and a fully symmetric tensor.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Piecewise Symmetric Tensors arXiv:2607.04712
Unverified 2026

Bessel Totally-Positive Attention

Replace ordinary dot-product attention logits with a strictly totally positive kernel evaluated on positive, ordered scalar coordinates attached to queries and keys. Use the modified-Bessel kernel K(x,s)=I_s(x), whose every ordered minor is positive, then row-normalize it as an attention matrix. This creates an attention operator with a mathematically enforced anti-oscillatory structure rather than merely positive entries.

Useful5/10
Difficulty6/10
Novelty8/10
Paper: Strict Total Positivity from Spectral Darboux and Toeplitz Smoothing Mechanisms arXiv:2607.02778
Unverified 2026

Matroid-circuit equivariant message passing

Represent each matroid circuit as a structured hyperedge and perform message passing from circuit embeddings back to their constituent elements. Tie all circuit-update parameters that lie in the same automorphism orbit, so relabelings preserving the matroid produce exactly relabeled hidden states rather than requiring the network to learn this symmetry from data.

Useful5/10
Difficulty5/10
Novelty6/10
Paper: Encoding matroids into quantum states arXiv:2607.02736
Unverified 2026

Rank-safe Bernoulli layer initialization

Use the Bernoulli corank asymptotic to choose sparsity for binary or sparse linear layers and reject initial matrices with excessive numerical rank deficiency. The layer should also explicitly prevent zero columns, because the paper's probability law indicates that zero-column events are a leading mechanism behind large corank in the sparse regime.

Useful5/10
Difficulty4/10
Novelty5/10
Paper: Rank deficiency of Bernoulli random matrices for growing corank arXiv:2607.00495
Unverified 2026

SURE-Adaptive Derivative Front End

Prepend an adaptive Savitzky-Golay derivative bank to a temporal neural network. For each input channel and derivative order, select the local window by minimizing Stein's unbiased risk estimate, then concatenate the raw signal with the estimated derivatives. This supplies denoised velocity and acceleration features without requiring clean derivative targets or forcing the backbone to learn unstable finite-difference filters.

Useful5/10
Difficulty3/10
Novelty6/10
Paper: PDE Identification Using Noise Adaptive Differentiation in Strong Form (S-IDENT) arXiv:2606.31776
Unverified 2026

Polynomial Band-Pass Feature Mixer

Add a norm-controlled feature mixer that applies a polynomial spectral filter to the channel covariance of a transformer or MLP block. A quadratic filter centered at \(\rho\) suppresses covariance eigenmodes far from the target and preserves modes near it, providing a tunable alternative to purely variance-maximizing mixing or standard normalization.

Useful5/10
Difficulty5/10
Novelty6/10
Paper: Spectral Selection in Sphere-Constrained Flows Generated by Polynomials of the Dirichlet Laplacian arXiv:2608.24444
Unverified 2026

Complex Phase-Corrected State Integrator

Use the complex-conjugate palindromic coefficient that cancels the leading temporal phase defect of oscillatory modes. Implement complex arithmetic directly or use an exactly equivalent doubled-real state, then project the final state to its real component for real-valued prediction tasks.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Sharp CFL stability and temporal-dispersion optimization of symmetric splitting schemes for time-domain Maxwell equations arXiv:2608.22315
Unverified 2026

Pole-Tuned Graph Residual Layer

Use the graph Laplacian spectrum to set the mixing and correction coefficients of a two-state graph-propagation block. Balancing the contraction of low-frequency consensus modes against high-frequency disagreement modes may reduce oversmoothing and make deep graph-neural networks less sensitive to manually selected residual coefficients.

Useful5/10
Difficulty6/10
Novelty5/10
Paper: Optimal Parameter Design for DIGing on Minimizing Unweighted Sum of Squares arXiv:2607.25463
Unverified 2026

Commutator-Polynomial Residual Adapter

Replace an unconstrained linear residual adapter by an operator \(T\) satisfying a polynomial relation in the commutator operator \(\Delta_A(X)=AX-XA\). Choose the polynomial roots in a stable half-plane so that repeated commutators become nilpotent, making repeated adapter application terminate algebraically and permitting a finite-polynomial inverse of \(I+T\).

Useful4/10
Difficulty6/10
Novelty9/10
Paper: Spectral Rigidity of Commutators: Dynamics, Resonance, and Nilpotency arXiv:2608.29574
Unverified 2026

m-Binomial Global Mixer

Insert a fixed or lightly gated lower-triangular binomial-transform layer into a sequence model to create global interactions across positions without forming attention logits. For a sequence of length N, mix each output position with all earlier positions using coefficients determined by an integer m; initialize the layer fixed and optionally learn a diagonal channel gate or a small mixture over m values.

Useful4/10
Difficulty5/10
Novelty8/10
Paper: $m$-Bell and $m$-Stirling numbers: Iterated binomial transforms, hyper-Bessel functions, and moments of the Conway--Maxwell--Poisson distribution arXiv:2608.12011