Architecture ideas

Attention variants, state-space and recurrent cells, normalization and token-mixing schemes — each tested against the standard block it replaces.

Unverified 2026

Negative Bethe-Hessian positional features

Augment node features with eigenvectors corresponding to negative eigenvalues of the Bethe-Hessian H(t,G), rather than using only Laplacian or adjacency positional encodings. The diagonal D-I correction is designed for sparse, locally tree-like graphs and should suppress degree-fluctuation artifacts near the connectivity threshold. Feed the resulting coordinates to a GNN through a learned gate so the model can ignore them when they are uninformative.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: The Bethe-Hessian down to the Percolation Threshold arXiv:2608.16672
Unverified 2026

Fractional-to-Local RG Residual Block

Replace a single local message-passing or convolution operator by a spectrally controlled mixture of fractional and ordinary diffusion. The exponent σ is learned or scheduled, while a crossover gate forces the model to change parameterization near the renormalization-group threshold σ*=2, allowing long-range propagation when useful without retaining an unnecessarily nonlocal operator at short scales.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: The $6-ε$ Expansion for Long-Range Lee--Yang and Percolation Criticality arXiv:2608.15120
Unverified 2026

Åberg Percolation Routing

Replace a dense neural interaction graph by a dynamically activated graph whose edge $(u,v)$ is retained only when its effective coupling exceeds the local spacing of response modes. The network remains sparse below the connectivity transition but becomes globally communicating once a giant component forms, providing a controllable alternative to arbitrary magnitude pruning.

Useful6/10
Difficulty6/10
Novelty8/10
Paper: Small-world structure of quantum computer hardware arXiv:2608.13855
Unverified 2026

Warm-Started Perron Positional Encoding

Add a distributed spectral positional encoding to a graph neural network, graph transformer, sparse-attention model, or MoE router by computing the dominant eigenvector of the current weighted adjacency matrix with a few warm-started power iterations. Unlike a Fiedler-vector feature, this encoding uses only local neighbor aggregation, is naturally nonnegative for nonnegative adjacency weights, and can be updated incrementally when the graph or edge weights change.

Useful6/10
Difficulty4/10
Novelty4/10
Paper: Adjacency-Based Spectral Proxy Control of Mobile Communication Agents arXiv:2608.13616
Unverified 2026

Quadratic-budget Toeplitz long-range layer

Replace a dense translation-invariant interaction matrix with a positive-definite Toeplitz kernel K_n(e^f) whose log-spectrum is parameterized by a small number of Fourier coefficients with 1/|k| decay. Use the paper's explicit quadratic term as a spectral-volume budget, allowing long-range structure while discouraging uncontrolled determinant growth and ill-conditioning. Subtracting this term from a log-determinant regularizer leaves a residual intended to capture higher-order deviations from…

Useful6/10
Difficulty6/10
Novelty7/10
Paper: On Toeplitz determinants with slow Fourier decay arXiv:2608.13182
Unverified 2026

Surrogate-guided topology search for nonlinear reservoirs

Search sparse reservoir wiring in graph space rather than repeatedly testing every candidate with its full nonlinear dynamics. Use graph descriptors to predict validation accuracy and nonlinear feature selectivity, then spend exact simulations on candidates with high predicted performance or high surrogate uncertainty.

Useful6/10
Difficulty6/10
Novelty6/10
Paper: Graph-theoretic design of lasing networks for physical vision arXiv:2608.13097
Unverified 2026

Adaptive spectral-gap toroidal encoding

Replace ordinary absolute positional embeddings with coordinates on a learned flat torus and use dual-lattice Fourier characters as positional features. Control the covariance of the coordinate fundamental domain so that the paper's inequality guarantees a lower bound on the smallest nonzero positional frequency, preventing the learned periodic coordinate system from developing arbitrarily weak or nearly constant modes.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Spectral and Isoperimetric Bounds on Flat Tori arXiv:2608.13052
Unverified 2026

Cactus-Graph Phase Budgeting

Build neural computation graphs with explicitly phase-budgeted serial and parallel branches, treating serial compositions as SRG products and parallel residual branches as SRG sums. Allocate phase centers theta_i so that every loop or branch aggregate stays away from -1, enabling stability-aware architecture search and constructive control of branch gains.

Useful6/10
Difficulty7/10
Novelty8/10
Paper: The $θ$-Symmetric SRG with Applications to Stability of Cactus Dynamic Networks arXiv:2608.12591
Unverified 2026

Bloch-Husimi attention

Replace unconstrained attention score vectors by normalized SU(2) coherent-state responses of a positive operator on an (N+1)-dimensional spin space. Each query produces a smooth bounded response over a fixed spherical grid, while values are aggregated normally. The coherent-state kernel imposes geometric structure and exposes a controllable concentration parameter N.

Useful6/10
Difficulty6/10
Novelty7/10
Paper: Isospectral majorization and isoperimetric inequalities for coherent states on the Bloch sphere arXiv:2608.12248
Unverified 2026

Ambiguity-Flat Weyl Feature Layer

Replace a random cyclic filter bank or patch projection with the Weyl–Heisenberg orbit of one normalized learnable prototype. Regularize the prototype so that all nonzero shift and modulation correlations have a large and nearly equal magnitude, maximizing the smallest eigenvalue of the induced feature Gram matrix and preventing poorly observed feature directions.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Uniformly Stable Minimal Weyl--Heisenberg Measurements Approaching the SIC Benchmark arXiv:2608.11850
Unverified 2026

Deep-spectrum community features

Replace the usual top-eigenvector positional encoding in a graph neural network with a density-selected spectral subspace. The selector explicitly searches below the leading eigenvectors, where community information may survive after latent geometric modes have consumed the largest eigenvalues. The selected coordinates can be concatenated to node features or used as a bias in graph attention.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Spectral graph clustering with inhomogeneous latent geometry arXiv:2608.11321
Unverified 2026

Scalene Nilpotent-Symmetry Network

Augment a sequence network with a learned staggered matrix-product-operator symmetry and penalize its commutator with the network map. Unlike ordinary equivariance, the auxiliary operator need not define a self-commuting transfer-matrix family: it can be discovered through cross-commutation with a second alternating operator, while nilpotency supplies a finite hierarchy of symmetry constraints. The model should preserve generalized symmetry sectors and exhibit lower commutator error on…

Useful6/10
Difficulty7/10
Novelty8/10
Paper: Scalene Yang--Baxter triples as a source of hidden symmetries beyond the ordinary Yang--Baxter equation arXiv:2608.09081
Unverified 2026

Near-Optimal Lanczos Spectral Layer

Implement f(A)b inside a neural network with a short Lanczos recurrence instead of an eigendecomposition or dense matrix-function operation. Use an SPD operator A such as a regularized graph Laplacian or feature covariance matrix, and choose the number of iterations by monitoring successive approximations. For Stieltjes functions, Lanczos is guaranteed to be close to the best vector in the same Krylov subspace.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Optimal near-optimality bounds for the Lanczos method for matrix functions arXiv:2608.07160
Unverified 2026

Braess-aware graph rewiring

Use Kemeny’s constant as a diffusion-quality gate when adding shortcut edges or cliques to a graph used by a GNN. Candidate augmentations are accepted only when they reduce estimated average hitting time, preventing rewiring operations that superficially shorten paths but make the random walk mix more slowly.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Kemeny's constant and Braess cliques in graphs arXiv:2608.04150
Unverified 2026

Sparse Weighing Mixer

Use enumerated weighing matrices as sparse orthogonal channel-mixing operators inside MLPs or residual blocks. Their ternary entries reduce multiplication to signed additions, while exact orthogonality prevents amplification or attenuation of feature norms; a trainable fixed-support version can recover expressivity without giving up computational sparsity.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Constructing Large Orthogonal Minimally Aliased Response Surface Designs Through Enumeration and Combination of Weighing Designs arXiv:2608.04814
Unverified 2026

Curved-Critical Residual Lattice

Construct a 2D recurrent or residual neural lattice with slowly varying local couplings, while parameterizing those couplings so that an anisotropy invariant remains constant across all spatial and depth locations. The network obtains controlled local propagation velocities rather than arbitrary inhomogeneous amplification, enabling depth-dependent receptive fields while preserving near-critical signal propagation.

Useful6/10
Difficulty6/10
Novelty8/10
Paper: Two dimensional inhomogeneous classical systems at criticality arXiv:2608.02903
Unverified 2026

Summed Resolvent Spectral Layer

Replace a recursive product implementation of a rational spectral filter with an additive sum of independently evaluated resolvents. Use the layer on a graph Laplacian, token-similarity operator, or other sparse feature operator to obtain a high-order filter without multiplicative roundoff and gradient amplification; the independent solves can also be batched or distributed across devices.

Useful6/10
Difficulty6/10
Novelty6/10
Paper: Stable and Efficient One-Way Modelling of Convective Disturbances in Laminar Boundary Layers: OWNS-Summation arXiv:2608.01155
Unverified 2026

Outlier-Spectral Landmark Attention

Construct a symmetric token affinity matrix and approximate only its spectrally outlying token-mixing modes using a small set of sampled landmark columns. The resulting low-rank operator replaces an \(O(n^2)\) dense mixer by two skinny matrix multiplications, while the paper's residual guarantee predicts that large-magnitude global interaction modes are preserved.

Useful6/10
Difficulty5/10
Novelty5/10
Paper: Sublinear Time Eigenvector Approximation via Column Sampling arXiv:2608.00840
Unverified 2026

Finite-Band Polynomial Seed Bank

Construct one reference Lanczos basis for a symmetric propagation operator H, then derive several seed-specific spectral responses for Q_a(H)x_0 through finite-band polynomial connectors. With degree-r seeds, each transformed basis vector uses at most 2r+1 neighboring reference basis vectors, avoiding a separate Lanczos factorization for every seed.

Useful6/10
Difficulty6/10
Novelty7/10
Paper: Polynomial Initial-State Jumps and Christoffel Transforms in Krylov Complexity arXiv:2607.05294
Unverified 2026

Spectrally screened polynomial pseudoinverse layer

Replace an SVD-based pseudoinverse of a learned rectangular matrix with a low-degree polynomial initialization followed by a few Newton–Schulz iterations. The polynomial approximates the inverse Gram operator, while a cheap residual test accepts it only when the iteration is contractive and otherwise selects a conservative transpose-scaled initialization.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Iterative Methods for Computing the Moore--Penrose Inverse of Split-Quaternion Matrices with Applications arXiv:2607.29270
Unverified 2026

Geometrically Random Transport Network

Construct a deep sequence model as a layered channel network with fixed random K-regular connections between neighboring depth layers, instead of dense or independently random weight matrices. Use norm-preserving edge normalization and a reversible residual update so that geometric randomness controls information transport while trainable nonlinear readouts provide task-specific computation. The architecture exposes a tunable crossover between quasi-one-dimensional ballistic or localized…

Useful6/10
Difficulty6/10
Novelty7/10
Paper: Quantum Chaos and Diffusive Transport from Geometric Randomness arXiv:2607.28579
Unverified 2026

Coherence-to-Diffusion Graph Layer

Replace a single graph or token-mixing operator with two coupled channels: an antisymmetric, coherence-preserving transport channel and a state-dependent dissipative diffusion channel. The local feature state controls the dissipative edge rates, so strongly occupied or conflicting regions are smoothed while weakly interacting regions retain rapid coherent propagation.

Useful6/10
Difficulty6/10
Novelty7/10
Paper: Interacting Quantum Symmetric Exclusion Process arXiv:2607.28255
Unverified 2026

Fourier Turing Recurrent Layer

Replace one spatial convolution block by a recurrent Fourier-domain layer that couples every mode k to its opposite mode -k and gives the strongest amplification to a nonzero selected wave number k*. The layer crosses a controlled Turing-like instability at k* and uses cubic saturation to produce bounded structured features instead of unbounded activation growth.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Quantum Turing Patterns arXiv:2607.26331
Unverified 2026

Markov-Increment Window Encoder

Replace a collection of overlapping sliding-window features with approximately orthogonal incremental features: the length-m feature contains information not predictable from shorter consecutive windows. Use the paper's transition-operator Toeplitz precision matrix to decorrelate the resulting sequence of window features before attention, suppressing duplicated local evidence and improving conditioning.

Useful6/10
Difficulty6/10
Novelty7/10
Paper: Block-hierarchical covariance decompositions for finite-block additive functionals arXiv:2607.25949