Architecture ideas

Attention variants, state-space and recurrent cells, normalization and token-mixing schemes — each tested against the standard block it replaces.

✓✓ Beats tuned baseline 2026

Private spectral whitening front-end

Estimate the temporal spectrum of each sequence channel using a locally private procedure, then apply a regularized inverse-square-root spectral filter before the sequence enters attention or an SSM. The filter removes predictable low-frequency or narrow-band redundancy while avoiding unstable amplification at frequencies where the private estimate is small.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: On the privacy cost for dependent Gaussian data: spectral density estimation under local differential privacy arXiv:2608.24847
Unverified 2026

Variation-Diminishing Channel Mixer

Constrain a channel-mixing layer to be a product of nonnegative bidiagonal matrices, rather than an unconstrained dense matrix. The resulting totally nonnegative operator is predicted not to increase sign oscillations in ordered channel features, potentially reducing high-frequency feature noise and making deep stacks more stable.

Useful5/10
Difficulty4/10
Novelty8/10
Paper: The Exact Maximum of the Spectral Sum of Graphs arXiv:2607.23081
Unverified 2026

Uniformly bounded Jacobi spectral features

Replace raw powers or unconstrained polynomial spectral features with normalized Jacobi features whose amplitude is provably bounded on the entire input interval. Use trainable mixtures of these features in a positional encoding, graph spectral layer, or MLP front end, while preserving the theorem's normalization and optionally constraining the learned mixture norm.

Useful5/10
Difficulty4/10
Novelty7/10
Paper: The Koornwinder--Kostenko--Teschl Conjecture for Jacobi Polynomials and the Discrete Laguerre Phase Transition arXiv:2608.30486
Unverified 2026

Krasikov-Normalized Jacobi Feature Layer

Replace raw polynomial features in a scalar MLP expansion with endpoint-weighted orthonormal Jacobi features. The paper's envelope gives a degree- and parameter-aware scale for each feature, preventing high-degree terms or endpoint behavior from dominating gradients while preserving a richer approximation basis than low-degree monomials.

Useful5/10
Difficulty4/10
Novelty6/10
Paper: The Erdélyi--Magnus--Nevai and Krasikov Conjectures for Jacobi Polynomials arXiv:2608.30304
Unverified 2026

Zero-forcing causal lattice mixer

Build a sparse recurrent graph-neural layer on a path-by-path, path-by-cycle, or cycle-by-cycle latent lattice using a skew-zero-forcing seed set and its forcing order as a causal update schedule. Only the currently forced target node is activated at each step, so a small number of anchor states can propagate through the complete lattice while retaining local connectivity and periodic-boundary structure. The exact seed-count formulas predict the minimum number of anchors required by the graph…

Useful5/10
Difficulty6/10
Novelty6/10
Paper: Grundy Total Domination and Skew Zero Forcing in Cartesian Products of Paths and Cycles arXiv:2608.27804
Unverified 2026

Jumbled sparse attention masks

Design sparse attention masks using a graph discrepancy criterion rather than selecting only local or nearest-neighbor edges. A mask with approximately uniform edge counts between every pair of token subsets spreads information globally, while the rigidity consequence provides a principled way to preserve enough independent pairwise constraints for latent geometric features.

Useful5/10
Difficulty4/10
Novelty6/10
Paper: Rigidity of expanders and pseudorandom graphs arXiv:2608.21058
Unverified 2026

Potential-weighted fractional diffusion layer

Insert a positivity-preserving fractional Schrödinger resolvent into a 1D neural sequence block. Given a nonnegative learned potential V, the layer transforms an input signal f using V^a(-Delta+V)^(-a)f, allowing the network to learn where to smooth or suppress features while retaining an L1 bound independent of the potential magnitude. Use a in (0,1] as a fixed hyperparameter or a clipped learned scalar.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Potential-free $L^1$-estimates for positivity-preserving Riesz transform related to Schrödinger operator in dimension one arXiv:2608.17406
Unverified 2026

Schatten-Stable Noncommutative Matrix Layer

Replace an ordinary elementwise interaction between two feature matrices by a noncommutative functional-calculus layer \(\varphi(A,B)\), where \(A\) and \(B\) are Hermitian channel operators that need not commute. Add a soft penalty on \([A,B]=AB-BA\), and use a Besov-smooth parameterization of \(\varphi\) so that perturbations are controlled in Schatten \(p\)-norm for \(p\leq2\). This creates a principled matrix interaction module that can remain stable when feature operators or graph…

Useful5/10
Difficulty6/10
Novelty8/10
Paper: Commutator estimates for functions of noncommuting self-adjoint operators arXiv:2608.16731
Unverified 2026

Resolvent response basis for conditioned modules

Compress a module whose output changes with a scalar condition such as diffusion time, temperature, or compute budget by representing its response in a low-rank basis generated by resolvent-like functions. Distinct spectral modes produce rational factors \((1-\tau\lambda_k)^{-1}\), allowing a small number of learned components to approximate a large hypernetwork or condition-dependent parameter table.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Spectral duality structures and the Fisher--Rao geometry of reset distributions arXiv:2608.15805
Unverified 2026

Jucys–Murphy spectral token mixer

Add a structured token-mixing layer based on commuting sums of swap operators rather than unconstrained pairwise attention. The layer learns a low-degree spectral filter in the Jucys–Murphy operators, allowing it to represent hierarchical interactions while retaining an explicit algebraic inductive bias.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Hitting-time mixing for the star transposition shuffle arXiv:2608.13727
Unverified 2026

Pisot-Separated Multiscale Codes

Replace an unconstrained geometric multiscale codebook by features generated from a finite digit set and a Pisot scale factor. The contracting algebraic-conjugate directions should suppress near-collisions between representations at different scales, producing a discretely separated hierarchy that can be used for embeddings, recurrent memory, or quantized transformer states.

Useful5/10
Difficulty6/10
Novelty9/10
Paper: Self-similar Delone sets and Pisot numbers arXiv:2608.11867
Unverified 2026

Spectral Phase-Lifted Features

Augment a hidden representation with positively homogeneous interaction features built from approximate eigenmodes of a linear layer. Fractional products of mode magnitudes and phases provide nonlinear channels whose transformation laws are inherited from the spectrum of the underlying operator, potentially representing oscillatory or multiplicative dynamics more compactly than a generic MLP.

Useful5/10
Difficulty7/10
Novelty8/10
Paper: The spectrum of operator extensions to free Banach Lattices arXiv:2608.11437
Unverified 2026

Cross-Order Hodge Stability Scaling

Normalize every higher-order simplicial message-passing or diffusion block using the spectral radius of a lower-order up-Laplacian, rather than estimating a separate radius for each order. The paper's monotonicity theorem guarantees that this shared bound is conservative for all higher orders, enabling stable explicit updates with one spectral calibration.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Eigenvalue growth of the discrete Hodge Laplacian across dimensions arXiv:2608.11170
Unverified 2026

Asymmetry-Aware Bochner–Riesz Graph Filter

Replace a sharp graph-Laplacian spectral filter with a Bochner–Riesz filter whose smoothness exponent increases when the graph contains regions with different effective dimensions. Estimate the largest local dimension and dimension gap from neighborhood growth, then choose the exponent above both the classical spectral threshold and the asymmetric obstruction threshold. This should suppress unstable high-frequency mixing in heterogeneous graphs while preserving more low-frequency signal than…

Useful5/10
Difficulty5/10
Novelty6/10
Paper: Herz versus Fefferman: Symmetric and asymmetric Bochner--Riesz theory arXiv:2608.09247
Unverified 2026

Repair-cost detector for incompatible similarity predictions

Use the paper's lower bound on nearest-correlation repair cost to detect when a neural network's pairwise similarity predictions contain too much globally incompatible off-diagonal energy. Instead of projecting every predicted matrix onto the correlation cone, train the network to reduce the repair-risk statistic or trigger expensive repair only when a cheap diagnostic predicts substantial distortion.

Useful5/10
Difficulty4/10
Novelty6/10
Paper: Correlation Matrices in High Dimensions: The Elliptope as a Sample-Correlation Ensemble arXiv:2608.04162
Unverified 2026

q-Boson Spectral Initialization

Initialize a neural layer with singular values taken from the finite spectral measure of the paper's q-boson Jacobi operator instead of using Xavier or ordinary orthogonal initialization. The resulting layer has a deliberately shaped singular-value distribution and an explicit finite-size spectral edge, allowing initialization to target stable signal propagation while retaining spectral diversity.

Useful5/10
Difficulty4/10
Novelty7/10
Paper: Sharp Bounds on Ground State Energy of the SYK Model arXiv:2607.27185
Unverified 2026

Complex-stretched resonance layer

Insert a fixed or learnable complex coordinate stretch outside the region where a neural operator models the physical interaction, so outgoing waves are damped and resonant states become ordinary discrete eigenmodes on a finite grid. Train the network with eigenvalue or resolvent losses computed after the stretch, while preserving the physical field in the interior region.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Dirac resonances as non-self-adjoint eigenvalues arXiv:2607.26166
Unverified 2026

Rank-Two Motif Spectral Architecture Library

Use the paper's three rank-two graph families as a small, analytically understood library of propagation topologies. Select or mix figure-eight, theta, and dumbbell edge-routing motifs to obtain different effective receptive-field growth rates while retaining an exact spectral-radius target for normalization and architecture search.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Critical-exponent spectra and rank two inverse realization on biregular trees arXiv:2607.21294
Unverified 2026

Constant-gap brickwork unitary initialization

Initialize a unitary feature-mixing layer with a shallow brickwork circuit of independent random SU(4) gates instead of sampling or factorizing a dense Haar-random unitary. Stack enough layers to obtain a target contraction of non-Haar components, using the paper's constant spectral-gap principle to make the required depth essentially independent of the number of qubits. The resulting layer is local, parameter-efficient, exactly norm-preserving, and should provide Haar-like scrambling at…

Useful5/10
Difficulty5/10
Novelty6/10
Paper: Random unitary circuits with constant spectral gap arXiv:2607.20919
Unverified 2026

Protected-Kernel Graph Diffusion

Replace an ordinary graph diffusion or message-passing operator with a positive-semidefinite Laplacian whose kernel contains a prescribed node-wise subspace. The layer smooths only feature components orthogonal to that subspace, preserving global constants, positional modes, or other structural signals even when graph edges are dynamically added or removed.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Laplacian Spectral Shaping for Non-Uniform Scaling Formation Control of Open Multi-Agent Systems arXiv:2607.16709
Unverified 2026

Defect-Localized Cycle Positional Encoding

Use the isolated positive spectral mode created by a finite branch defect on an otherwise long cycle as a graph positional feature. The feature should concentrate around structurally unusual vertices while remaining insensitive to the total cycle length, providing a principled alternative to raw Laplacian eigenvectors for cycle-with-branch graphs.

Useful5/10
Difficulty5/10
Novelty8/10
Paper: Discrete Einstein metrics on unicyclic graphs arXiv:2607.14748
Unverified 2026

Additive-energy sparse offset design

Learn or select sparse cyclic convolution or relative-attention offsets whose pairwise differences collide less often modulo the sequence length. The paper's Fourier fourth-power identity turns this combinatorial objective into an FFT-computable differentiable loss, enabling fixed-K sparse patterns with lower aliasing and interference than random offsets.

Useful5/10
Difficulty4/10
Novelty7/10
Paper: Spectral and Additive Combinatorial Methods for Cycles and Absorbing Sets in Lifted-Product Quantum LDPC Codes arXiv:2607.13666
Unverified 2026

Main-Krylov Structural Encoder

Add a structural positional channel formed from the Krylov sequence generated by the graph adjacency matrix and the all-ones vector. For graphs with k main eigenvalues, this sequence has rank k, so a GNN can retain all information obtainable from global walk counts using only k node features rather than storing many adjacency powers.

Useful5/10
Difficulty4/10
Novelty7/10
Paper: Trees with exactly three main eigenvalues arXiv:2607.13577
Unverified 2026

Geometric observability gating

Build a graph diffusion or neural-operator encoder whose sparse-observation loss is weighted according to graph distance from the observed nodes. For early diffusion times, suppress supervision or cross-attention demands that are geometrically impossible because signals at distance \(d\) are attenuated like \(e^{-d^2/(2t)}\); gradually release those constraints as diffusion time grows.

Useful5/10
Difficulty4/10
Novelty6/10
Paper: Optimal geometric barriers for weighted observability of heat semigroups on metric measure spaces arXiv:2607.13279