Architecture ideas

Attention variants, state-space and recurrent cells, normalization and token-mixing schemes — each tested against the standard block it replaces.

Unverified 2026

Spectrally Balanced Subdivision Backbone

Construct a sparse message-passing graph from a tree backbone by subdividing every backbone edge and attaching leaves so that 2d_T1(x_i)+f_i is constant across backbone vertices. Use this graph as a fixed communication skeleton, with propagation weights calibrated by the predicted spectral radius. The same construction can be compressed into an effective backbone operator by eliminating subdivision and leaf nodes.

Useful5/10
Difficulty5/10
Novelty6/10
Paper: Tight lower bound for the spectral radius of connected graphs with given matching number arXiv:2607.11061
Unverified 2026

Bilinear-Form Structured Transition

Construct the latent transition from a nondegenerate bilinear form phi and a form-compatible operator instead of from an unconstrained dense matrix. The resulting SSM has an exact orthogonal or symplectic algebraic structure, reducing transition parameter redundancy and testing whether preservation of a latent pairing improves extrapolation on reversible, parity-sensitive, or Hamiltonian-like sequence tasks.

Useful5/10
Difficulty5/10
Novelty5/10
Paper: Based maps to Lagrangian Grassmannians, Quivers, and Bott Periodicity arXiv:2607.10956
Unverified 2026

Homoclinic Symbolic Reservoir

Construct a periodically driven hybrid recurrent state-space model whose vector field is piecewise smooth across learned switching surfaces. Engineer a transverse homoclinic intersection around a hyperbolic recurrent state; the resulting shift-like invariant set provides a controllable symbolic reservoir for sequence prediction and long-horizon generation.

Useful5/10
Difficulty7/10
Novelty7/10
Paper: Homoclinic Theorems for piecewise smooth vector fields arXiv:2607.09618
Unverified 2026

Crossover-Aware Multiscale Attention

Build a neural architecture whose receptive field or attention span is increased according to an estimated disorder-to-order crossover scale. Local branches process windows below the crossover as if they were stochastic, while a global branch is activated only when the context exceeds the predicted scale needed to expose deterministic recurrence. This targets sequences or images containing long-range quasiperiodic, hierarchical, or algorithmically generated structure that is statistically…

Useful5/10
Difficulty5/10
Novelty7/10
Paper: The scales of disorder in perfect quasicrystals arXiv:2607.09274
Unverified 2026

Monotone Resolvent Elimination Layer

Build an implicit layer from a piecewise-linear maximal monotone operator on visible variables z_* and auxiliary variables z_**, then eliminate the auxiliary block rather than exposing it in the network output. Compute the layer through a fixed point of the eliminated component of a nonexpansive resolvent, with damping when the auxiliary map is not strictly contractive.

Useful5/10
Difficulty6/10
Novelty6/10
Paper: Maximal monotonicity of piecewise polyhedral mappings arXiv:2607.07358
Unverified 2026

Random-layer minimum-gain conditioning

Factor a neural linear layer as W = M A, where A is randomized at initialization and M is a deterministic channel mixer or learned feature transform. Regularize M toward low inverse-Hilbert–Schmidt norm under a scale constraint, because the paper's theorem predicts that this raises the high-probability lower bound on s_min(W) and reduces near-singular initialization events.

Useful5/10
Difficulty5/10
Novelty6/10
Paper: On the smallest singular value of the product of random and deterministic matrices arXiv:2607.06785
Unverified 2026

Frieze-consistent multiplicative feature block

Replace a standard two-layer multiplicative interaction block with auxiliary positive features X whose neighboring products generate two coupled feature grids x and y. Add the Y-diamond recurrence as either a hard recurrent update or a differentiable consistency loss, forcing local interactions to obey the same compatibility structure as an SL2/Y-frieze.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: All Y-friezes come from $\mathrm{SL}_2$-friezes arXiv:2607.06767
Unverified 2026

Rigidity-Calibrated Set Attention

Augment pairwise attention on a set of n tokens with a rigidity operator derived from normalized pairwise directions. The operator couples infinitesimal node displacements through changes in pairwise distances, while the complete-graph theorem provides a geometry-independent eigenvalue target n/2 after spherical centering and normalization.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: The Second Largest Eigenvalue of Stiffness Matrices of Normalized Complete Frameworks arXiv:2607.05472
Unverified 2026

Marginal-Preserving Difference Noise

Construct two latent variables X and Y with exactly the same marginal distribution, while forcing their difference X-Y to follow a chosen centered noise or residual law. Insert the pair into a residual, VAE, or diffusion block so that the model receives the desired perturbation without changing the marginal latent distribution at either endpoint. This creates a controlled alternative to independently sampled noise, especially when marginal drift in repeated stochastic layers is harmful.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: By Law, Every Zero-Mean Risk Is the Difference of Two Equally Distributed Risks arXiv:2607.05460
Unverified 2026

Invariant Möbius latent mixer

Insert a piecewise Möbius transformation as a deterministic latent mixing layer, using the paper's exact branch structure rather than a generic unconstrained MLP. The transformation repeatedly moves points between branches while preserving a known reference density, creating a cheap chaotic mixer with analytically computable Jacobian factors. Use a truncated, normalized version in practice so that the sigma-finite invariant measure becomes a valid finite training distribution.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Dynamics of integer zeroes of homogeneous quadratic equations over $\mathbb{R}^3$ arXiv:2607.03354
Unverified 2026

Polynomial Band-Pass Feature Mixer

Add a norm-controlled feature mixer that applies a polynomial spectral filter to the channel covariance of a transformer or MLP block. A quadratic filter centered at \(\rho\) suppresses covariance eigenmodes far from the target and preserves modes near it, providing a tunable alternative to purely variance-maximizing mixing or standard normalization.

Useful5/10
Difficulty5/10
Novelty6/10
Paper: Spectral Selection in Sphere-Constrained Flows Generated by Polynomials of the Dirichlet Laplacian arXiv:2608.24444
Unverified 2026

Complex Phase-Corrected State Integrator

Use the complex-conjugate palindromic coefficient that cancels the leading temporal phase defect of oscillatory modes. Implement complex arithmetic directly or use an exactly equivalent doubled-real state, then project the final state to its real component for real-valued prediction tasks.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Sharp CFL stability and temporal-dispersion optimization of symmetric splitting schemes for time-domain Maxwell equations arXiv:2608.22315
Unverified 2026

Commutator-Polynomial Residual Adapter

Replace an unconstrained linear residual adapter by an operator \(T\) satisfying a polynomial relation in the commutator operator \(\Delta_A(X)=AX-XA\). Choose the polynomial roots in a stable half-plane so that repeated commutators become nilpotent, making repeated adapter application terminate algebraically and permitting a finite-polynomial inverse of \(I+T\).

Useful4/10
Difficulty6/10
Novelty9/10
Paper: Spectral Rigidity of Commutators: Dynamics, Resonance, and Nilpotency arXiv:2608.29574
Unverified 2026

Reaction-Closed Sparse Routing

Represent the active experts or channels of a sparse layer by a presence set and impose a reaction-style dependency graph on possible support changes. During a growth phase, activate only the least support set closed under enabled dependencies; during later pruning, allow trajectory-dependent removals but never add structurally unreachable experts. This should reduce routing churn and dead experts while preserving adaptive sparsity.

Useful4/10
Difficulty5/10
Novelty7/10
Paper: A Structural Theory of Admissible Transitions in Biological Reaction Networks arXiv:2608.27201