Architecture ideas

Attention variants, state-space and recurrent cells, normalization and token-mixing schemes — each tested against the standard block it replaces.

Unverified 2026

Complex Phase-Corrected State Integrator

Use the complex-conjugate palindromic coefficient that cancels the leading temporal phase defect of oscillatory modes. Implement complex arithmetic directly or use an exactly equivalent doubled-real state, then project the final state to its real component for real-valued prediction tasks.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Sharp CFL stability and temporal-dispersion optimization of symmetric splitting schemes for time-domain Maxwell equations arXiv:2608.22315
Unverified 2026

Pole-Tuned Graph Residual Layer

Use the graph Laplacian spectrum to set the mixing and correction coefficients of a two-state graph-propagation block. Balancing the contraction of low-frequency consensus modes against high-frequency disagreement modes may reduce oversmoothing and make deep graph-neural networks less sensitive to manually selected residual coefficients.

Useful5/10
Difficulty6/10
Novelty5/10
Paper: Optimal Parameter Design for DIGing on Minimizing Unweighted Sum of Squares arXiv:2607.25463
Unverified 2026

Commutator-Polynomial Residual Adapter

Replace an unconstrained linear residual adapter by an operator \(T\) satisfying a polynomial relation in the commutator operator \(\Delta_A(X)=AX-XA\). Choose the polynomial roots in a stable half-plane so that repeated commutators become nilpotent, making repeated adapter application terminate algebraically and permitting a finite-polynomial inverse of \(I+T\).

Useful4/10
Difficulty6/10
Novelty9/10
Paper: Spectral Rigidity of Commutators: Dynamics, Resonance, and Nilpotency arXiv:2608.29574
Unverified 2026

Coherent-Fluctuating Amplitude Units

Represent selected hidden features as z = sqrt(N) exp(i theta), with a persistent phase and an explicitly stochastic amplitude. Regularize the ratio between coherent power |E[z]|^2 and total power E[|z|^2] toward the condensate prediction pi/4, while optionally matching higher amplitude moments.

Useful4/10
Difficulty5/10
Novelty8/10
Paper: Coherent Bose-Einstein condensation with fluctuating density arXiv:2607.12926
Unverified 2026

Narayana-stable polynomial layer

Replace a monomial polynomial feature block by a fixed Narayana basis transformation. If the input polynomial has nonnegative coefficients and only real roots, the transformed polynomial is guaranteed to have only real roots as well, giving a certified stability-preserving coordinate change for polynomial neural networks.

Useful4/10
Difficulty5/10
Novelty9/10
Paper: The Narayana transformation arXiv:2607.01572
Unverified 2026

Reaction-Closed Sparse Routing

Represent the active experts or channels of a sparse layer by a presence set and impose a reaction-style dependency graph on possible support changes. During a growth phase, activate only the least support set closed under enabled dependencies; during later pruning, allow trajectory-dependent removals but never add structurally unreachable experts. This should reduce routing churn and dead experts while preserving adaptive sparsity.

Useful4/10
Difficulty5/10
Novelty7/10
Paper: A Structural Theory of Admissible Transitions in Biological Reaction Networks arXiv:2608.27201