Architecture ideas

Attention variants, state-space and recurrent cells, normalization and token-mixing schemes — each tested against the standard block it replaces.

Unverified 2026

Cross-Order Hodge Stability Scaling

Normalize every higher-order simplicial message-passing or diffusion block using the spectral radius of a lower-order up-Laplacian, rather than estimating a separate radius for each order. The paper's monotonicity theorem guarantees that this shared bound is conservative for all higher orders, enabling stable explicit updates with one spectral calibration.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Eigenvalue growth of the discrete Hodge Laplacian across dimensions arXiv:2608.11170
Unverified 2026

Mean-Curvature Relaxation Layer

Insert a small number of differentiable graphical mean-curvature-flow steps between a neural network's raw vector-field prediction and its task loss. The relaxation performs geometry-aware smoothing rather than isotropic Gaussian smoothing, and it can enforce fixed boundary values after every step.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Well-posedness for the mean curvature flow on the half-space and on bounded domains arXiv:2608.08901
Unverified 2026

Lexicographic spectral activation

Replace an ordinary elementwise nonlinearity on a learned Hermitian matrix with a matrix function f(A), while supplying exact Jacobian-vector and Hessian-vector products through the lexicographic divided-difference formula. This gives a principled spectral layer for covariance features, graph operators, attention kernels, or matrix-valued embeddings, particularly when perturbation matrices do not commute and eigenvalues are repeated or nearly repeated.

Useful5/10
Difficulty5/10
Novelty5/10
Paper: Lexicographic functional calculus and its application to functional calculus calculus arXiv:2608.08404
Unverified 2026

Vacancy-preserving collision-free router

Build a differentiable assignment layer whose rows represent tokens and whose columns represent experts, memory slots, or attention slots. Each row has unit probability mass, but no column receives positive mass from two rows; maintaining at least one vacant column makes assignments continuously deformable through elementary vacancy moves instead of abrupt softmax switches.

Useful5/10
Difficulty6/10
Novelty5/10
Paper: Tilings, packings, and the existence of Schwartz-class Gabor windows arXiv:2608.06679
Unverified 2026

Trace-Free Hodge Feature Mixer

Build a parameter-free spectral channel mixer whose channels are arranged as components of an l-form and whose multiplier is the trace-free Beurling--Ahlfors transform. At every nonzero spatial frequency it mixes the exact and coexact channel subspaces with opposite signs, preventing a uniform channel-direction bias and preserving a structured cancellation property. Insert it as a residual branch before a convolution, MLP, or attention block, with one learned scalar gate controlling its…

Useful5/10
Difficulty6/10
Novelty8/10
Paper: The trace-free Beurling--Ahlfors transform and the Bourgain--Brezis problem for Hodge systems arXiv:2608.04237
Unverified 2026

Topology-Guided Capacity Allocation

Use the layer at which persistent connected components and holes disappear to allocate capacity nonuniformly across a network. If representations simplify much earlier than desired, widen the responsible layers or insert an additional block; if simplification is excessively delayed, avoid spending parameters there. This turns persistent-homology COM into an actionable architecture-search signal rather than a post-hoc visualization.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Topological Simplification in Predictive Coding Networks arXiv:2608.02816
Unverified 2026

Distributional spectral-preconditioned features

Replace or augment a singular scalar activation \(\sigma\) with a distributionally regularized activation \(g\) whose Fourier transform is multiplied by \((i\rho)^\alpha\). This suppresses the problematic low-frequency singular component and can produce better-conditioned random-feature or first-layer representations, while a residual raw-activation branch prevents loss of standard approximation behavior.

Useful5/10
Difficulty5/10
Novelty8/10
Paper: Radon Measure Representations for Infinite-Width Neural Networks with Singular Activations arXiv:2607.29258
Unverified 2026

Determinantal Exclusion Router

Replace independent softmax expert choices with a collision-free Markov router whose particles occupy expert positions on a one-dimensional or circular index lattice. A particle can move only to an empty neighboring expert, and the move rate contains a product of sine ratios that globally repels nearby assignments; this should reduce expert collapse and produce more evenly spread routing without requiring a separate pairwise diversity loss.

Useful5/10
Difficulty7/10
Novelty8/10
Paper: Exact Results for the Symmetric Dyson Exclusion Process arXiv:2607.28807
Unverified 2026

Twisted-Shift Feature Mixer

Build a neural feature-mixing layer from a truncated shift S and a diagonal phase operator T satisfying TS=qST, with |q|=1. The relation forces moving one position in the graded feature basis to multiply the phase operator by q, providing a compact inductive bias for periodic, phase-sensitive, or cyclic data.

Useful5/10
Difficulty4/10
Novelty7/10
Paper: On the diversity of twisted commuting operators arXiv:2607.28372
Unverified 2026

q-Boson Spectral Initialization

Initialize a neural layer with singular values taken from the finite spectral measure of the paper's q-boson Jacobi operator instead of using Xavier or ordinary orthogonal initialization. The resulting layer has a deliberately shaped singular-value distribution and an explicit finite-size spectral edge, allowing initialization to target stable signal propagation while retaining spectral diversity.

Useful5/10
Difficulty4/10
Novelty7/10
Paper: Sharp Bounds on Ground State Energy of the SYK Model arXiv:2607.27185
Unverified 2026

Dispersive Analytic Smoothing Block

Insert a short gKdV-inspired spectral flow between neural blocks to regularize rough feature maps without using an isotropic low-pass filter. The module applies a Fourier dispersive phase and derivative-coupled polynomial residual updates, with an optional finite factorial dilation penalty to encourage analytic-looking features.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Instantaneous analytic smoothing of rough data for the modified and cubic gKdV equations arXiv:2607.27115
Unverified 2026

Gradient-Commutator Neural Dynamics

Build a continuous-time neural dynamics module from scalar potential networks and their iterated Lie brackets instead of directly predicting an unrestricted vector field. Gradient primitives provide structured vector fields, while commutators add non-conservative and rotational directions; the paper proves that finite spans of such objects generate every smooth vector field on the stated compact manifold.

Useful5/10
Difficulty6/10
Novelty8/10
Paper: The Lie algebra generated by gradient vector fields arXiv:2607.26890
Unverified 2026

Commutator-flow latent block

Represent each token or graph node by an anti-Hermitian matrix latent state and replace a standard residual transformation with a discretized Lie-algebra vortex flow. The commutator nonlinearities are equivariant under global unitary conjugation, so the block can learn interactions without selecting a basis and preserves the anti-Hermitian state space when initialized there.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Vortex Filaments in Hermitian Reductive Lie Algebras arXiv:2607.26650
Unverified 2026

Correlation-Length Scaling Benchmark

Treat the maximum dependency distance faithfully modeled by a finite neural architecture as an emergent correlation length, and estimate how it grows with depth, state size, or attention span. Fit the exponent \(\kappa\) and use it as an architecture-selection signal: a model with larger \(\kappa\) should acquire long-range competence more efficiently at equal parameter or FLOP budget.

Useful5/10
Difficulty3/10
Novelty6/10
Paper: Universal scaling framework for parameterized quantum evolutions at criticality arXiv:2607.22863
Unverified 2026

Flux-Balanced Local-Nonlocal Neural Layer

Partition a sequence, image, or graph into regions processed by a cheap local operator and a more expressive nonlocal operator, then couple their boundary activations with a shared continuity equation and a conservative interface-flux equation. The interface correction prevents the local and global branches from creating discontinuities or duplicated information, allowing nonlocal computation to be restricted to selected regions while preserving global consistency.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Coupling of Local and Nonlocal Problems Using Local Boundary Conditions arXiv:2607.22672
Unverified 2026

Polynomial Spectral Mode Controller

Replace an eigendecomposition-based spectral controller in a small recurrent or state-space transition layer with explicit polynomial projectors. Each hidden state is split into invariant modes, and each mode receives a separately constrained recurrent multiplier, enabling direct suppression of unstable modes or selective retention of long-memory modes using only matrix-polynomial evaluations.

Useful5/10
Difficulty6/10
Novelty6/10
Paper: A Direct Polynomial Approach to Spectral Decomposition arXiv:2607.20218
Unverified 2026

Yang–Baxter Pairwise Router

Replace unconstrained pairwise token-routing interactions with a structured two-token router derived from an involutive set-theoretical Yang–Baxter solution. The pair operator is a convex interpolation between identity and a permutation of discrete routing states, so it cannot amplify probability mass or logits when applied to routing distributions. The Yang–Baxter relation provides a falsifiable test for whether three-token routing updates are insensitive to the two admissible…

Useful5/10
Difficulty6/10
Novelty8/10
Paper: Integrable multi-species SSEP with reactive particle species arXiv:2607.18959
Unverified 2026

Centrally Extended Fourier Mode Mixer

Construct a neural mixing layer on Fourier or positional modes using a small set of exponentiated Virasoro generators instead of a dense mode-to-mode matrix. The generator coefficients are shared across all inputs, while the Lie bracket fixes how different mode shifts interact; an optional central channel captures the special coupling between modes whose indices sum to zero.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: On a super-Virasoro group, a semigroup of annuli, and Gauss--Berezin integral operators arXiv:2607.17168
Unverified 2026

Protected-Kernel Graph Diffusion

Replace an ordinary graph diffusion or message-passing operator with a positive-semidefinite Laplacian whose kernel contains a prescribed node-wise subspace. The layer smooths only feature components orthogonal to that subspace, preserving global constants, positional modes, or other structural signals even when graph edges are dynamically added or removed.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Laplacian Spectral Shaping for Non-Uniform Scaling Formation Control of Open Multi-Agent Systems arXiv:2607.16709
Unverified 2026

Hadamard fractal Fourier encoding

Construct positional features from a self-similar digit system whose Fourier characters are orthogonal under a prescribed nonuniform measure, rather than sampling frequencies independently. Use several admissible multiplier values to create frequency bands while preserving the underlying Hadamard structure, giving a deterministic multiscale encoding with a better-conditioned feature Gram matrix on fractal or highly clustered coordinates.

Useful5/10
Difficulty4/10
Novelty5/10
Paper: Spectral eigenvalue set of self-similar measures associated with product-form Hadamard triples arXiv:2607.15743
Unverified 2026

Jordan-Isometric Matrix Layer

Replace an unconstrained linear map on matrix-valued features by an exact operator-norm isometry assembled from parallel copies of X and its transpose. Contractive compression matrices and unitary basis changes allow a wider family than ordinary orthogonal layers, while a contractive remainder can increase output width without increasing the layer's spectral norm.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Isometries between C$^*$-algebras with finite corank arXiv:2607.13367
Unverified 2026

Branching-Fanout Sparse MoE

Replace a fixed top-k expert count with a stochastic, token-specific fanout generated by a supercritical binary branching process stopped at a geometric time. The resulting number of active experts has finite mean but a power-law tail with log-periodic modulation, allowing most tokens to use little compute while reserving larger computation for difficult or ambiguous tokens.

Useful5/10
Difficulty6/10
Novelty8/10
Paper: Power-law and log-periodic degree tails for a family of probability generating function equations arising in evolving networks arXiv:2607.12564
Unverified 2026

Monadic Bar Refinement Network

Construct a shared latent transformation as a neural monad-like operator Γ=Ω∘Σ, and expose its iterates Γ^{q+1}Y as a refinement trajectory rather than stacking unrelated layers. Aggregate the resulting representations with a learned or fixed realization weighting, while training an algebra-action map θ:ΓY→Y to make one-step refinement compatible with the original representation. This creates a shallow-parameter, arbitrarily deep computation path with explicit compositional…

Useful5/10
Difficulty6/10
Novelty6/10
Paper: The homotopical monadicity theorem arXiv:2607.12124
Unverified 2026

Potential-Steered Observable Wave Layer

Replace homogeneous feature propagation with a discretized wave equation containing a positive, spatially varying learnable potential. The potential changes Hamiltonian trajectories so that feature energy reaches the layer's readout or sensor region instead of remaining in dynamically hidden modes. Train the potential jointly with the task objective and an empirical observability penalty.

Useful5/10
Difficulty6/10
Novelty8/10
Paper: Uniform controllability for the wave equation with large potential arXiv:2607.11702