Architecture ideas

Attention variants, state-space and recurrent cells, normalization and token-mixing schemes — each tested against the standard block it replaces.

Unverified 2026

Schur torsion-filter feature layer

Add a deterministic feature layer that evaluates symmetric Schur-type features on a fixed cyclic orbit and learned reciprocal latent pairs, then projects the resulting channels onto selected residue classes with an exact roots-of-unity filter. The reciprocal construction makes the layer invariant under replacing each latent scalar by its inverse, while the torsion projector prevents leakage between cyclic frequency sectors.

Useful5/10
Difficulty6/10
Novelty6/10
Paper: Schur polynomials twisted by roots of unity and reciprocal pairs: torsion filters, fusion quotients, and total unimodularity at odd order arXiv:2608.18302
Unverified 2026

Veronese Projective Feature Layer

Replace or augment the first embedding layer for antipodally identified inputs with the normalized traceless quadratic map from the Veronese construction. Because q and -q produce exactly the same feature, the layer enforces projective invariance by construction rather than learning it from augmented examples. The resulting matrix-valued features can be flattened, projected, or processed by an equivariant linear layer.

Useful5/10
Difficulty2/10
Novelty6/10
Paper: Normal Curvature and the Projective Systole arXiv:2608.18002
Unverified 2026

Potential-weighted fractional diffusion layer

Insert a positivity-preserving fractional Schrödinger resolvent into a 1D neural sequence block. Given a nonnegative learned potential V, the layer transforms an input signal f using V^a(-Delta+V)^(-a)f, allowing the network to learn where to smooth or suppress features while retaining an L1 bound independent of the potential magnitude. Use a in (0,1] as a fixed hyperparameter or a clipped learned scalar.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Potential-free $L^1$-estimates for positivity-preserving Riesz transform related to Schrödinger operator in dimension one arXiv:2608.17406
Unverified 2026

Schatten-Stable Noncommutative Matrix Layer

Replace an ordinary elementwise interaction between two feature matrices by a noncommutative functional-calculus layer \(\varphi(A,B)\), where \(A\) and \(B\) are Hermitian channel operators that need not commute. Add a soft penalty on \([A,B]=AB-BA\), and use a Besov-smooth parameterization of \(\varphi\) so that perturbations are controlled in Schatten \(p\)-norm for \(p\leq2\). This creates a principled matrix interaction module that can remain stable when feature operators or graph…

Useful5/10
Difficulty6/10
Novelty8/10
Paper: Commutator estimates for functions of noncommuting self-adjoint operators arXiv:2608.16731
Unverified 2026

Matroid-Capacity Router

Replace independent top-k expert decisions by a global fractional routing problem that enforces token-side and expert-side capacities together with an additional diversity constraint represented by a partition or laminar matroid. Use the resulting Hall-type deficiency certificate to identify overloaded token subsets and penalize the actual structural cause of routing failure rather than relying only on an aggregate load-balancing loss.

Useful5/10
Difficulty6/10
Novelty4/10
Paper: Measurable Matroids: Foundations and Min--Max Theorems arXiv:2608.16464
Unverified 2026

Hermitian ETF classifier head

Construct a classifier whose normalized class vectors form an explicit 2d-line equiangular tight frame instead of using independently initialized weights. The ETF gives every class the same norm, equal pairwise coherence, and an isotropic frame operator, which should make final-layer gradients better conditioned and reduce accidental class crowding. The classifier can be fixed, or restricted to a learned unitary rotation of the ETF so that its geometry is preserved during training.

Useful5/10
Difficulty4/10
Novelty4/10
Paper: New constructions of optimal arrangements of $2d$ lines in $\mathbb{C}^d$ arXiv:2608.16116
Unverified 2026

PSD-Safe Learnable Similarity Kernel

Use the finite-order characterization to learn a nonlinear similarity function for token, patch, or graph-node Gram matrices while preserving PSD by construction or by a differentiable certificate loss. This creates a kernelized attention or graph-readout mechanism in which nonlinear affinity transformations cannot introduce indefinite similarity geometry.

Useful5/10
Difficulty6/10
Novelty6/10
Paper: A finite-order characterization of entrywise positivity preservers arXiv:2608.15904
Unverified 2026

Singularity-isolated cell interaction layer

Replace pointwise pair interactions between mesh cells by quadrature of the interaction kernel over the full Cartesian product of the two cells. Decompose each cell pair into convex-hull pieces and apply a Duffy-like radial transformation so the coincidence singularity is confined to one quadrature coordinate, allowing fixed Gauss-Jacobi or adaptive quadrature to produce smooth, low-variance interaction features.

Useful5/10
Difficulty7/10
Novelty7/10
Paper: Space-Time Galerkin Boundary Element Method for the Wave Equation arXiv:2608.15292
Unverified 2026

Critical 2d Intensity Bottleneck

Replace a complex latent vector x in C^d by squared magnitudes of m learned complex linear projections. Set m equal to 2d: the paper proves that m less than or equal to 2d minus 1 cannot generically preserve the latent up to global phase, whereas m equal to 2d is generically sufficient, giving a principled minimal width for a phase-invariant neural bottleneck.

Useful5/10
Difficulty4/10
Novelty7/10
Paper: The Minimum Number of Measurements for Almost-Everywhere Complex Phase Retrieval arXiv:2608.15003
Unverified 2026

Correlated-Gaussian Orbit Fingerprint

Replace a polynomial layer's single-replica output statistics with a finite fingerprint computed from several correlated Gaussian replicas. Train the fingerprint to be invariant under orthogonal reparameterizations while remaining discriminative between genuinely different polynomial maps, preventing models from collapsing distinct tensor functions that have identical marginal output laws. This is a practical symmetry-aware regularizer or auxiliary embedding for tensorized MLPs and polynomial…

Useful5/10
Difficulty5/10
Novelty8/10
Paper: Finite Gaussian Reconstruction of Polynomial Orbits: From Correlated Moments to Oscillatory Periods arXiv:2608.14475
Unverified 2026

Jordan spectral feature scaling

Group neural features into small Hermitian matrix elements and scale each group with the paper's tracial spectral Lp norm rather than independently normalizing scalar channels. This introduces a coupled spectral geometry while remaining implementable with ordinary eigendecompositions in the associative Hermitian-matrix special case.

Useful5/10
Difficulty5/10
Novelty8/10
Paper: Spectral nonassociative $\mathrm{L}^p$-spaces for $\mathrm{JBW}^*$-algebras arXiv:2608.14231
Unverified 2026

Velocity-Scaled Symbolic Flow Model

Represent a continuous-time neural dynamical system as a symbolic Markov chain over regions together with a positive learned roof function giving the time spent in each region. Weight local reconstruction and prediction errors by the predicted vector-field speed, following the paper's scaled Hölder coding relation, so that the model does not over-penalize arbitrarily small coordinate errors near equilibria. This produces a hybrid latent model with discrete long-range structure and continuous…

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Symbolic dynamics for non-uniformly hyperbolic flows arXiv:2608.14095
Unverified 2026

Hardy-Basis Equivariant Mixer

Insert a fixed or partially learnable equivariant change-of-basis module into a spherical or SO(3)-equivariant network. At each angular frequency \(\ell\), the module maps the line selected by the line-bundle quantization to the line selected by the Grauert-tube quantization, allowing the network to represent both holomorphic/base-local and geodesic-flow-adapted features without breaking rotation equivariance.

Useful5/10
Difficulty5/10
Novelty8/10
Paper: Intertwining the line bundle and Grauert-tube Hardy quantizations of the round 2-sphere arXiv:2608.13965
Unverified 2026

Jucys–Murphy spectral token mixer

Add a structured token-mixing layer based on commuting sums of swap operators rather than unconstrained pairwise attention. The layer learns a low-degree spectral filter in the Jucys–Murphy operators, allowing it to represent hierarchical interactions while retaining an explicit algebraic inductive bias.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Hitting-time mixing for the star transposition shuffle arXiv:2608.13727
Unverified 2026

Convex-lifted additive codebook

Encode each scalar or discrete code t by the strictly convex lift γ(t)=(t,t²), optionally followed by a learned linear projection and normalization. Because three-code sums on this curve have only near-minimal additive energy, the representation should produce fewer collisions when a model composes three tokens, codes, or retrieved items by addition.

Useful5/10
Difficulty3/10
Novelty7/10
Paper: Near optimal three-fold additive energy bound for points on convex curves arXiv:2608.12316
Unverified 2026

Pisot-Separated Multiscale Codes

Replace an unconstrained geometric multiscale codebook by features generated from a finite digit set and a Pisot scale factor. The contracting algebraic-conjugate directions should suppress near-collisions between representations at different scales, producing a discretely separated hierarchy that can be used for embeddings, recurrent memory, or quantized transformer states.

Useful5/10
Difficulty6/10
Novelty9/10
Paper: Self-similar Delone sets and Pisot numbers arXiv:2608.11867
Unverified 2026

Spectral Phase-Lifted Features

Augment a hidden representation with positively homogeneous interaction features built from approximate eigenmodes of a linear layer. Fractional products of mode magnitudes and phases provide nonlinear channels whose transformation laws are inherited from the spectrum of the underlying operator, potentially representing oscillatory or multiplicative dynamics more compactly than a generic MLP.

Useful5/10
Difficulty7/10
Novelty8/10
Paper: The spectrum of operator extensions to free Banach Lattices arXiv:2608.11437
Unverified 2026

Independent-Set Neural Output Head

Replace an unconstrained categorical or multilabel output head with a graph-supported distribution over feasible independent sets. Given neural logits, assign probability proportional to the exponential of the total logit of each selected vertex, so incompatible vertices can never be jointly active. Use exact junction-tree inference for decomposable graphs with small treewidth, and compare against post-hoc masking or penalty-based constraint enforcement.

Useful5/10
Difficulty6/10
Novelty6/10
Paper: Graphical Models for Multivariate Count Data arXiv:2608.11366
Unverified 2026

Elliptic Low-Oscillation Feature Layer

Construct a spatially varying diffusion layer whose coefficient matrix is explicitly uniformly elliptic and whose local mean oscillation is penalized. Use it inside an implicit residual block, so the learned operator remains a controlled perturbation of a constant-coefficient elliptic operator rather than becoming an unstable collection of unrelated local filters.

Useful5/10
Difficulty6/10
Novelty8/10
Paper: Regularity for Elliptic Equations with Coefficients of Small Mean Oscillation arXiv:2608.10813
Unverified 2026

Birkhoff Modular Mask Regularizer

Represent structured neural masks or routing states as order ideals of a finite prerequisite poset, then use a modular score whose exact minimizers are a desired decomposition-closed family of valid configurations. This replaces many pairwise constraint penalties with one additive potential that gives zero cost to every intended valid state and positive cost to invalid intermediate states.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Decomposition-Closed Sublattices as Minimizer Sets of Modular Functions over Distributive Lattices arXiv:2608.10026
Unverified 2026

Asymmetry-Aware Bochner–Riesz Graph Filter

Replace a sharp graph-Laplacian spectral filter with a Bochner–Riesz filter whose smoothness exponent increases when the graph contains regions with different effective dimensions. Estimate the largest local dimension and dimension gap from neighborhood growth, then choose the exponent above both the classical spectral threshold and the asymmetric obstruction threshold. This should suppress unstable high-frequency mixing in heterogeneous graphs while preserving more low-frequency signal than…

Useful5/10
Difficulty5/10
Novelty6/10
Paper: Herz versus Fefferman: Symmetric and asymmetric Bochner--Riesz theory arXiv:2608.09247
Unverified 2026

Mean-Curvature Relaxation Layer

Insert a small number of differentiable graphical mean-curvature-flow steps between a neural network's raw vector-field prediction and its task loss. The relaxation performs geometry-aware smoothing rather than isotropic Gaussian smoothing, and it can enforce fixed boundary values after every step.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Well-posedness for the mean curvature flow on the half-space and on bounded domains arXiv:2608.08901
Unverified 2026

Proper binary edge positional encoding for tree GNNs

Precompute a two-valued edge labeling of every input tree so that adjacent vertices have different weighted incident-edge sums. Feed the edge labels and resulting vertex signatures into message passing as deterministic symmetry breakers. This can distinguish branches that otherwise produce identical initial representations without adding trainable parameters or random node identifiers.

Useful5/10
Difficulty4/10
Novelty7/10
Paper: Proper $\{a,b\}$-edge-weightings of trees arXiv:2608.08438
Unverified 2026

Lexicographic spectral activation

Replace an ordinary elementwise nonlinearity on a learned Hermitian matrix with a matrix function f(A), while supplying exact Jacobian-vector and Hessian-vector products through the lexicographic divided-difference formula. This gives a principled spectral layer for covariance features, graph operators, attention kernels, or matrix-valued embeddings, particularly when perturbation matrices do not commute and eigenvalues are repeated or nearly repeated.

Useful5/10
Difficulty5/10
Novelty5/10
Paper: Lexicographic functional calculus and its application to functional calculus calculus arXiv:2608.08404