Architecture ideas

Attention variants, state-space and recurrent cells, normalization and token-mixing schemes — each tested against the standard block it replaces.

Unverified 2026

Competing Infection-Removal Graph Layer

Replace a conventional graph message-passing layer with a finite-horizon stochastic propagation process containing susceptible, infected, and removed feature states. Messages spread along active infected-to-susceptible edges, while infected nodes are simultaneously deleted at a rate proportional to their susceptible-neighbor count. This provides explicit propagation control and anti-oversmoothing dynamics instead of repeatedly averaging over every neighbor.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: The Zombie Infection Model arXiv:2607.29409
Unverified 2026

Pullback-Commuting 3-Axis Network

Use three learned state-transition operators corresponding to three data axes, and train them to satisfy the paper's pullback-style interchange rule. For every local pair of axes, two successive updates should reach the same square state; for triples of axes, all six update orders should agree. This reduces sensitivity to scan direction and limits long-horizon drift caused by inconsistent local transitions.

Useful6/10
Difficulty6/10
Novelty7/10
Paper: Higher-Dimensional Symbolic Dynamics: A Textile Framework For 3-graphs arXiv:2607.29233
Unverified 2026

Null-form quadratic wave layer

Replace an unconstrained quadratic interaction between channel derivatives with a learnable combination of Lorentzian and antisymmetric null forms. For wave-equation surrogates, this enforces exact cancellation when two interacting features have parallel null directions, suppressing resonant derivative products that otherwise cause unstable long-horizon rollouts.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Recovery of a Null Form in the Wave Equation from Scattering Data arXiv:2607.28917
Unverified 2026

Group-Lifted Message Passing

Turn a small base message-passing graph into a family of larger graphs by replicating every base node across a finite fiber and wiring replicas with permutations derived from a group extension. Use one shared local neural update on every lifted copy, so parameter count stays that of the base graph while the lifted graph supplies additional global paths and larger effective receptive fields.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Lifting Lifted Product Codes arXiv:2607.28621
Unverified 2026

Interval-Lifetime Feature Modules

Represent a multiparameter feature stream as a direct sum of interval modules over the nonempty-subset lattice of several corruption, scale, or context variables. Each learned channel is active only on a connected order-convex region of the lattice, replacing a dense bank of unrelated per-condition adapters with reusable feature channels having explicit parameter-space lifetimes.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Interval Decompositions for Multipersistence Modules over Finite Posets and Robustness of Sheaf Data on Simplicial Complexes arXiv:2607.28134
Unverified 2026

Decoder branch witness regularizer

Apply the paper's mechanism-contrast idea to ReLU decoders by requiring each piecewise-affine branch to produce a detectable and distinctive change across at least one activation boundary. Penalize branches with vanishing Jacobian jumps or nearly identical boundary signatures, discouraging observationally interchangeable decoder mechanisms.

Useful6/10
Difficulty6/10
Novelty8/10
Paper: Beyond ICA: Identifiability by Symmetry Breaking arXiv:2607.23182
Unverified 2026

Structure-Preserving Profile Layer

Replace unconstrained output coordinates with a neural parameterization whose outputs are valid monotone profiles by construction, analogous to representing a Young diagram through nonnegative ordered row increments. Train the network against an explicit energy or negative log-probability while preserving the feasible geometry, rather than relying on penalties that permit invalid intermediate states.

Useful6/10
Difficulty4/10
Novelty6/10
Paper: Neural variational framework for random Young-diagram limit shapes arXiv:2607.27061
Unverified 2026

Essential-Edge Harmonic Attention

Compute one-dimensional persistent homology and minimum-norm harmonic representatives, then use their absolute edge coefficients as topology-aware saliency in a graph transformer. Add the saliency to attention logits or use it as a soft regularizer so the model preferentially propagates information along edges that are essential to persistent cycles.

Useful6/10
Difficulty6/10
Novelty7/10
Paper: Essential Simplices Dominate in Harmonic Representatives of One-Dimensional Persistent Classes arXiv:2607.26378
Unverified 2026

Homotopy-Associative Attention

Augment standard pairwise attention composition with a shared ternary correction m_3(a,b,c), so two different parenthesizations of a three-token or three-edge composition need not agree exactly but are forced to differ by a learned bounded correction. This gives the network a structured way to represent context-dependent compositionality without replacing efficient quadratic attention with unrestricted third-order attention.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Hochschild Cohomology of the Symmetric Square of an Annulus with Stops arXiv:2607.25944
Unverified 2026

Dynamic String-Averaged Constraint Layer

Insert a differentiable layer that enforces multiple affine consistency constraints by running several short strings of relaxed projections and averaging their outputs. Change the strings and weights across training steps, but impose bounded string length, positive averaging weights, and an almost-cyclic coverage rule so every constraint is revisited regularly. This creates an architecture-level analogue of dynamic string-averaging rather than applying one fixed projection order.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: On the boundedness of infinite products of relaxed projections: perturbations resilience and dynamic string-averaging arXiv:2607.25797
Unverified 2026

Fractional Nonlocal-Gradient Residual Block

Augment a local convolutional block with a fractional nonlocal-gradient branch that aggregates directional feature differences over multiple spatial scales. The residual branch gives each location access to long-range variation while preserving the property that constant feature fields produce zero response. A learnable residual gate allows the network to suppress the branch if nonlocal interactions are unhelpful.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: A Lusin theorem for nonlocal gradients arXiv:2607.25621
Unverified 2026

Double-Bracket Projector Refinement

Represent an attention or routing state as a symmetric projector or fixed-spectrum positive semidefinite matrix and refine it using the paper's double-bracket flow instead of unconstrained gradient steps. The update rotates the state toward a task-derived Hermitian cost matrix while preserving its eigenvalues, so rank, trace, and spectral diversity remain fixed by construction.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: A Path Integral Model of Cognition arXiv:2607.24807
Unverified 2026

Canonical Zero-Defect Density Layer

Convert a density-dependent operator acting only on active coordinates into an ambient neural layer by embedding with sqrt(rho) and setting its action to zero on the zero-density defect. This produces the minimum-norm extension and prevents arbitrary or unstable outputs on coordinates that the current density declares unobservable.

Useful6/10
Difficulty4/10
Novelty7/10
Paper: Density-Dependent Operators on Density-Projection Condensation Spaces: Ambient Extensions, Zero-Density Defects, and Stability arXiv:2607.24540
Unverified 2026

Noncommutative adjacency-degree moments

Augment a graph neural network with features generated by noncommutative words in the adjacency matrix and diagonal degree matrix. Ordered patterns such as AD^2A and DADA distinguish where degree information occurs along a walk; the paper proves that the full scalar moment family determines every tree.

Useful6/10
Difficulty4/10
Novelty6/10
Paper: Adjacency-degree algebras and spectral determination of graphs arXiv:2607.21494
Unverified 2026

Constraint-Free Skew Coupling

Compose independently parameterized neural dynamical modules through power-preserving skew coupling instead of equality penalties or projected constraints. This creates a modular graph or world model in which information exchanged between modules is antisymmetric, so internal coupling cannot create or destroy total latent energy.

Useful6/10
Difficulty6/10
Novelty6/10
Paper: Mixed finite element discretization of intrinsic geometrically exact beams for explicit multibody dynamics arXiv:2607.20245
Unverified 2026

Strongly Pseudomonotone Implicit Router

Replace an explicit MoE router or constrained output head with the solution of a variational inequality over a convex feasible set. The neural operator can be nonmonotone, but training should enforce a measurable strong-pseudomonotonicity margin so the selected route or control is unique and has bounded sensitivity to changes in the token representation. Use an explicit projection residual for approximate solving and for monitoring whether the implicit layer has actually converged.

Useful6/10
Difficulty6/10
Novelty5/10
Paper: A Coupled Nonsmooth Dynamical System: Global Well-Posedness, Stability and Sensitivity Analysis arXiv:2607.20133
Unverified 2026

Mollified Transport-Quantile Layer

Use a transport map \(Q_\theta\) from a fixed latent reference distribution to a data distribution, but expose only its locally averaged version \(\bar Q_{\theta,\sigma}(z)=\mathbb E_{u\sim K_\sigma(\cdot-z)}Q_\theta(u)\). Latent-space mollification integrates the pole-type influence singularity instead of allowing one training sample near \(Q_\theta(z)\) to dominate the quantile feature or its gradient.

Useful6/10
Difficulty4/10
Novelty7/10
Paper: The Influence Function of Transport-based Quantiles arXiv:2607.19080
Unverified 2026

Learned fractional-scale convolution

Replace a single Laplacian or fixed diffusion regularizer in a CNN with a finite positive mixture of fractional Laplacians at several orders. The resulting module separately controls short-range smoothing and long-range spatial coupling, while positivity preserves a dissipative energy and avoids the unstable behavior of arbitrary signed mixtures.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Ground state solutions for Hartree type equations driven by superposition operators and Pohozaev Identity arXiv:2607.19076
Unverified 2026

Hard-Rod Symmetry Invariant Module

Construct a scalar feature or critic for oscillator-based neural dynamics that is invariant under the transformations imposed by free harmonic motion and elastic collisions. For finite-size rods, the module should represent only quantities compatible with common oscillator-phase rotations and momentum permutations, preventing a learned world model from inventing coordinate-dependent pseudo-conserved quantities that disappear after collisions.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Absence of hidden analytic conserved quantities in harmonically confined rods arXiv:2607.18872
Unverified 2026

Volume-Weighted Hodge Convolution

Replace the ordinary combinatorial Hodge propagation in a simplicial neural network with a geometry-induced weighted Hodge Laplacian built from Euclidean simplex volumes. The operator preserves the harmonic/topological subspace while changing the positive spectrum according to the shape and scale of the simplices, allowing message passing to distinguish geometrically meaningful cells that have identical incidence patterns.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Geometry-Induced Hodge Stars on Rips and Dowker--Rips Complexes arXiv:2607.18692
Unverified 2026

Line-Graph Spectral Edge Parameterization

Replace one independently learned vector per graph edge with a truncated spectral expansion on the line graph. The model learns coefficients for low-frequency edge modes and reconstructs edge features before message passing, reducing parameters while imposing an inductive bias that incident edges should have correlated behavior.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Lossy compression of weighted graph adjacency matrices by transform coding arXiv:2607.14834
Unverified 2026

Gaussian Simplex Classification Head

Replace the unconstrained final classifier with equal-norm regular-simplex class directions and train it under explicit isotropic Gaussian feature noise. At fixed signal energy and equal class priors, the paper's Gaussian-max theorem predicts that this geometry maximizes finite-noise maximum-likelihood decoding probability, making it a concrete candidate for robust classification heads.

Useful6/10
Difficulty4/10
Novelty4/10
Paper: Stochastic Domination of Gaussian Maxima: A Resolution of the Weak Simplex Conjecture arXiv:2607.14087
Unverified 2026

Analytic KL spatial adapter

Replace a dense spatial parameter field in a neural field or convolutional adapter by a truncated squared-exponential KL expansion with analytic Gaussian-Hermite modes. The amplitude and correlation length remain trainable, but changing them only rescales coefficients and basis parameters instead of triggering a numerical eigensolve.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Hierarchical Bayesian inversion using the Karhunen-Loève expansion with analytical eigenpairs of the squared exponential kernel arXiv:2607.12387
Unverified 2026

Horizontal Symmetry Quotient Layer

Replace explicit quotient construction by a differentiable projection that removes learned group-orbit directions from both source and target features. The paper's reduction argument shows that a closed level constraint makes the restricted form horizontal, so the network can operate on invariant coordinates while retaining a measurable residual for symmetry leakage.

Useful6/10
Difficulty6/10
Novelty5/10
Paper: Reduction of relative multisymplectic manifolds arXiv:2607.12350