Architecture ideas

Attention variants, state-space and recurrent cells, normalization and token-mixing schemes — each tested against the standard block it replaces.

△ Mechanism confirmed, baseline not beaten 2026

Equivariant Shared-Mechanism World Model

Use the paper's families of local graph embeddings to identify repeated occurrences of the same causal substructure across time steps, environments, or entities. Feed every aligned occurrence through one shared transition mechanism and impose an explicit equivariance penalty under the symmetry group acting on occurrence indices, rather than learning an independent predictor for every context.

Useful8/10
Difficulty5/10
Novelty5/10
Paper: Symmetries and Causality: Causal Effect Identification Beyond IID Data arXiv:2609.03697
△ Mechanism confirmed, baseline not beaten 2026

Quotient Spectral Positional Encoding

Construct a graph and its spectral positional features using affinities between inputs after optimally aligning one input over the known symmetry group. Feed these quotient-space eigenvectors to a transformer or graph neural network, so symmetry-equivalent examples receive the same structural coordinates without storing augmented copies.

Useful8/10
Difficulty6/10
Novelty6/10
Paper: Group Invariant Spectral Embedding arXiv:2607.08987
✗ Mechanism failed 2026

Adversarial Subspace Residual Localizer

Replace a fragile learned similarity score for continuous object coordinates with a projection residual against a learned signal subspace. Candidate coordinates are represented by normalized Fourier or positional feature vectors, and the score is the fraction of feature energy outside the estimated subspace. The score remains useful even when the estimated subspace is adversarially rotated, because the perturbation is controlled directly by a sine-theta distance rather than by assumptions about…

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Certified Spherical MUSIC for 3D Localization under Adversarial Subspace Perturbations arXiv:2609.03264
△ Mechanism confirmed, baseline not beaten 2026

Nullspace-coordinate constrained operator blocks

Build a neural operator from frozen ambient mechanism blocks and a geometry-specific algebraic constraint adapter. The adapter parameterizes all outputs in the affine set satisfying sampled linear constraints exactly, so the network never produces boundary-violating states and does not require a penalty coefficient or post-step projection.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: Geometry-aware LegONet for PDE Learning on Arbitrary Domains arXiv:2607.23069
△ Mechanism confirmed, baseline not beaten 2026

Ordered Diffusion Message Passing

Use a learned scalar ordering function to turn a symmetric local Gaussian graph kernel into a directed, row-stochastic message-passing operator. The asymmetric tilt lets neighboring nodes communicate preferentially along an inferred dynamical direction, while the Gaussian factor retains locality and diffusion-like smoothing.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Ordered Diffusion Kernels arXiv:2608.18019
✗ Failed on benchmark 2026

Gauge-Free Spectral OT Layer

Parameterize an entropic OT cost only in directions that can change the transport plan, removing row-plus-column potential directions that are invisible because of OT gauge invariance. Whiten the remaining feature coordinates using their empirical covariance, producing an OT layer whose identifiable parameters have substantially more uniform sensitivity.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Sinkhorn Linearization and the Spectral Proxy: Unifying the Statistical and Algorithmic Theory of Feature-Parameterized Inverse Optimal Transport via a Single Spectral Sandwich arXiv:2608.13201
✗ Failed on benchmark 2026

Differentiable Persistence Landscape Layer

Convert each persistence diagram produced from an input, intermediate feature map, or graph filtration into a discretized persistence landscape and feed it to an MLP or concatenate it with ordinary neural features. Unlike a variable-size list of birth-death pairs, the landscape has a fixed tensor shape and is provably nonexpansive with respect to the diagram Wasserstein distance.

Useful7/10
Difficulty4/10
Novelty5/10
Paper: A Hilbert space embedding of persistence diagrams and barcodes arXiv:2608.08858
△ Mechanism confirmed, baseline not beaten 2026

Hodge-Selective Edge Dynamics

Replace an unconstrained edge-feature residual update in a graph neural network with separate cut-space and harmonic-space updates. The cut branch carries transfer information visible at nodes, while the harmonic branch models cycle circulation and can be given an independently chosen contraction rate, preventing persistent or unstable circulation features from contaminating node predictions.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: From a Scalar Parabolic Oscillator to Topological Thermostats: Selective Feeback Control of Harmonic Flow Modes arXiv:2608.07768
△ Mechanism confirmed, baseline not beaten 2026

Tropical Multisymmetric Pooling

Replace ordinary sum or mean pooling in a permutation-invariant set network by the complete family of basic tropical multisymmetric values. For an input set of n points in R^r, each feature computes the maximum total coordinate score obtainable by assigning disjoint rows to prescribed coordinate channels. The resulting representation is invariant to row permutations, separates all multisets, and inherits a bi-Lipschitz relation to optimal row matching, so nearby sets cannot be arbitrarily…

Useful7/10
Difficulty5/10
Novelty8/10
Paper: The basic tropical polynomials generate the semifield of $r$-symmetric tropical rational functions arXiv:2608.06857
△ Mechanism confirmed, baseline not beaten 2026

Local separating-code positional encodings

Replace globally unique node IDs with a small discrete alphabet labeling whose ordered local neighborhood words uniquely identify nodes. Feed these separating words to a GNN or graph transformer as positional features, preserving node distinguishability with bounded local receptive fields.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Information and Locality in Cayley Graphs arXiv:2608.04608
△ Mechanism confirmed, baseline not beaten 2026

Spectrally identifiable phaseless recurrent layer

Build a complex-valued recurrent or graph-neural layer whose hidden state evolves under a fixed graph Schrödinger operator and is exposed to the downstream network only through coordinate magnitudes at several times. Choose the diagonal potential so that the spectrum has unique unordered pair sums, the squared-eigenvector matrix is invertible, and every eigenvector pair overlaps in at least one observed coordinate; the resulting temporal intensity code is theoretically injective up to one…

Useful7/10
Difficulty6/10
Novelty8/10
Paper: Dynamical phase retrieval for Schr{ö}dinger evolution on finite graphs arXiv:2607.26705
△ Mechanism confirmed, baseline not beaten 2026

Exact Neural de Rham Backbone

Replace independently parameterized scalar, vector, and higher-order neural outputs with consecutive spaces of ReLU-power differential forms linked by an exact exterior-derivative layer. The network can then produce curl-free, divergence-free, or more general closed fields by construction, while the complex prevents artificial null-space modes that commonly appear when differential constraints are enforced only through sampled residual losses.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: ReLU$^k$ Neural de Rham Complexes arXiv:2607.22478
△ Mechanism confirmed, baseline not beaten 2026

Tangent-Branch Neural Evasion Layer

Wrap a neural multi-agent policy with an analytic planner that generates turn-straight trajectories tangent to pursuer surveillance disks, then selects the branch with the smallest predicted completion time. The network supplies high-level preferences or residual corrections, while the geometric layer prevents unnecessarily entering exclusion regions and exposes an explicit branch-switching signal for training.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Semi-Explicit Solutions to the Prying-Pedestrian Surveillance-Evasion Differential Game and Extensions to Two Pursuers arXiv:2607.21087
✗ Mechanism failed 2026

Zeta-Corrected Singular Integral Layer

Construct a periodic neural integral layer whose fixed singular kernel behaves like |y|^{-s} near the origin, but whose samples on the uniform grid are replaced on a small symmetric stencil by SinCoTrap correction weights. The correction cancels low-order Taylor errors caused by sampling the singularity, while all nonlocal grid points remain unchanged. Increasing the correction order from p=0 to p=1 or p=2 should reduce discretization error without increasing global grid resolution.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: SinCoTrap: A High-Order Locally Corrected Trapezoidal Rule for Periodic Singular Integrals in Arbitrary Dimensions arXiv:2607.12390
✗ Failed on benchmark 2026

ZCA In-Context Output Transport

Train a neural surrogate to predict outputs in a source-domain ZCA-whitened space, then adapt to a shifted domain using only the shifted domain's output mean and covariance. At inference, transport the network prediction through the target covariance square root, yielding a weight-free correction that preserves output-coordinate semantics and can be applied to MLP, CNN, graph-NN, or transformer regressors.

Useful7/10
Difficulty4/10
Novelty5/10
Paper: Gradient-Free Topology Adaptation for Power Flow Surrogates via In-Context Whitening arXiv:2607.12241
✗ Mechanism failed 2026

Multi-view cycle-consistent matching layer

Replace independent pairwise feature matching across augmented or multimodal views with jointly estimated soft permutation matrices constrained to agree through cycles. The paper's multi-view result suggests that independent copies can cross a correspondence-recovery threshold even when every individual pairwise matching is statistically non-informative. In a neural network, this can provide cleaner token, patch, object, or cell alignment targets and can be used either as a differentiable…

Useful7/10
Difficulty5/10
Novelty6/10
Paper: Geometric planted matchings in high dimensions: The power of multiple views arXiv:2607.09026
✗ Failed on benchmark 2026

Differentiable Gaussian DAG Layer

Replace an unconstrained covariance or dependency module with a topologically ordered linear-Gaussian DAG whose edge transforms and innovation covariances are neural-network parameters. The layer computes a joint covariance by a differentiable triangular solve, allowing downstream losses to use uncertainty, conditional prediction, or dependency penalties while preserving positive semidefiniteness by construction. This is especially suitable for graph neural networks, structured VAEs, and…

Useful7/10
Difficulty5/10
Novelty6/10
Paper: A Differentiable Covariance Calculus for Linear Gaussian Bayesian Networks arXiv:2607.04578
✓ Mechanism works 2026

Rooted Motif Positional Encoding

Augment every graph node with a vector of rooted walk and motif densities rather than relying only on degree or Laplacian positional encodings. This should distinguish nodes or communities with identical expected degree but different connectivity profiles, especially in equal-degree stochastic block models and graphs with locally heterogeneous structure.

Useful7/10
Difficulty4/10
Novelty6/10
Paper: Beyond Degree: Rooted Motif Signatures for Latent Position Identifiability in Graphon Models arXiv:2607.01358
✗ Failed on benchmark 2026

Cross-domain amortized inverse operator

Use separate measurement-domain and target-domain token sets so a network can infer a field on one spatial domain from sparse observations on another in one forward pass. The same decoder can answer arbitrary target query points, avoiding an optimization loop for each inverse instance.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: GAIA: Geometry-Adaptive Operator Learning for Forward and Inverse Problems arXiv:2607.01128
Unverified 2026

Uniform Species Architecture Sampler

Translate a recursive neural architecture grammar into a combinatorial specification and use its generating function to sample architectures uniformly conditional on size. This removes the severe shape and branching biases of naive random tree generation, producing a better-covered architecture-search population at the same evaluation budget.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Enumerating Chemical Structures, Stereoisomers, and Stereogenic Units with Analytic Combinatorics arXiv:2609.02932
Unverified 2026

Bicomplex Spatio-Temporal Residual Encoder

Replace independent per-sensor temporal encoders with a shared two-dimensional transform whose temporal and spatial phase channels remain algebraically distinguishable. Train a neural residual detector and localization head on the transformed coefficients, forcing perturbations with the same temporal signature but different positions to differ primarily in their spatial phase.

Useful6/10
Difficulty5/10
Novelty8/10
Paper: Multivariable Geometric Laplace Transform and Fault Detection in Distributed-Converter Lines arXiv:2609.02431
Unverified 2026

Sparse Legendre Shape Hypernetwork

Use a sparse multivariate Legendre expansion as the geometry-to-network-weights map, rather than an unconstrained MLP that consumes all shape parameters. The hypernetwork predicts only coefficients for a selected set of polynomial multi-indices, allowing high-dimensional or countably parameterized shape uncertainty to be handled with a number of learned terms determined by coefficient decay rather than ambient dimension.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Shape Holomorphy and Sparse Approximation of the Maxwell Electric Field Integral Operator arXiv:2609.00466
Unverified 2026

Poisson Non-Backtracking Fingerprint

Add a fixed or lightly parameterized graph-level feature extractor based on short non-backtracking cycle counts, and concatenate its Poisson log-likelihood-ratio features with the output of a graph neural network. The feature scaling uses the paper's explicit means, so the network receives statistics that are approximately independent and correctly normalized rather than raw, highly correlated cycle counts.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Analysis of Polynomial Threshold Functions on Random Regular Graphs: Computational Complexity of Detecting Noisy Random Lift arXiv:2608.28539
Unverified 2026

Mass-Conserving Puncta Router

Insert a differentiable reaction-diffusion layer that converts dense token or pixel features into sparse, spatially coherent routing masks. Two competing orientations form complexes through conserved monomer reservoirs, so local assignments can cluster while opposite assignments mutually exclude one another instead of independently activating at the same location. The layer can be used as a soft-to-hard MoE router, attention-mask generator, or object-part grouping module.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Clustering versus sorting: a mass-conserving reaction-diffusion model of planar polarity puncta arXiv:2608.29679