Architecture ideas

Attention variants, state-space and recurrent cells, normalization and token-mixing schemes — each tested against the standard block it replaces.

✗ Mechanism failed 2026

Reference-Preserving Martingale Layer

Replace an unconstrained stochastic transition between categorical or discretized latent distributions by a transition matrix that preserves a prescribed reference distribution while mapping relative populations through a martingale. This prevents the layer from inventing arbitrarily sharp deviations from the reference and imposes a convex-order monotonicity condition on uncertainty across layers or diffusion time steps.

Useful8/10
Difficulty6/10
Novelty7/10
Paper: State convertibility and fluctuation theorems from a dynamical reference: majorization meets martingales arXiv:2608.19391
△ Mechanism confirmed, baseline not beaten 2026

Tail-Aware Verifier Portfolio

Use the paper's tail comparison to decide when another call from the same verifier family is useless and when to switch to a different model, modality, or evidence source. The objective is to reduce the high-alpha survivor population—the incorrect examples that consistently fool one verifier—rather than maximizing average one-shot verifier accuracy.

Useful8/10
Difficulty5/10
Novelty7/10
Paper: Partially Correlated Verifier Cascades in LLM Harnesses: Concave Log-Odds, Polynomial Reliability, and Blind-Spot Ceilings arXiv:2607.13918
✗ Failed on benchmark 2026

Topological Fluctuation Graph Layer

Replace a deterministic graph propagation layer by a stable stochastic linearized latent dynamics whose frequency-resolved covariance matrix defines spectral bands. Train or initialize the graph operator so that a selected covariance band has a nonzero Chern number and remains separated by a measurable spectral gap, producing representations that are robust to local perturbations and can support boundary-localized responses.

Useful7/10
Difficulty7/10
Novelty8/10
Paper: Topology of Fluctuation Bands in Chiral Active Matter arXiv:2608.26055
✓✓ Beats tuned baseline 2026

KPZ latent evolution block

Replace an unconstrained recurrent or neural-operator latent transition with a differentiable KPZ cell acting on a spatial latent field. The cell explicitly separates smoothing, nonequilibrium nonlinear steepening, and stochastic forcing, making it suitable for driven dissipative systems and long-horizon roughening that generic networks may fail to reproduce.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Three-Dimensional Kardar--Parisi--Zhang Scaling in Polariton Condensates arXiv:2607.28106
✗ Failed on benchmark 2026

Nonlinear Noise-Tightening Drift

Replace a linear restoring drift in score-based sampling, latent dynamics, or stochastic regularization with a state-dependent nonlinear restoring term that is at least as contractive globally and more contractive away from the origin. This should reduce stationary variance without changing the worst-case local contraction certificate.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Wasserstein Stability of Contracting Flows: Effective Rates, Euler Self-Correction, and Noise Tightening arXiv:2607.14291
Unverified 2026

Nonreciprocal mutant feature fields

Replace a single residual feature field with two nonnegative streams: a primary representation A and a mutant or corrective representation B. A produces B through a one-way source term, while B suppresses A, creating an explicitly tunable competition mechanism that can prevent feature collapse and encourage complementary representations.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Death by mutants: unusual multicritical dynamics in a two-species model for absorbing state transitions arXiv:2609.03123
Unverified 2026

Reciprocal Paired-Density Network

Represent a neural density or feature field by two positive reciprocal branches whose product is the modeled density, analogous to the forward and backward fields in the paper. Add stochastic branching perturbations to the two branches and train their cross-covariance so that the diagonal paired density matches the target while off-diagonal correlations remain finite-range. This creates a structured alternative to an unconstrained single-field uncertainty representation.

Useful6/10
Difficulty6/10
Novelty7/10
Paper: Branching stochastic mechanics. I. Clustering and connected correlations within a branching-process representation of the Schrödinger equation arXiv:2608.29807
Unverified 2026

KPZ Directed-Polymer Attention

Replace independent Gaussian attention noise or unconstrained token routing with a directed-polymer path distribution over positions and layers. The router aggregates exponentially many monotone paths through temporally correlated random edge scores, producing heavy-tailed but spatially coherent routing and preventing attention from collapsing onto a single token. The paper's t^{2/3} wandering and t^{1/3} free-energy fluctuations become measurable diagnostics and tunable targets rather than…

Useful6/10
Difficulty5/10
Novelty7/10
Paper: KPZ Superdiffusion of Local Correlators in Diffusive Random Quantum Circuits arXiv:2608.06459
Unverified 2026

Noncommutative controllability regularizer

Equip a recurrent or state-space layer with multiple noncommuting transition operators and regularize the span of finite operator words applied to the input injection matrix. This discourages hidden directions that cannot be reached from the input and may improve long-range input influence, gradient propagation, and robustness under operator switching.

Useful6/10
Difficulty5/10
Novelty8/10
Paper: A noncommunicative Kalman condition for null controllability of backward stochastic parabolic systems arXiv:2608.01836
Unverified 2026

Competing Infection-Removal Graph Layer

Replace a conventional graph message-passing layer with a finite-horizon stochastic propagation process containing susceptible, infected, and removed feature states. Messages spread along active infected-to-susceptible edges, while infected nodes are simultaneously deleted at a rate proportional to their susceptible-neighbor count. This provides explicit propagation control and anti-oversmoothing dynamics instead of repeatedly averaging over every neighbor.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: The Zombie Infection Model arXiv:2607.29409
Unverified 2026

Morphogen-Controlled Topology-Preserving Sparse Growth

Replace fixed sparse masks with a stochastic birth-death process for neural connections or spatial units. A diffusing morphogen-like utility field controls where connections are added or removed, while a local simple-point test rejects removals or additions that would disconnect a layer or alter a prescribed computational topology. This creates an adaptive sparse architecture with a tunable compact-to-branched transition rather than unconstrained magnitude pruning.

Useful6/10
Difficulty6/10
Novelty6/10
Paper: Control of morphology and topology in a lattice model of branching morphogenesis arXiv:2607.24619
Unverified 2026

Convex-order stochastic expert layer

Replace a deterministic mixture-of-experts residual block with K population-indexed stochastic expert states coupled through a graphon matrix. The layer uses a shared drift and expert-dependent diffusion, while an empirical convex-order penalty makes later representations more dispersed than a reference representation without permitting a mean shift.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Convex order preservation for graphon mean-field systems arXiv:2608.19576
Unverified 2026

Marginal-Preserving Difference Noise

Construct two latent variables X and Y with exactly the same marginal distribution, while forcing their difference X-Y to follow a chosen centered noise or residual law. Insert the pair into a residual, VAE, or diffusion block so that the model receives the desired perturbation without changing the marginal latent distribution at either endpoint. This creates a controlled alternative to independently sampled noise, especially when marginal drift in repeated stochastic layers is harmful.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: By Law, Every Zero-Mean Risk Is the Difference of Two Equally Distributed Risks arXiv:2607.05460
Unverified 2026

Rough Multiplicative Random Features

Replace explicitly stored independent random positional features with deterministic multiplicative phase features generated from a small table of random phases indexed by primes. Restrict positions to integers whose prime factors exceed a slowly growing threshold, because the paper's central-limit result says periodic weighted sums over these rough integers recover Gaussian behavior despite strong multiplicative dependence.

Useful4/10
Difficulty5/10
Novelty9/10
Paper: Random Multiplicative Functions with Periodic Weights arXiv:2608.00184