Architecture ideas

Attention variants, state-space and recurrent cells, normalization and token-mixing schemes — each tested against the standard block it replaces.

△ Mechanism confirmed, baseline not beaten 2026

Tail-Aware Verifier Portfolio

Use the paper's tail comparison to decide when another call from the same verifier family is useless and when to switch to a different model, modality, or evidence source. The objective is to reduce the high-alpha survivor population—the incorrect examples that consistently fool one verifier—rather than maximizing average one-shot verifier accuracy.

Useful8/10
Difficulty5/10
Novelty7/10
Paper: Partially Correlated Verifier Cascades in LLM Harnesses: Concave Log-Odds, Polynomial Reliability, and Blind-Spot Ceilings arXiv:2607.13918
✗ Failed on benchmark 2026

Small-gain certified modular network

Partition a neural network into independently trained or independently monitored modules and constrain their cross-module interaction gain using a compositional contraction certificate. This enables stable deep modular MLPs, graph blocks, or recurrent modules without estimating the full network Jacobian, while providing an explicit coupling threshold for when the architecture loses contraction.

Useful8/10
Difficulty6/10
Novelty7/10
Paper: Contraction Certification from Streaming Data: Wasserstein Robustness and Compositional Stability for Interconnected Nonlinear System arXiv:2607.11982
△ Mechanism confirmed, baseline not beaten 2026

Monotone Compositional Reachability Critic

Train separate neural value functions for primitive reachability, avoidance, or target-reaching tasks, then combine them with a coordinatewise monotone aggregator whose derivatives with respect to all primitive values are nonnegative. This transfers the paper's exact two-player decomposition condition into a modular critic architecture: adding a new target changes only one primitive critic and the aggregator, rather than requiring a new high-dimensional value function.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Exact Decomposition of Value Functions for Two-Player Games in Hamilton-Jacobi Reachability arXiv:2608.27654
✓✓ Beats tuned baseline 2026

Two-Channel Fractal Renormalization Network

Replace ordinary depth-wise feature propagation by a ternary hierarchical block that recursively aggregates three child representations while maintaining separate neutral and defect channels. The block is initialized from the Sierpinski six-vertex recursion, then optionally learns a bounded correction. The neutral channel preserves the paper's cubic mixing law, while the defect channel provides a controlled route for long-range and nonlocal interactions.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Fractal deconfinement and confinement in Sierpinski ice arXiv:2608.02741
△ Mechanism confirmed, baseline not beaten 2026

Shell-Wise Balanced MoE Routing

Replace a soft auxiliary load-balancing loss with a deterministic router correction that balances expert assignments separately within confidence or score shells. The correction preserves the number of tokens assigned to each shell while making every expert receive equal or nearly equal mass inside each shell, preventing high-confidence tokens from monopolizing a subset of experts.

Useful7/10
Difficulty5/10
Novelty5/10
Paper: Optimal Dynamic Cooling of Multiple Qubits arXiv:2607.23641
✓✓ Beats tuned baseline 2026

Gauge-Patched Local Experts

Represent hidden features with several local orthogonal or unitary frames, and let group-valued transition maps align neighboring experts. Instead of forcing every expert to learn a globally coherent coordinate system, train local experts independently and impose a patching constraint that produces a globally consistent feature field. This is especially suitable for graph neural networks on data with heterogeneous local geometries or mixture-of-experts models whose experts specialize by region.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: A PDE approach to the 2D Yang-Mills measure arXiv:2607.22236
✗ Mechanism failed 2026

Dyadic Resolvent Filter Layer

Replace a single polynomial graph filter or dense inverse with a multiscale layer that applies unitary propagations at dyadic times and combines them according to the dyadic resolvent identity. For a symmetric graph operator, this implements a stable rational spectral filter that can selectively retain or suppress frequency bands while exposing logarithmic multiscale structure.

Useful7/10
Difficulty6/10
Novelty6/10
Paper: Dyadic Resolvent Representations of Self-Adjoint Operators: Propagator Expansions, Spectral Measures, and Zeta Functions arXiv:2607.21278
△ Mechanism confirmed, baseline not beaten 2026

Noise-Triggered Latent Rank Adaptation

Use the recursive errors-in-variables subspace spectrum as a controller for the width of a latent SSM rather than fixing the state dimension in advance. Neurons or state channels are added when corrected covariance eigenvalues rise above the noise floor and pruned when they remain below it, producing a model-order-adaptive recurrent architecture for nonstationary streams.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: A recursive subspace based method for errors-in-variables model identification of time-varying systems arXiv:2607.17065
△ Mechanism confirmed, baseline not beaten 2026

Gain-Weighted Cluster Co-Design

Use small-gain diagnostics to jointly learn module normalization and a communication partition rather than imposing a fixed global spectral constraint. Clusters should be formed around high-gain feedback loops, because grouping weakly related modules cannot improve the certificate and only adds bookkeeping.

Useful7/10
Difficulty7/10
Novelty7/10
Paper: Cluster-Based Distributed Small-Signal Stability Certificates for Grid-Forming Inverter Networks arXiv:2607.16985
✓✓ Beats tuned baseline 2026

Newton-Polytope Convex Network

Build a positively homogeneous convex network by representing every intermediate unit as a compact polytope and composing units with Minkowski sums, convex-hull unions, and positive dilations. This gives an explicitly convex and monotone architecture whose geometric complexity can be controlled independently of the number of sampled linear pieces, potentially producing smaller ICNNs for structured convex functions.

Useful7/10
Difficulty7/10
Novelty7/10
Paper: Tropical Circuits with Scalar Multiplication Gates arXiv:2607.11540
△ Mechanism confirmed, baseline not beaten 2026

Directional Vertex Polytope Decoder

Represent a predicted convex object by one point per prescribed unit direction and decode it as the convex hull of those points. Enforce direction-wise maximizer inequalities so every point is a genuine vertex, then use the covering-radius bound to choose the number and placement of directions according to the desired geometric accuracy.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Galerkin approximations to the space of convex bodies by polytopes in nondegenerate V-representation arXiv:2608.26615
✗ Mechanism failed 2026

Long-Cycle Topological Graph Pooling

Construct a sparse radius graph over input samples or learned node embeddings, compute its cycle space, and remove the subspace generated by sufficiently short cycles. Feed the remaining quotient-cycle coordinates or Betti-rank estimate to a graph neural network as a global topological feature, or use them to guide pooling so that local redundant loops are collapsed while global loops are retained. The paper predicts that the threshold L approximately equal to |log r| graph hops is the critical…

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Detection of first homology via random geometric graphs in the thermodynamic regime arXiv:2608.25065
Unverified 2026

Weighted Tree Dirichlet-to-Neumann Layer

Replace dense long-range token interactions with sparse message passing on a balanced hierarchical tree. Boundary token features are extended to internal tree nodes by weighted harmonic relaxation, and the resulting weighted normal derivative is used as a learned multiscale interaction or regularization signal.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Extension Problems for the Vladimirov--Taibleson Operator and the Hierarchical Laplacian arXiv:2609.03647
Unverified 2026

Minor-preserving complex network layer

Parameterize a complex linear layer as a product of sparse triangular network factors whose positive modulus version is totally nonnegative. The layer can use phase cancellation for expressive transformations, while selected minors remain bounded by explicitly computable positive minors, giving a structured alternative to unconstrained dense complex weights.

Useful6/10
Difficulty6/10
Novelty7/10
Paper: Entropy and domination for quasi-Hitchin representations arXiv:2608.27939
Unverified 2026

Energy-Preserving Hill Packet Layer

Augment a neural field or neural operator with a bank of localized, divergence-free moving packets whose radius and amplitude follow the Hill scaling rather than ordinary Gaussian scaling. The packet coefficients can represent unresolved flow corrections while keeping their L^2 contribution approximately invariant under refinement, preventing fine-scale features from becoming numerically negligible or explosively large.

Useful6/10
Difficulty5/10
Novelty8/10
Paper: Flexibility for the Three-Dimensional Navier-Stokes Equations via Moving Hill Vortices arXiv:2608.20068
Unverified 2026

Layered simplex sparse router

Replace an MoE router's single softmax distribution with a normalized coordinate-wise product of several simplex-valued routing factors. The product preserves positivity and normalization but, as depth grows, concentrates mass on a small subset of experts, creating a mathematically controlled heavy-tailed routing prior rather than relying only on an auxiliary load-balancing loss.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: A Layered Simplex Architecture for Large Alphabets arXiv:2608.19908
Unverified 2026

Free-semigroup Toeplitz layer

Represent hierarchical or tree-structured hidden states on words over d symbols and replace a dense mixing layer by a noncommutative Toeplitz operator composed of shared word shifts. Coefficients are reused at every tree location, so the parameter count depends on maximum interaction depth rather than the number of nodes; an optional spectral penalty controls the amplification profile of finite-depth truncations.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Limiting eigenvalue distribution and entropy of multi-Toeplitz matrices arXiv:2608.17859
Unverified 2026

Hardy–Szegő Repulsive Token Router

Replace independent top-k token selection by a quality-weighted determinantal subset objective based on the Hardy–Szegő kernel. Tokens with high learned quality are preferred, but geometrically redundant tokens have a small determinant contribution, encouraging diverse sets of routed experts, retrieved items, or attended context tokens.

Useful6/10
Difficulty6/10
Novelty5/10
Paper: Hardy-Szegő Point Processes: Large Deviations and Strong Szegő Asymptotics arXiv:2608.17509
Unverified 2026

Quadratic-budget Toeplitz long-range layer

Replace a dense translation-invariant interaction matrix with a positive-definite Toeplitz kernel K_n(e^f) whose log-spectrum is parameterized by a small number of Fourier coefficients with 1/|k| decay. Use the paper's explicit quadratic term as a spectral-volume budget, allowing long-range structure while discouraging uncontrolled determinant growth and ill-conditioning. Subtracting this term from a log-determinant regularizer leaves a residual intended to capture higher-order deviations from…

Useful6/10
Difficulty6/10
Novelty7/10
Paper: On Toeplitz determinants with slow Fourier decay arXiv:2608.13182
Unverified 2026

Cactus-Graph Phase Budgeting

Build neural computation graphs with explicitly phase-budgeted serial and parallel branches, treating serial compositions as SRG products and parallel residual branches as SRG sums. Allocate phase centers theta_i so that every loop or branch aggregate stays away from -1, enabling stability-aware architecture search and constructive control of branch gains.

Useful6/10
Difficulty7/10
Novelty8/10
Paper: The $θ$-Symmetric SRG with Applications to Stability of Cactus Dynamic Networks arXiv:2608.12591
Unverified 2026

Primitive-Fock Interaction Layer

Replace an unconstrained q-way polynomial or tensorized feature layer with separate decomposable and primitive interaction channels. The decomposable channel models interactions explainable as products of lower physical-weight feature blocks, while the primitive channel captures residual factors that cannot be represented by those products. This should reduce redundant high-order parameters and provide a controllable inductive bias for compositional or disentangled representations.

Useful6/10
Difficulty6/10
Novelty7/10
Paper: Weak Limits of Wiener Chaos: Primitive-Fock Classification and Hilbert-Stein Extraction arXiv:2608.12492
Unverified 2026

Smith-Reduced Chain Encoder

Replace an ordinary hierarchical graph encoder with a finite chain-complex encoder whose learned boundary maps satisfy \(\partial_{k-1}\partial_k=0\). Compute Smith normal form on the integer incidence matrices and treat unit-labelled cell pairs as refinement overhead: cancel or gate those pairs before message passing, while preserving non-unit labels that encode genuinely nontrivial structure. The resulting representation should be insensitive to arbitrary cell subdivision while retaining…

Useful6/10
Difficulty6/10
Novelty6/10
Paper: A Chain- and Diagram-Level Semantics for Morphological Calculus Refinement, monodromy, and bivector orbit decompositions arXiv:2608.11325
Unverified 2026

Single-Node Observable Leaky-RNN

Construct a sparse recurrent network with positive edge weights and Leaky-ReLU updates so that one selected hidden node, observed over a finite time window, contains enough information to reconstruct the full hidden state. Add an auxiliary decoder from the observed trajectory to the initial state or current state, and use graph rewiring or edge-growth until every hidden node has a directed path to the sensor within the observation horizon.

Useful6/10
Difficulty5/10
Novelty8/10
Paper: On the Observability and Controllability of Leaky-ReLU Networks arXiv:2608.09059
Unverified 2026

Granularity-Aware Feasible Routing

Replace a continuous allocation or routing decision with a lattice-valued decision whose unit size is explicitly normalized by total capacity. Round allocations downward rather than to the nearest lattice point, preserving per-example capacity feasibility, and train or evaluate against the resulting granularity ratio rather than treating discretization as an implementation detail.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Bid Lattices and the Value of Flexibility:A Granularity Ratio for Capacity Markets arXiv:2608.08371