Architecture ideas

Attention variants, state-space and recurrent cells, normalization and token-mixing schemes — each tested against the standard block it replaces.

✗ Mechanism failed 2026

Consensus-Corrected Topology-Invariant GNN

Replace ordinary topology-sensitive message passing with scalar-gated aggregation followed by an explicit correction that aligns local node states with a graph-wide consensus component. The correction should make node embeddings less sensitive to line or edge removals while preserving local information needed for prediction. This is suitable for graph neural networks and graph-based world models exposed to changing graph sizes or sparsity patterns.

Useful8/10
Difficulty5/10
Novelty7/10
Paper: UNION: A Unified AC-OPF Framework for Topology-Varying Real-Time Grid Operation arXiv:2608.25784
✗ Mechanism failed 2026

SU(d) Spectral Associative Memory

Replace vector-valued Hopfield neurons by SU(d)-valued latent states and construct Hebbian couplings from matrix memories. Recall is performed by iterating toward the dominant eigenmode of the induced lifted coupling operator, with each iterate projected back onto SU(d); the larger matrix representation should reduce random crosstalk and increase critical memory capacity.

Useful8/10
Difficulty7/10
Novelty8/10
Paper: High-Capacity Generalized Hopfield Networks arXiv:2608.08226
✗ Mechanism failed 2026

Matrix-Free Differentiable CBF Safety Layer

Attach a hard control-barrier-function quadratic-program safety filter to a neural policy, but solve the filter with operator splitting and differentiate through its fixed-point map using projection Jacobian-vector products. The network learns the nominal action and task objective end to end, while the deployed action remains the feasible filtered action rather than an unconstrained penalty-based approximation.

Useful8/10
Difficulty6/10
Novelty6/10
Paper: End-to-End Learning of Safe Optimal Feedback Control in High Dimensions with Control Barrier Function Layers arXiv:2607.20674
✗ Mechanism failed 2026

Floor-Aware Adaptive Block Drafting

Estimate the irreducible rejection caused by missing within-block information, then use it to choose the block's conditioning order instead of tuning block length blindly. If the estimated floor is high, expose one or more realized tokens before continuing; if the floor is low but observed rejection is high, spend compute on improving the drafter.

Useful8/10
Difficulty5/10
Novelty7/10
Paper: Beyond Parallel Blindness: Information Floors and Model Gaps in Block Drafting arXiv:2608.27339
✗ Mechanism failed 2026

Correlated Long-Range Residual Mixer

Replace an iid local or randomly sparse residual mixer with a distance-decaying long-range operator whose edge magnitudes are correlated through a shared latent Gaussian field. The paper predicts that these correlations qualitatively change low-energy spectral scaling and increase multiscale information propagation relative to iid long-range weights. Apply the operator as a spectrally normalized residual block so that the benefit comes from correlated scale coverage rather than uncontrolled…

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Effective Hamiltonian description on monitored Majorana chains: correlated power-law hoppings and unconventional entanglement scaling arXiv:2609.04091
✗ Mechanism failed 2026

Fractional-memory recurrent state

Construct an efficient recurrent or state-space layer whose impulse response follows Mittag-Leffler relaxation instead of a single exponential. A bank of stable diagonal state channels approximates the long power-law tail, allowing the layer to retain information over widely separated timescales with only \(K\) states per feature.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Anomalous diffusion memory factorization: Characteristic timescales and application to inverse problem arXiv:2608.21674
✗ Mechanism failed 2026

Pisot-Orbit Deterministic JL Layer

Replace a dense random projection used before retrieval, classification, or expert routing with a publicly reproducible matrix generated by a Pisot beta-transformation orbit. Search over a small public seed and sampling gap to select one matrix that preserves the calibration set's pairwise distances, then freeze it for training and inference. The projection removes random-matrix storage and makes the same embedding transform exactly reproducible across servers or proof systems.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Deterministic Johnson--Lindenstrauss Projections from Pisot $β$-Transformations for Zero-Knowledge Private Routing arXiv:2608.13078
✗ Mechanism failed 2026

FFT Weak-Residual Engine

Evaluate weak residuals against a bank of periodic trigonometric test functions using FFT projections instead of repeated pointwise quadrature or output automatic differentiation. Frequency truncation and mode weighting provide a direct way to control the spatial scales enforced during neural PDE training.

Useful7/10
Difficulty4/10
Novelty6/10
Paper: Efficient Weak-Entropy PINN for Solving Hyperbolic Conservation Laws arXiv:2608.10389
✗ Mechanism failed 2026

Signed-Distance Ambient FNO

Embed every variable-domain sample into one fixed ambient hyperrectangle and append its signed-distance function as an additional channel to the operator input. Deterministically extend fields outside the physical domain, resample them onto a shared latent grid, apply standard Fourier layers, then interpolate and mask the output on the requested target discretization. The network learns the operator rather than a separate geometry encoder, so the same weights can be used across shapes and mesh…

Useful7/10
Difficulty4/10
Novelty6/10
Paper: ADEx-FNO: A Unified Ambient-Domain Framework for Fourier Neural Operators on Varying Geometries arXiv:2608.08608
✗ Mechanism failed 2026

Dyadic Resolvent Filter Layer

Replace a single polynomial graph filter or dense inverse with a multiscale layer that applies unitary propagations at dyadic times and combines them according to the dyadic resolvent identity. For a symmetric graph operator, this implements a stable rational spectral filter that can selectively retain or suppress frequency bands while exposing logarithmic multiscale structure.

Useful7/10
Difficulty6/10
Novelty6/10
Paper: Dyadic Resolvent Representations of Self-Adjoint Operators: Propagator Expansions, Spectral Measures, and Zeta Functions arXiv:2607.21278
✗ Mechanism failed 2026

KS-Adaptive Graph Halting

Use the KS ratio to decide how many message-passing layers to execute per graph or per node, rather than selecting a fixed depth. In the subcritical regime, stop once the predicted remaining effect is below a tolerance; in the supercritical regime, continue until the observed logit change becomes small or a larger budget is reached.

Useful7/10
Difficulty5/10
Novelty5/10
Paper: The Value of Depth in Message Passing on Sparse Graphs: A Kesten-Stigum Dichotomy arXiv:2607.16676
✗ Mechanism failed 2026

Memory-Retaining RG Feature Blocks

Replace scale-blind pooling or downsampling with a coarse-graining block that carries an explicit relevant scale variable \(\eta\) alongside the feature field. The block is constrained to represent features in the memory-retaining form \(h(\xi,\eta)=\eta^{\alpha}F(\xi/\eta^{\beta})\), allowing both feature amplitude and profile shape to depend on the scale inherited from the input or previous RG step.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: Memory Retention and the Classification of Renormalization-Group Fixed Points in Self-Similar Dynamics arXiv:2607.14388
✗ Mechanism failed 2026

Zeta-Corrected Singular Integral Layer

Construct a periodic neural integral layer whose fixed singular kernel behaves like |y|^{-s} near the origin, but whose samples on the uniform grid are replaced on a small symmetric stencil by SinCoTrap correction weights. The correction cancels low-order Taylor errors caused by sampling the singularity, while all nonlocal grid points remain unchanged. Increasing the correction order from p=0 to p=1 or p=2 should reduce discretization error without increasing global grid resolution.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: SinCoTrap: A High-Order Locally Corrected Trapezoidal Rule for Periodic Singular Integrals in Arbitrary Dimensions arXiv:2607.12390
✗ Mechanism failed 2026

Critical power-law sparse attention

Replace dense self-attention by a sparse mask on a one-dimensional or ordered token geometry, retaining local neighbors and adding long-range edges with probability proportional to distance raised to \(-(1+\sigma)\). Use \(\sigma\approx0.8\text{--}0.85\) as the initial regime because the paper finds that this range supports delocalized, GOE-like connectivity despite sparse bonds. The resulting layer has linear or near-linear attention cost while maintaining long-range paths.

Useful7/10
Difficulty4/10
Novelty6/10
Paper: Emergent quantum chaos from correlations on a random graph arXiv:2607.11662
✗ Mechanism failed 2026

Dual-Residual Depth Refinement

Train a residual network on a coarse depth mesh, estimate a dual-weighted residual for every layer interval, and insert new layers at intervals with the largest estimated contribution to objective error. This replaces uniform depth expansion or expensive neural architecture search with targeted refinement driven by both forward-dynamics error and downstream loss sensitivity.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: An optimal control approach for neural network architecture adaptation with a posteriori error estimation arXiv:2607.07637
✗ Mechanism failed 2026

Exact Multi-Population Hyperplane Router

Replace a learned binary MoE gate with a hyperplane whose two sides contain prescribed proportions of several token populations simultaneously. In a low-dimensional routing projection, solve the cap-volume equations directly, producing deterministic per-population load control without an auxiliary load-balancing loss. Recursively applying the construction yields a balanced binary expert tree.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: From Ham-Sandwich to Centerpoints: Semialgebraic Algorithms for Cutting Polytopal Measures arXiv:2607.02400
✗ Mechanism failed 2026

Nonlinear Laplacian Equilibrium GNN Layer

Replace several fixed message-passing layers with an implicit graph layer whose state is the solution of a nonlinear flow equilibrium. Learn monotone edge laws from endpoint features, solve for node potentials with damped chord-Newton steps, and use the resulting edge flows or potentials as the layer output. Monotonicity and the Laplacian Jacobian provide a principled stability mechanism while retaining sparse graph computation.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: NLF: A Resistor-Network Framework and Linear-Time Solver for Convex Network-Flow Equilibria arXiv:2607.02041
✗ Mechanism failed 2026

Expander Tied Dictionary Bottleneck

Replace the dense decoder of an overcomplete activation autoencoder with a fixed left-d-regular expander mask and learn only the nonzero decoder values. Tie the encoder to the transpose of this sparse decoder, preserving the activation dimension m, latent width n, and TopK sparsity k while reducing learned dictionary parameters from mn to dn.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Expander Sparse Autoencoders: Parameter-Efficient Dictionaries for Mechanistic Interpretability arXiv:2607.01799
✗ Mechanism failed 2026

Subresonant Power-Law Memory Bank

Add a deterministic complex-valued state-space bank whose mode detunings become progressively smaller with mode index, Delta_n=c n^{-p}, while input couplings decay as B_n=b n^{-kappa}. For slowly varying or constant forcing, the summed state follows the paper's subresonant response and grows like t^{1-alpha}, providing controllable power-law memory with only O(N) recurrent state updates. This should improve long-context retention compared with a same-size unconstrained RNN or uniformly spaced…

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Small Denominators and Subresonant Accumulation in Weakly Nonlinear Dispersive Dynamics arXiv:2607.01447
✗ Mechanism failed 2026

Subcritical Ancestral Attention

Construct a sparse attention layer by sampling backward token histories as a continuous-time branching process rather than allowing every query to attend to every key. Each active ancestor either dies or branches into a bounded number of candidate ancestors, with branching probability controlled by a small parameter. The branch-out penalty predicts exponentially small probability of long, highly branching histories, providing a direct knob for receptive-field size and attention FLOPs.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Cutoff with an $O(1)$ window for Potts Glauber Dynamics on lattice at High Temperature arXiv:2608.26259
✗ Mechanism failed 2026

Long-Cycle Topological Graph Pooling

Construct a sparse radius graph over input samples or learned node embeddings, compute its cycle space, and remove the subspace generated by sufficiently short cycles. Feed the remaining quotient-cycle coordinates or Betti-rank estimate to a graph neural network as a global topological feature, or use them to guide pooling so that local redundant loops are collapsed while global loops are retained. The paper predicts that the threshold L approximately equal to |log r| graph hops is the critical…

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Detection of first homology via random geometric graphs in the thermodynamic regime arXiv:2608.25065
✗ Mechanism failed 2026

Canonical Tropical Segment State

Build a sequence or graph module whose state is a canonical set of affine tropical pieces rather than an opaque hidden vector. Compose consecutive segments by Minkowski addition of their lifted supports, merge alternatives by union followed by lower-hull reduction, and evaluate the resulting piecewise-linear function with a minimum.

Useful7/10
Difficulty7/10
Novelty8/10
Paper: On the Representational Geometry of Dynamic Programs arXiv:2608.25034
✗ Mechanism failed 2026

Samplet-compressed kernel interaction layer

Replace a dense coordinate-kernel interaction among N points by an orthogonal samplet transform with a sparse detail-detail matrix and a small polynomial branch. Detail basis vectors have vanishing moments, so smooth low-frequency behavior is represented by a few polynomial coefficients while localized residual interactions become sparse in the transformed domain.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Samplet compression for conditionally positive definite kernels and universal Kriging arXiv:2608.24283
✗ Mechanism failed 2026

Tree-Structured Exact Expert Router

Replace independent top-k expert selection with a decision-diagram router that optimizes a quadratic surrogate over binary expert activations and continuous assignment weights. When expert redundancy or communication costs form a tree, partial routing decisions are merged whenever they have the same separator state, turning exponentially many candidate masks into a dynamic program over a small number of graph cuts.

Useful7/10
Difficulty7/10
Novelty8/10
Paper: Convexification of mixed-integer quadratic optimization via decision diagrams arXiv:2608.22815