Architecture ideas

Attention variants, state-space and recurrent cells, normalization and token-mixing schemes — each tested against the standard block it replaces.

Unverified 2026

Flow-Constrained Hierarchical Policy

Parameterize a tree-structured policy through realization weights satisfying sequence-form flow conservation, instead of independently predicting probabilities at every node. Conditional action probabilities are recovered by dividing a child sequence weight by its parent weight, guaranteeing globally consistent probabilities and avoiding invalid or contradictory branch masses. This is suitable for hierarchical RL policies, adaptive computation trees, and neural routers with sequential gating…

Useful5/10
Difficulty4/10
Novelty6/10
Paper: Baseball, An Extensive-Form Game-Theoretic Duel arXiv:2607.29041
Unverified 2026

Covariance-complement uncertainty head

Represent uncertainty of a graph-structured neural feature field through dual covariance rather than explicitly storing a dense primal covariance. Recover calibrated primal marginal variances from dual statistics using the paper's covariance-complement identity.

Useful5/10
Difficulty4/10
Novelty8/10
Paper: Accelerated Random-Sweep Gibbs Sampling for Gaussian Graphical Models via Dual Normal Factor Graphs arXiv:2607.28706
Unverified 2026

Twisted-Shift Feature Mixer

Build a neural feature-mixing layer from a truncated shift S and a diagonal phase operator T satisfying TS=qST, with |q|=1. The relation forces moving one position in the graded feature basis to multiply the phase operator by q, providing a compact inductive bias for periodic, phase-sensitive, or cyclic data.

Useful5/10
Difficulty4/10
Novelty7/10
Paper: On the diversity of twisted commuting operators arXiv:2607.28372
Unverified 2026

Coset-aware MoE routing repair

Add an integer-lattice feasibility layer after ordinary top-1 or top-2 MoE routing. The router first produces its usual expert assignments, then minimally changes a small number of low-confidence assignments so the batch count vector lies in a prescribed lattice or desired coset, eliminating persistent modular load imbalance that ordinary auxiliary losses may not detect.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: On the number of factorable induced subgraphs arXiv:2607.27870
Unverified 2026

q-Boson Spectral Initialization

Initialize a neural layer with singular values taken from the finite spectral measure of the paper's q-boson Jacobi operator instead of using Xavier or ordinary orthogonal initialization. The resulting layer has a deliberately shaped singular-value distribution and an explicit finite-size spectral edge, allowing initialization to target stable signal propagation while retaining spectral diversity.

Useful5/10
Difficulty4/10
Novelty7/10
Paper: Sharp Bounds on Ground State Energy of the SYK Model arXiv:2607.27185
Unverified 2026

Dispersive Analytic Smoothing Block

Insert a short gKdV-inspired spectral flow between neural blocks to regularize rough feature maps without using an isotropic low-pass filter. The module applies a Fourier dispersive phase and derivative-coupled polynomial residual updates, with an optional finite factorial dilation penalty to encourage analytic-looking features.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Instantaneous analytic smoothing of rough data for the modified and cubic gKdV equations arXiv:2607.27115
Unverified 2026

Gradient-Commutator Neural Dynamics

Build a continuous-time neural dynamics module from scalar potential networks and their iterated Lie brackets instead of directly predicting an unrestricted vector field. Gradient primitives provide structured vector fields, while commutators add non-conservative and rotational directions; the paper proves that finite spans of such objects generate every smooth vector field on the stated compact manifold.

Useful5/10
Difficulty6/10
Novelty8/10
Paper: The Lie algebra generated by gradient vector fields arXiv:2607.26890
Unverified 2026

Commutator-flow latent block

Represent each token or graph node by an anti-Hermitian matrix latent state and replace a standard residual transformation with a discretized Lie-algebra vortex flow. The commutator nonlinearities are equivariant under global unitary conjugation, so the block can learn interactions without selecting a basis and preserves the anti-Hermitian state space when initialized there.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Vortex Filaments in Hermitian Reductive Lie Algebras arXiv:2607.26650
Unverified 2026

Noise-crossing band-pass neuron

Replace selected ReLU or sigmoid units with a stochastic binary crossing activation that fires only when exactly one of two independent noise thresholds is crossed. The resulting expected activation is low for inputs far below or far above the noise distribution and maximal near its median, creating an analytically controlled band-pass and potentially reducing saturation-driven instability.

Useful5/10
Difficulty4/10
Novelty6/10
Paper: Reconstructing Backpropagation from Forward Fluctuations in Noise-modulated Neural Networks arXiv:2607.26483
Unverified 2026

Complex-stretched resonance layer

Insert a fixed or learnable complex coordinate stretch outside the region where a neural operator models the physical interaction, so outgoing waves are damped and resonant states become ordinary discrete eigenmodes on a finite grid. Train the network with eigenvalue or resolvent losses computed after the stretch, while preserving the physical field in the interior region.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Dirac resonances as non-self-adjoint eigenvalues arXiv:2607.26166
Unverified 2026

Cyclic Power-Consistent Replica Block

Construct p shared neural replicas of the same token or feature set, quotient their outputs by the cyclic group C_p, and train a power head to agree with the representation obtained from a jointly processed p-fold input. Add a filtration score whose value is nondecreasing under the power map and strictly increases on deliberately nontrivial replica combinations. The experiment tests whether this algebraically structured consistency signal is better than ordinary pairwise augmentation…

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Quantum Steenrod powers and Hamiltonian maps arXiv:2607.25960
Unverified 2026

Derangetropy Rank Warp

Insert a distribution-free rank warp before selected MLP or attention projections. For each scalar activation, replace its empirical rank u by the cumulative interval map induced by the Type-III derangetropy kernel, optionally followed by Gaussian or affine output calibration. The transform is invariant to strictly increasing reparameterizations of the feature and contracts the marginal toward central ranks, potentially reducing sensitivity to heavy tails and outliers.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Derangetropy Operators arXiv:2607.24705
Unverified 2026

Central-Moment Feature Mixer

Replace raw polynomial interactions between neighboring feature vectors with central polynomial interactions computed after subtracting the local feature mean. Keep separate second-, third-, and fourth-order channels and apply independent residual gates to them, so a uniform shift of every feature in a neighborhood cannot create artificial cross-order responses. This is a drop-in higher-order mixer for a small transformer or graph neural network.

Useful5/10
Difficulty5/10
Novelty6/10
Paper: Central-Hermite Sensing and Collision for Frame-Robust Order-Resolved Relaxation on D3Q125 arXiv:2607.23629
Unverified 2026

Metric-magnitude pooling

Replace mean or max pooling over a set of learned element embeddings with pooling based on the metric-magnitude weighting. Pairwise distances create a globally coupled correction for redundancy, so geometrically isolated or boundary elements can contribute differently from dense clusters of nearly duplicate elements.

Useful5/10
Difficulty5/10
Novelty8/10
Paper: Scalably computing metric magnitude arXiv:2607.23354
Unverified 2026

Correlation-Length Scaling Benchmark

Treat the maximum dependency distance faithfully modeled by a finite neural architecture as an emergent correlation length, and estimate how it grows with depth, state size, or attention span. Fit the exponent \(\kappa\) and use it as an architecture-selection signal: a model with larger \(\kappa\) should acquire long-range competence more efficiently at equal parameter or FLOP budget.

Useful5/10
Difficulty3/10
Novelty6/10
Paper: Universal scaling framework for parameterized quantum evolutions at criticality arXiv:2607.22863
Unverified 2026

Orthogonal symmetric pair embedding

For every unordered pair of scalar features, construct invariant coordinates from the elementary symmetric quantities s=x+y and q=xy, then feed a truncated orthogonalized polynomial basis in (s,q) to the neural network. Estimate the basis by weighted Gram-Schmidt or Cholesky whitening under the paper's triangle weight, so polynomial channels have low redundancy and controlled scale instead of requiring an unconstrained MLP to learn both symmetry and decorrelation.

Useful5/10
Difficulty3/10
Novelty7/10
Paper: Symmetric Jacobi Polynomials on a Triangle and Their Spectral Algebra arXiv:2607.22751
Unverified 2026

Flux-Balanced Local-Nonlocal Neural Layer

Partition a sequence, image, or graph into regions processed by a cheap local operator and a more expressive nonlocal operator, then couple their boundary activations with a shared continuity equation and a conservative interface-flux equation. The interface correction prevents the local and global branches from creating discontinuities or duplicated information, allowing nonlocal computation to be restricted to selected regions while preserving global consistency.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Coupling of Local and Nonlocal Problems Using Local Boundary Conditions arXiv:2607.22672
Unverified 2026

Rank-Two Motif Spectral Architecture Library

Use the paper's three rank-two graph families as a small, analytically understood library of propagation topologies. Select or mix figure-eight, theta, and dumbbell edge-routing motifs to obtain different effective receptive-field growth rates while retaining an exact spectral-radius target for normalization and architecture search.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Critical-exponent spectra and rank two inverse realization on biregular trees arXiv:2607.21294
Unverified 2026

Log-Finite-Part Polynomial Interaction Kernel

Replace a singular inverse interaction kernel by the finite part of its meromorphic continuation at an exceptional dimension, producing an explicit polynomial-times-logarithm feature interaction. This gives a controlled alternative to adding an arbitrary ridge term when a learned polynomial Gram matrix becomes rank-deficient.

Useful5/10
Difficulty5/10
Novelty8/10
Paper: Exceptional supersphere integration and logarithmic Pizzetti kernels arXiv:2607.21241
Unverified 2026

Reach-Calibrated Topology Tokens

Add a finite-resolution geometric code to a 3D neural encoder: quantized lattice occupancy, local barycenters, and tangent directions are converted into structural tokens alongside ordinary point or mesh features. Choose lattice spacing from estimated local reach so that small perturbations do not change the code, and train the continuous encoder to agree with this discrete structural representation.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: A Geometric Finiteness Theory for Essential Surfaces in Knot Exteriors arXiv:2607.20844
Unverified 2026

Signed Partition-Path Attention

Replace one dense attention layer with a sparse hierarchical attention module whose states are clusters of tokens and whose transitions merge two clusters or reverse a previous merge. Enforce the flag-space cancellation law on pairs of alternative two-step merge paths, so redundant hierarchical routes destructively interfere instead of producing duplicated features. Normalize merge-then-unmerge loops using the product of the sizes of the merged clusters, preventing large clusters from…

Useful5/10
Difficulty7/10
Novelty8/10
Paper: Flag Space, Matroidal Schur Algebras and the Steinberg Representation arXiv:2607.20779
Unverified 2026

Web-Constrained Product Flow

Add an invertible two-dimensional flow block whose Jacobian and coordinate outputs are explicitly regularized to preserve independence of several prescribed product distributions. Instead of estimating independence only from samples, enforce the change-of-variables functional equation for multiple density probes, encouraging the learned map to belong to a low-dimensional family of independence-preserving transformations.

Useful5/10
Difficulty6/10
Novelty6/10
Paper: The Independence-Preserving Property and Planar Web Geometry arXiv:2607.20646
Unverified 2026

Polynomial Spectral Mode Controller

Replace an eigendecomposition-based spectral controller in a small recurrent or state-space transition layer with explicit polynomial projectors. Each hidden state is split into invariant modes, and each mode receives a separately constrained recurrent multiplier, enabling direct suppression of unstable modes or selective retention of long-memory modes using only matrix-polynomial evaluations.

Useful5/10
Difficulty6/10
Novelty6/10
Paper: A Direct Polynomial Approach to Spectral Decomposition arXiv:2607.20218
Unverified 2026

Positive Grassmannian subset head

Replace independent logits for all d-subsets with a neural head that outputs a d-by-n matrix A and assigns subset weight x_I=det(A_{:,I}). After normalization, these minors define a probability distribution over subsets. The head imposes a strong algebraic coupling between subset probabilities, reducing parameters and potentially improving extrapolation to rarely observed subsets.

Useful5/10
Difficulty6/10
Novelty6/10
Paper: Maximum Likelihood Estimation on the Grassmannian of Lines arXiv:2607.19593