Architecture ideas

Attention variants, state-space and recurrent cells, normalization and token-mixing schemes — each tested against the standard block it replaces.

Unverified 2026

Dispersive Analytic Smoothing Block

Insert a short gKdV-inspired spectral flow between neural blocks to regularize rough feature maps without using an isotropic low-pass filter. The module applies a Fourier dispersive phase and derivative-coupled polynomial residual updates, with an optional finite factorial dilation penalty to encourage analytic-looking features.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Instantaneous analytic smoothing of rough data for the modified and cubic gKdV equations arXiv:2607.27115
Unverified 2026

Gradient-Commutator Neural Dynamics

Build a continuous-time neural dynamics module from scalar potential networks and their iterated Lie brackets instead of directly predicting an unrestricted vector field. Gradient primitives provide structured vector fields, while commutators add non-conservative and rotational directions; the paper proves that finite spans of such objects generate every smooth vector field on the stated compact manifold.

Useful5/10
Difficulty6/10
Novelty8/10
Paper: The Lie algebra generated by gradient vector fields arXiv:2607.26890
Unverified 2026

Commutator-flow latent block

Represent each token or graph node by an anti-Hermitian matrix latent state and replace a standard residual transformation with a discretized Lie-algebra vortex flow. The commutator nonlinearities are equivariant under global unitary conjugation, so the block can learn interactions without selecting a basis and preserves the anti-Hermitian state space when initialized there.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Vortex Filaments in Hermitian Reductive Lie Algebras arXiv:2607.26650
Unverified 2026

Pyramid-Coupled Multiscale Representations

Construct a nested sequence of representations in which each coarser representation is obtained from the previous one by a 1-Lipschitz projection. Train prediction heads at multiple scales so coarse predictions remain stable and approximately recoverable from the finer representation, enabling early exit, token pooling, and controlled multiresolution inference.

Useful5/10
Difficulty6/10
Novelty6/10
Paper: Pyramids and Extended Metric Measure Spaces arXiv:2607.26626
Unverified 2026

Noise-crossing band-pass neuron

Replace selected ReLU or sigmoid units with a stochastic binary crossing activation that fires only when exactly one of two independent noise thresholds is crossed. The resulting expected activation is low for inputs far below or far above the noise distribution and maximal near its median, creating an analytically controlled band-pass and potentially reducing saturation-driven instability.

Useful5/10
Difficulty4/10
Novelty6/10
Paper: Reconstructing Backpropagation from Forward Fluctuations in Noise-modulated Neural Networks arXiv:2607.26483
Unverified 2026

Complex-stretched resonance layer

Insert a fixed or learnable complex coordinate stretch outside the region where a neural operator models the physical interaction, so outgoing waves are damped and resonant states become ordinary discrete eigenmodes on a finite grid. Train the network with eigenvalue or resolvent losses computed after the stretch, while preserving the physical field in the interior region.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Dirac resonances as non-self-adjoint eigenvalues arXiv:2607.26166
Unverified 2026

Cyclic Power-Consistent Replica Block

Construct p shared neural replicas of the same token or feature set, quotient their outputs by the cyclic group C_p, and train a power head to agree with the representation obtained from a jointly processed p-fold input. Add a filtration score whose value is nondecreasing under the power map and strictly increases on deliberately nontrivial replica combinations. The experiment tests whether this algebraically structured consistency signal is better than ordinary pairwise augmentation…

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Quantum Steenrod powers and Hamiltonian maps arXiv:2607.25960
Unverified 2026

Antichain Multiscale Attention Windows

Replace an unrestricted collection of nested dyadic attention windows on a 2D token grid by a sparse antichain: no selected window may contain another selected window. Use the paper's exponential occupancy guarantee to control how many attention blocks reuse the same token, and add a differentiable log-moment penalty during training when exact antichain selection is relaxed. The expected benefit is bounded peak KV reuse and more predictable sparse-attention cost without discarding multiscale…

Useful5/10
Difficulty5/10
Novelty7/10
Paper: An antichain approach to a conjecture of Zygmund arXiv:2607.25957
Unverified 2026

Derangetropy Rank Warp

Insert a distribution-free rank warp before selected MLP or attention projections. For each scalar activation, replace its empirical rank u by the cumulative interval map induced by the Type-III derangetropy kernel, optionally followed by Gaussian or affine output calibration. The transform is invariant to strictly increasing reparameterizations of the feature and contracts the marginal toward central ranks, potentially reducing sensitivity to heavy tails and outliers.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Derangetropy Operators arXiv:2607.24705
Unverified 2026

Central-Moment Feature Mixer

Replace raw polynomial interactions between neighboring feature vectors with central polynomial interactions computed after subtracting the local feature mean. Keep separate second-, third-, and fourth-order channels and apply independent residual gates to them, so a uniform shift of every feature in a neighborhood cannot create artificial cross-order responses. This is a drop-in higher-order mixer for a small transformer or graph neural network.

Useful5/10
Difficulty5/10
Novelty6/10
Paper: Central-Hermite Sensing and Collision for Frame-Robust Order-Resolved Relaxation on D3Q125 arXiv:2607.23629
Unverified 2026

Orthogonal symmetric pair embedding

For every unordered pair of scalar features, construct invariant coordinates from the elementary symmetric quantities s=x+y and q=xy, then feed a truncated orthogonalized polynomial basis in (s,q) to the neural network. Estimate the basis by weighted Gram-Schmidt or Cholesky whitening under the paper's triangle weight, so polynomial channels have low redundancy and controlled scale instead of requiring an unconstrained MLP to learn both symmetry and decorrelation.

Useful5/10
Difficulty3/10
Novelty7/10
Paper: Symmetric Jacobi Polynomials on a Triangle and Their Spectral Algebra arXiv:2607.22751
Unverified 2026

Flux-Balanced Local-Nonlocal Neural Layer

Partition a sequence, image, or graph into regions processed by a cheap local operator and a more expressive nonlocal operator, then couple their boundary activations with a shared continuity equation and a conservative interface-flux equation. The interface correction prevents the local and global branches from creating discontinuities or duplicated information, allowing nonlocal computation to be restricted to selected regions while preserving global consistency.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Coupling of Local and Nonlocal Problems Using Local Boundary Conditions arXiv:2607.22672
Unverified 2026

Rank-Two Motif Spectral Architecture Library

Use the paper's three rank-two graph families as a small, analytically understood library of propagation topologies. Select or mix figure-eight, theta, and dumbbell edge-routing motifs to obtain different effective receptive-field growth rates while retaining an exact spectral-radius target for normalization and architecture search.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Critical-exponent spectra and rank two inverse realization on biregular trees arXiv:2607.21294
Unverified 2026

Log-Finite-Part Polynomial Interaction Kernel

Replace a singular inverse interaction kernel by the finite part of its meromorphic continuation at an exceptional dimension, producing an explicit polynomial-times-logarithm feature interaction. This gives a controlled alternative to adding an arbitrary ridge term when a learned polynomial Gram matrix becomes rank-deficient.

Useful5/10
Difficulty5/10
Novelty8/10
Paper: Exceptional supersphere integration and logarithmic Pizzetti kernels arXiv:2607.21241
Unverified 2026

Constant-gap brickwork unitary initialization

Initialize a unitary feature-mixing layer with a shallow brickwork circuit of independent random SU(4) gates instead of sampling or factorizing a dense Haar-random unitary. Stack enough layers to obtain a target contraction of non-Haar components, using the paper's constant spectral-gap principle to make the required depth essentially independent of the number of qubits. The resulting layer is local, parameter-efficient, exactly norm-preserving, and should provide Haar-like scrambling at…

Useful5/10
Difficulty5/10
Novelty6/10
Paper: Random unitary circuits with constant spectral gap arXiv:2607.20919
Unverified 2026

Reach-Calibrated Topology Tokens

Add a finite-resolution geometric code to a 3D neural encoder: quantized lattice occupancy, local barycenters, and tangent directions are converted into structural tokens alongside ordinary point or mesh features. Choose lattice spacing from estimated local reach so that small perturbations do not change the code, and train the continuous encoder to agree with this discrete structural representation.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: A Geometric Finiteness Theory for Essential Surfaces in Knot Exteriors arXiv:2607.20844
Unverified 2026

Signed Partition-Path Attention

Replace one dense attention layer with a sparse hierarchical attention module whose states are clusters of tokens and whose transitions merge two clusters or reverse a previous merge. Enforce the flag-space cancellation law on pairs of alternative two-step merge paths, so redundant hierarchical routes destructively interfere instead of producing duplicated features. Normalize merge-then-unmerge loops using the product of the sizes of the merged clusters, preventing large clusters from…

Useful5/10
Difficulty7/10
Novelty8/10
Paper: Flag Space, Matroidal Schur Algebras and the Steinberg Representation arXiv:2607.20779
Unverified 2026

Web-Constrained Product Flow

Add an invertible two-dimensional flow block whose Jacobian and coordinate outputs are explicitly regularized to preserve independence of several prescribed product distributions. Instead of estimating independence only from samples, enforce the change-of-variables functional equation for multiple density probes, encouraging the learned map to belong to a low-dimensional family of independence-preserving transformations.

Useful5/10
Difficulty6/10
Novelty6/10
Paper: The Independence-Preserving Property and Planar Web Geometry arXiv:2607.20646
Unverified 2026

Polynomial Spectral Mode Controller

Replace an eigendecomposition-based spectral controller in a small recurrent or state-space transition layer with explicit polynomial projectors. Each hidden state is split into invariant modes, and each mode receives a separately constrained recurrent multiplier, enabling direct suppression of unstable modes or selective retention of long-memory modes using only matrix-polynomial evaluations.

Useful5/10
Difficulty6/10
Novelty6/10
Paper: A Direct Polynomial Approach to Spectral Decomposition arXiv:2607.20218
Unverified 2026

Yang–Baxter Pairwise Router

Replace unconstrained pairwise token-routing interactions with a structured two-token router derived from an involutive set-theoretical Yang–Baxter solution. The pair operator is a convex interpolation between identity and a permutation of discrete routing states, so it cannot amplify probability mass or logits when applied to routing distributions. The Yang–Baxter relation provides a falsifiable test for whether three-token routing updates are insensitive to the two admissible…

Useful5/10
Difficulty6/10
Novelty8/10
Paper: Integrable multi-species SSEP with reactive particle species arXiv:2607.18959
Unverified 2026

High-Degree Jordan Anchor

Preprocess a noisy input graph into a high-degree core and compute a Jordan-center anchor in that core. Feed each node its distance to the anchor, and optionally use the anchor to bias graph-transformer attention; the hypothesis is that this suppresses spurious low-degree noise and gives the network a stable global coordinate system.

Useful5/10
Difficulty4/10
Novelty6/10
Paper: Finding Adam in noisy trees arXiv:2607.18201
Unverified 2026

Centrally Extended Fourier Mode Mixer

Construct a neural mixing layer on Fourier or positional modes using a small set of exponentiated Virasoro generators instead of a dense mode-to-mode matrix. The generator coefficients are shared across all inputs, while the Lie bracket fixes how different mode shifts interact; an optional central channel captures the special coupling between modes whose indices sum to zero.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: On a super-Virasoro group, a semigroup of annuli, and Gauss--Berezin integral operators arXiv:2607.17168
Unverified 2026

Objective-Weighted Graph Partition Router

Use the paper's structure-inheriting crossover to construct discrete token-to-expert assignments from two parent routers instead of randomly reinitializing routing assignments. Build a sparse token-similarity graph and optimize an objective combining within-expert similarity, cross-expert separation, and expert-load balance; use the resulting assignment to initialize router logits or to periodically repair overloaded experts. The method is especially suitable for small calibration batches or…

Useful5/10
Difficulty6/10
Novelty7/10
Paper: A Parallel Evolutionary Algorithm Framework for Graph $k$-CUT Problems arXiv:2607.17158
Unverified 2026

Protected-Kernel Graph Diffusion

Replace an ordinary graph diffusion or message-passing operator with a positive-semidefinite Laplacian whose kernel contains a prescribed node-wise subspace. The layer smooths only feature components orthogonal to that subspace, preserving global constants, positional modes, or other structural signals even when graph edges are dynamically added or removed.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Laplacian Spectral Shaping for Non-Uniform Scaling Formation Control of Open Multi-Agent Systems arXiv:2607.16709