Architecture ideas

Attention variants, state-space and recurrent cells, normalization and token-mixing schemes — each tested against the standard block it replaces.

Unverified 2026

Complex-stretched resonance layer

Insert a fixed or learnable complex coordinate stretch outside the region where a neural operator models the physical interaction, so outgoing waves are damped and resonant states become ordinary discrete eigenmodes on a finite grid. Train the network with eigenvalue or resolvent losses computed after the stretch, while preserving the physical field in the interior region.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Dirac resonances as non-self-adjoint eigenvalues arXiv:2607.26166
Unverified 2026

Cyclic Power-Consistent Replica Block

Construct p shared neural replicas of the same token or feature set, quotient their outputs by the cyclic group C_p, and train a power head to agree with the representation obtained from a jointly processed p-fold input. Add a filtration score whose value is nondecreasing under the power map and strictly increases on deliberately nontrivial replica combinations. The experiment tests whether this algebraically structured consistency signal is better than ordinary pairwise augmentation…

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Quantum Steenrod powers and Hamiltonian maps arXiv:2607.25960
Unverified 2026

Metric-magnitude pooling

Replace mean or max pooling over a set of learned element embeddings with pooling based on the metric-magnitude weighting. Pairwise distances create a globally coupled correction for redundancy, so geometrically isolated or boundary elements can contribute differently from dense clusters of nearly duplicate elements.

Useful5/10
Difficulty5/10
Novelty8/10
Paper: Scalably computing metric magnitude arXiv:2607.23354
Unverified 2026

Orthogonal symmetric pair embedding

For every unordered pair of scalar features, construct invariant coordinates from the elementary symmetric quantities s=x+y and q=xy, then feed a truncated orthogonalized polynomial basis in (s,q) to the neural network. Estimate the basis by weighted Gram-Schmidt or Cholesky whitening under the paper's triangle weight, so polynomial channels have low redundancy and controlled scale instead of requiring an unconstrained MLP to learn both symmetry and decorrelation.

Useful5/10
Difficulty3/10
Novelty7/10
Paper: Symmetric Jacobi Polynomials on a Triangle and Their Spectral Algebra arXiv:2607.22751
Unverified 2026

Upper-shadow mask augmentation

Represent an input perturbation, feature mask, or expert route as a subset of a ground set of size n. Collect a useful family F of k-subsets, then generate larger l-subsets only by adding l-k elements to members of F; these are the upper-shadow augmentations. The paper's explicit profile predicts a guaranteed fraction of distinct l-masks covered by this procedure, allowing an augmentation system to replace inefficient random mask sampling with targeted combinatorial expansion.

Useful5/10
Difficulty4/10
Novelty9/10
Paper: Upper-shadow comparisons on the slice and the Frankl--Tokushige product conjectures arXiv:2607.21589
Unverified 2026

Variable-Exponent Fourier Block

Replace a fixed-norm Fourier feature layer by a Fourier transform followed by spatially varying modular normalization. Use a baseline exponent approaching the endpoint regime at large coordinates and permit only bounded, smooth deviations so the transform remains controlled while the network can emphasize localized details.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Fourier inequalities in variable Lebesgue spaces arXiv:2607.15922
Unverified 2026

Hadamard fractal Fourier encoding

Construct positional features from a self-similar digit system whose Fourier characters are orthogonal under a prescribed nonuniform measure, rather than sampling frequencies independently. Use several admissible multiplier values to create frequency bands while preserving the underlying Hadamard structure, giving a deterministic multiscale encoding with a better-conditioned feature Gram matrix on fractal or highly clustered coordinates.

Useful5/10
Difficulty4/10
Novelty5/10
Paper: Spectral eigenvalue set of self-similar measures associated with product-form Hadamard triples arXiv:2607.15743
Unverified 2026

Descent-Set Shuffle Composition

Represent each sequence chunk by a distribution over local descent-set patterns, then compose two chunks using the shuffle-algebra product rather than concatenating their embeddings alone. The module explicitly models how local order statistics change under interleaving, providing an inductive bias for event streams, code tokens, time-series segments, or mixtures of independently generated sequences.

Useful5/10
Difficulty6/10
Novelty8/10
Paper: Shuffle-compatibility for combinatorial statistics on words, parking functions, and set partitions arXiv:2607.14255
Unverified 2026

Geometric observability gating

Build a graph diffusion or neural-operator encoder whose sparse-observation loss is weighted according to graph distance from the observed nodes. For early diffusion times, suppress supervision or cross-attention demands that are geometrically impossible because signals at distance \(d\) are attenuated like \(e^{-d^2/(2t)}\); gradually release those constraints as diffusion time grows.

Useful5/10
Difficulty4/10
Novelty6/10
Paper: Optimal geometric barriers for weighted observability of heat semigroups on metric measure spaces arXiv:2607.13279
Unverified 2026

Branching-Fanout Sparse MoE

Replace a fixed top-k expert count with a stochastic, token-specific fanout generated by a supercritical binary branching process stopped at a geometric time. The resulting number of active experts has finite mean but a power-law tail with log-periodic modulation, allowing most tokens to use little compute while reserving larger computation for difficult or ambiguous tokens.

Useful5/10
Difficulty6/10
Novelty8/10
Paper: Power-law and log-periodic degree tails for a family of probability generating function equations arising in evolving networks arXiv:2607.12564
Unverified 2026

Potential-Steered Observable Wave Layer

Replace homogeneous feature propagation with a discretized wave equation containing a positive, spatially varying learnable potential. The potential changes Hamiltonian trajectories so that feature energy reaches the layer's readout or sensor region instead of remaining in dynamically hidden modes. Train the potential jointly with the task objective and an empirical observability penalty.

Useful5/10
Difficulty6/10
Novelty8/10
Paper: Uniform controllability for the wave equation with large potential arXiv:2607.11702
Unverified 2026

Prime-Gated Maximal-Length Binary Reservoir

Replace a learned recurrent transition with a sparse binary reservoir compiled from prime-count gates. Three permanently active control vertices implement copy and XNOR transitions, allowing the signal state to realize an affine feedback register over \(\mathbb F_2\) with period \(2^m-1\) using only \(O(m)\) edges and bounded in-degree. Train only an input projection and readout, or use straight-through estimators if end-to-end adaptation is required.

Useful5/10
Difficulty5/10
Novelty6/10
Paper: Pulse Graphs: Prime-Activated Boolean Dynamics on Directed Graphs arXiv:2607.10453
Unverified 2026

Homoclinic Symbolic Reservoir

Construct a periodically driven hybrid recurrent state-space model whose vector field is piecewise smooth across learned switching surfaces. Engineer a transverse homoclinic intersection around a hyperbolic recurrent state; the resulting shift-like invariant set provides a controllable symbolic reservoir for sequence prediction and long-horizon generation.

Useful5/10
Difficulty7/10
Novelty7/10
Paper: Homoclinic Theorems for piecewise smooth vector fields arXiv:2607.09618
Unverified 2026

Crossover-Aware Multiscale Attention

Build a neural architecture whose receptive field or attention span is increased according to an estimated disorder-to-order crossover scale. Local branches process windows below the crossover as if they were stochastic, while a global branch is activated only when the context exceeds the predicted scale needed to expose deterministic recurrence. This targets sequences or images containing long-range quasiperiodic, hierarchical, or algorithmically generated structure that is statistically…

Useful5/10
Difficulty5/10
Novelty7/10
Paper: The scales of disorder in perfect quasicrystals arXiv:2607.09274
Unverified 2026

Subduction-Based Tangent Augmentation

Train a predictor on quotient-consistent tangent jets rather than only on transformed samples. Generate several local representatives of the same orbit, compute first-order feature perturbations, and aggregate them through a shared tangent module before prediction. This gives a structured alternative to treating augmented views as independent examples and can improve robustness to composed transformations.

Useful5/10
Difficulty6/10
Novelty6/10
Paper: Diffeological Riemannian orbifolds arXiv:2607.08939
Unverified 2026

Charge-conserving Z3 neural block

Represent each feature as belonging to one of three \(\mathbb{Z}_3\) charge sectors and constrain every linear and multiplicative operation to obey charge addition modulo 3. Add invariant cubic gates such as \(x_1x_2x_3\) or \(x_q^3\), which can express the same phase-insensitive interaction selected by the paper's three-photon drive. This should improve data efficiency and exact cyclic-augmentation consistency when the task has a genuine ternary symmetry.

Useful5/10
Difficulty4/10
Novelty6/10
Paper: Quantum and Classical Potts Criticality in Driven-Dissipative Bosonic Lattices arXiv:2607.08425
Unverified 2026

Stable Magnitude Bottleneck

Insert a magnitude-only bottleneck whose output is the absolute value of a random independent-feature expansion of the latent vector. Train a decoder to reconstruct the latent representation or input modulo one global sign, while explicitly rejecting feature distributions whose normalized L1 mass is too small. The module provides a controlled way to obtain sign-invariant representations without allowing arbitrary coordinate-wise sign loss.

Useful5/10
Difficulty4/10
Novelty7/10
Paper: Stable Phase Retrieval for Spans of Independent Random Variables arXiv:2607.06693
Unverified 2026

Patterned-Walk Graph Signature

Augment a graph neural network or graph transformer with counts of cyclic walks whose successive steps are required to be graph edges or graph non-edges according to a binary pattern. These features encode induced-subgraph structure that ordinary adjacency powers miss, and can be concatenated to the graph-level token or used as an auxiliary prediction target.

Useful5/10
Difficulty4/10
Novelty7/10
Paper: Generalized spectral closedness of $\mathcal{F}$-free graph classes arXiv:2607.06455
Unverified 2026

Cyclotomic p-Cap Layer

Replace an ordinary token aggregation step with a p-replica cyclic-equivariant block. Features are copied into p replicas, processed by shared operators, coupled through a cap-like bilinear interaction, and projected onto cyclic invariants. An auxiliary commutation loss enforces that applying the operator before or after the p-fold lift gives similar outputs.

Useful5/10
Difficulty5/10
Novelty8/10
Paper: Noncommutative Cartier Formulae arXiv:2607.05360
Unverified 2026

Microscopic Boundary Pooling

Replace uniform set or point-cloud pooling with a microscopic weighting computed from pairwise feature-space distances. The resulting signed pooling vector should retain boundary and geometrically isolated points that ordinary mean pooling suppresses, potentially improving recognition when class information is concentrated on shape extremities or rare local configurations.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: The microscopic weighting on a metric space arXiv:2607.05349
Unverified 2026

Invariant Möbius latent mixer

Insert a piecewise Möbius transformation as a deterministic latent mixing layer, using the paper's exact branch structure rather than a generic unconstrained MLP. The transformation repeatedly moves points between branches while preserving a known reference density, creating a cheap chaotic mixer with analytically computable Jacobian factors. Use a truncated, normalized version in practice so that the sigma-finite invariant measure becomes a valid finite training distribution.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Dynamics of integer zeroes of homogeneous quadratic equations over $\mathbb{R}^3$ arXiv:2607.03354
Unverified 2026

Smooth-Plus-Boundary-Lifting Network

Represent the prediction as a sum of a smooth interior branch and a fractional boundary branch: u_theta(x)=u_int_theta(x)+d(x)^a u_bd_theta(x). This mirrors the paper's direct-sum solution structure and allocates separate network capacity to the globally regular component and the boundary layer.

Useful5/10
Difficulty5/10
Novelty8/10
Paper: The structure of solution spaces for fractional-order operators, with gradient estimates arXiv:2607.02312
Unverified 2026

SURE-Adaptive Derivative Front End

Prepend an adaptive Savitzky-Golay derivative bank to a temporal neural network. For each input channel and derivative order, select the local window by minimizing Stein's unbiased risk estimate, then concatenate the raw signal with the estimated derivatives. This supplies denoised velocity and acceleration features without requiring clean derivative targets or forcing the backbone to learn unstable finite-difference filters.

Useful5/10
Difficulty3/10
Novelty6/10
Paper: PDE Identification Using Noise Adaptive Differentiation in Strong Form (S-IDENT) arXiv:2606.31776
Unverified 2026

PED finite-state graph layer

Add a finite-state message-passing layer that tracks local configurations corresponding to perfect edge domination or dominating induced matchings instead of transmitting unconstrained node embeddings alone. On graphs with a tree, series-parallel, or small-separator decomposition, the layer produces an exact or differentiable partition function over globally valid edge configurations, which can be used as node features, an auxiliary loss, or a structural prior.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Counting perfect edge dominating sets: extremal results and linear-time algorithms arXiv:2607.03894