Architecture ideas

Attention variants, state-space and recurrent cells, normalization and token-mixing schemes — each tested against the standard block it replaces.

Unverified 2026

Trace-Free Hodge Feature Mixer

Build a parameter-free spectral channel mixer whose channels are arranged as components of an l-form and whose multiplier is the trace-free Beurling--Ahlfors transform. At every nonzero spatial frequency it mixes the exact and coexact channel subspaces with opposite signs, preventing a uniform channel-direction bias and preserving a structured cancellation property. Insert it as a residual branch before a convolution, MLP, or attention block, with one learned scalar gate controlling its…

Useful5/10
Difficulty6/10
Novelty8/10
Paper: The trace-free Beurling--Ahlfors transform and the Bourgain--Brezis problem for Hodge systems arXiv:2608.04237
Unverified 2026

Repair-cost detector for incompatible similarity predictions

Use the paper's lower bound on nearest-correlation repair cost to detect when a neural network's pairwise similarity predictions contain too much globally incompatible off-diagonal energy. Instead of projecting every predicted matrix onto the correlation cone, train the network to reduce the repair-risk statistic or trigger expensive repair only when a cheap diagnostic predicts substantial distortion.

Useful5/10
Difficulty4/10
Novelty6/10
Paper: Correlation Matrices in High Dimensions: The Elliptope as a Sample-Correlation Ensemble arXiv:2608.04162
Unverified 2026

Injective Boundary-Aware Disk Pooling

Replace fixed-radius image blur or pooling with disk averages whose radius is proportional to the distance from each pixel to the image boundary. Compute the transform at every spatial location and train a lightweight decoder to reconstruct the pre-transform feature map, using reconstruction error as an anti-collapse regularizer. This creates a scale-adaptive smoothing layer with an injectivity motivation in the continuum while providing larger context in the image interior.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Variable-Radius Disk Transforms and an Area-Integral Problem of Zalcman arXiv:2608.02546
Unverified 2026

G2 structured latent code

Use the signed-base expansion as a compact discrete-continuous latent parameterization for a VAE or autoencoder. A short binary sequence produces exponentially refined coordinates, while a learned Markov prior captures correlations between successive latent bits. The decoder receives the resulting bounded real coordinates instead of an unconstrained Gaussian latent vector.

Useful5/10
Difficulty5/10
Novelty6/10
Paper: Fractal random variables defined by probability distributions of digits of their $G_2$-representation having two bases with different signs arXiv:2607.29327
Unverified 2026

Distributional spectral-preconditioned features

Replace or augment a singular scalar activation \(\sigma\) with a distributionally regularized activation \(g\) whose Fourier transform is multiplied by \((i\rho)^\alpha\). This suppresses the problematic low-frequency singular component and can produce better-conditioned random-feature or first-layer representations, while a residual raw-activation branch prevents loss of standard approximation behavior.

Useful5/10
Difficulty5/10
Novelty8/10
Paper: Radon Measure Representations for Infinite-Width Neural Networks with Singular Activations arXiv:2607.29258
Unverified 2026

Dispersive Analytic Smoothing Block

Insert a short gKdV-inspired spectral flow between neural blocks to regularize rough feature maps without using an isotropic low-pass filter. The module applies a Fourier dispersive phase and derivative-coupled polynomial residual updates, with an optional finite factorial dilation penalty to encourage analytic-looking features.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Instantaneous analytic smoothing of rough data for the modified and cubic gKdV equations arXiv:2607.27115
Unverified 2026

Noise-crossing band-pass neuron

Replace selected ReLU or sigmoid units with a stochastic binary crossing activation that fires only when exactly one of two independent noise thresholds is crossed. The resulting expected activation is low for inputs far below or far above the noise distribution and maximal near its median, creating an analytically controlled band-pass and potentially reducing saturation-driven instability.

Useful5/10
Difficulty4/10
Novelty6/10
Paper: Reconstructing Backpropagation from Forward Fluctuations in Noise-modulated Neural Networks arXiv:2607.26483
Unverified 2026

Complex-stretched resonance layer

Insert a fixed or learnable complex coordinate stretch outside the region where a neural operator models the physical interaction, so outgoing waves are damped and resonant states become ordinary discrete eigenmodes on a finite grid. Train the network with eigenvalue or resolvent losses computed after the stretch, while preserving the physical field in the interior region.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Dirac resonances as non-self-adjoint eigenvalues arXiv:2607.26166
Unverified 2026

Cyclic Power-Consistent Replica Block

Construct p shared neural replicas of the same token or feature set, quotient their outputs by the cyclic group C_p, and train a power head to agree with the representation obtained from a jointly processed p-fold input. Add a filtration score whose value is nondecreasing under the power map and strictly increases on deliberately nontrivial replica combinations. The experiment tests whether this algebraically structured consistency signal is better than ordinary pairwise augmentation…

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Quantum Steenrod powers and Hamiltonian maps arXiv:2607.25960
Unverified 2026

Derangetropy Rank Warp

Insert a distribution-free rank warp before selected MLP or attention projections. For each scalar activation, replace its empirical rank u by the cumulative interval map induced by the Type-III derangetropy kernel, optionally followed by Gaussian or affine output calibration. The transform is invariant to strictly increasing reparameterizations of the feature and contracts the marginal toward central ranks, potentially reducing sensitivity to heavy tails and outliers.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Derangetropy Operators arXiv:2607.24705
Unverified 2026

Central-Moment Feature Mixer

Replace raw polynomial interactions between neighboring feature vectors with central polynomial interactions computed after subtracting the local feature mean. Keep separate second-, third-, and fourth-order channels and apply independent residual gates to them, so a uniform shift of every feature in a neighborhood cannot create artificial cross-order responses. This is a drop-in higher-order mixer for a small transformer or graph neural network.

Useful5/10
Difficulty5/10
Novelty6/10
Paper: Central-Hermite Sensing and Collision for Frame-Robust Order-Resolved Relaxation on D3Q125 arXiv:2607.23629
Unverified 2026

Upper-shadow mask augmentation

Represent an input perturbation, feature mask, or expert route as a subset of a ground set of size n. Collect a useful family F of k-subsets, then generate larger l-subsets only by adding l-k elements to members of F; these are the upper-shadow augmentations. The paper's explicit profile predicts a guaranteed fraction of distinct l-masks covered by this procedure, allowing an augmentation system to replace inefficient random mask sampling with targeted combinatorial expansion.

Useful5/10
Difficulty4/10
Novelty9/10
Paper: Upper-shadow comparisons on the slice and the Frankl--Tokushige product conjectures arXiv:2607.21589
Unverified 2026

Reach-Calibrated Topology Tokens

Add a finite-resolution geometric code to a 3D neural encoder: quantized lattice occupancy, local barycenters, and tangent directions are converted into structural tokens alongside ordinary point or mesh features. Choose lattice spacing from estimated local reach so that small perturbations do not change the code, and train the continuous encoder to agree with this discrete structural representation.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: A Geometric Finiteness Theory for Essential Surfaces in Knot Exteriors arXiv:2607.20844
Unverified 2026

Web-Constrained Product Flow

Add an invertible two-dimensional flow block whose Jacobian and coordinate outputs are explicitly regularized to preserve independence of several prescribed product distributions. Instead of estimating independence only from samples, enforce the change-of-variables functional equation for multiple density probes, encouraging the learned map to belong to a low-dimensional family of independence-preserving transformations.

Useful5/10
Difficulty6/10
Novelty6/10
Paper: The Independence-Preserving Property and Planar Web Geometry arXiv:2607.20646
Unverified 2026

Projective Compact Prior for Latent Models

Use the calibrated compact-support maximum-entropy law as a latent prior or representation regularizer in a VAE or autoencoder. Unlike a Gaussian prior, it prevents latent codes from drifting arbitrarily far while retaining explicitly controlled mean and covariance.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Projective Maximum Entropy: Universality and Acceptance-Region Calibration arXiv:2607.16547
Unverified 2026

Holonomy-Fixed State Filter

Add a preprocessing and inference module to a permutation-labeled graph network that computes the states globally compatible with all cycle transports. The module masks node or root-state logits to this fixed-point set, replacing exponential global assignment search with graph traversal plus permutation-table operations. A soft version can use the fixed-point mass as an auxiliary compatibility regularizer during training.

Useful5/10
Difficulty4/10
Novelty8/10
Paper: Contextual Fraction on Permutation Gain Graphs: Exact Algorithms, Query Lower Bounds, and Dynamic Maintenance arXiv:2607.16037
Unverified 2026

Variable-Exponent Fourier Block

Replace a fixed-norm Fourier feature layer by a Fourier transform followed by spatially varying modular normalization. Use a baseline exponent approaching the endpoint regime at large coordinates and permit only bounded, smooth deviations so the transform remains controlled while the network can emphasize localized details.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Fourier inequalities in variable Lebesgue spaces arXiv:2607.15922
Unverified 2026

LU-Preconditioned Orthogonal Weight Retraction

Periodically project a rectangular neural-network weight matrix onto an approximately orthonormal-column matrix using LU-preconditioned CholeskyQR rather than ordinary QR or a polar iteration. Pivoted LU handles badly scaled and nearly dependent columns, while Householder orthogonalization of the LU factor produces a triangular preconditioner that makes the subsequent Cholesky step safer in fp16 or bfloat16.

Useful5/10
Difficulty6/10
Novelty5/10
Paper: RCLUPPr: a new randomized CholeskyQR with LU preconditioning arXiv:2607.15561
Unverified 2026

Monadic Bar Refinement Network

Construct a shared latent transformation as a neural monad-like operator Γ=Ω∘Σ, and expose its iterates Γ^{q+1}Y as a refinement trajectory rather than stacking unrelated layers. Aggregate the resulting representations with a learned or fixed realization weighting, while training an algebra-action map θ:ΓY→Y to make one-step refinement compatible with the original representation. This creates a shallow-parameter, arbitrarily deep computation path with explicit compositional…

Useful5/10
Difficulty6/10
Novelty6/10
Paper: The homotopical monadicity theorem arXiv:2607.12124
Unverified 2026

Potential-Steered Observable Wave Layer

Replace homogeneous feature propagation with a discretized wave equation containing a positive, spatially varying learnable potential. The potential changes Hamiltonian trajectories so that feature energy reaches the layer's readout or sensor region instead of remaining in dynamically hidden modes. Train the potential jointly with the task objective and an empirical observability penalty.

Useful5/10
Difficulty6/10
Novelty8/10
Paper: Uniform controllability for the wave equation with large potential arXiv:2607.11702
Unverified 2026

Heterogeneity-Preserving Router Coarse-Graining

Use the paper's finite-habitat approximation as a warning and design principle: averaging token- or state-dependent routing environments can reduce the persistence of specialized subnetworks. Partition inputs into environments, estimate environment-specific interaction kernels, and retain the heterogeneity that produces positive invasion margins instead of replacing it with one global average.

Useful5/10
Difficulty5/10
Novelty6/10
Paper: Metacommunity persistence on spatially heterogeneous landscapes arXiv:2607.11291
Unverified 2026

Subduction-Based Tangent Augmentation

Train a predictor on quotient-consistent tangent jets rather than only on transformed samples. Generate several local representatives of the same orbit, compute first-order feature perturbations, and aggregate them through a shared tangent module before prediction. This gives a structured alternative to treating augmented views as independent examples and can improve robustness to composed transformations.

Useful5/10
Difficulty6/10
Novelty6/10
Paper: Diffeological Riemannian orbifolds arXiv:2607.08939
Unverified 2026

Spherical Height-Routed Multiscale Network

Replace an unconstrained deep routing tree by a q-ary descendant hierarchy with an explicit even height h=0,2,4,... labeling feature scale or computation depth. Train the router so that empirical occupancy of heights follows the exact even-sector law from the Nagao quotient, preventing concentration at shallow layers or unstable overuse of very deep paths.

Useful5/10
Difficulty5/10
Novelty6/10
Paper: $K$-spherical horospherical averages on the Nagao quotient: tree combinatorics and exact discrepancy arXiv:2607.08704
Unverified 2026

Charge-conserving Z3 neural block

Represent each feature as belonging to one of three \(\mathbb{Z}_3\) charge sectors and constrain every linear and multiplicative operation to obey charge addition modulo 3. Add invariant cubic gates such as \(x_1x_2x_3\) or \(x_q^3\), which can express the same phase-insensitive interaction selected by the paper's three-photon drive. This should improve data efficiency and exact cyclic-augmentation consistency when the task has a genuine ternary symmetry.

Useful5/10
Difficulty4/10
Novelty6/10
Paper: Quantum and Classical Potts Criticality in Driven-Dissipative Bosonic Lattices arXiv:2607.08425