Architecture ideas

Attention variants, state-space and recurrent cells, normalization and token-mixing schemes — each tested against the standard block it replaces.

Unverified 2026

Branching-Pressure Router

Replace a generic MoE router entropy bonus with a branching-pressure objective that values routes according to both their stochastic entropy and their number of valid fine-grained continuations. The module can be implemented as a hierarchical router: a coarse state chooses a base transition, while a validity mask determines how many valid expert or latent branches lift that transition.

Useful5/10
Difficulty5/10
Novelty6/10
Paper: The entropy of Gromov-Thurston manifolds and branched coverings arXiv:2608.24220
Unverified 2026

Reliability-gated Laplacian positional encodings

Construct metric-graph Laplacian positional encodings only at frequencies whose empirical eigenvalues are statistically stable under the paper’s $(n v_\mu(h))^{-1/2}$ law. Use local ball-mass estimates and empirical eigengaps to gate or downweight unreliable eigenvectors, preventing small-sample spectral noise from entering a GNN or graph transformer.

Useful5/10
Difficulty4/10
Novelty5/10
Paper: Spectral stability of empirical metric-measure Laplacians arXiv:2608.23150
Unverified 2026

Conservative amortized collision layer

Add a learned stochastic pair-interaction layer to a particle graph neural network, with a conditional normalizing flow generating the post-interaction relative state. Parameterize the update in center-of-mass and invariant relative coordinates so every sampled interaction preserves pair momentum and kinetic energy exactly. The flow learns the transition law directly from observed scattering or trajectory data, replacing repeated numerical collision solves or unconstrained message-passing…

Useful5/10
Difficulty6/10
Novelty6/10
Paper: A particle method for the Boltzmann equation via amortized sampling from Green's function of the lifted linear operator arXiv:2608.22880
Unverified 2026

Complex Phase-Corrected State Integrator

Use the complex-conjugate palindromic coefficient that cancels the leading temporal phase defect of oscillatory modes. Implement complex arithmetic directly or use an exactly equivalent doubled-real state, then project the final state to its real component for real-valued prediction tasks.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Sharp CFL stability and temporal-dispersion optimization of symmetric splitting schemes for time-domain Maxwell equations arXiv:2608.22315
Unverified 2026

Critical Interface State-Space Pooling

Add a fixed or weakly learned interface-localized branch to a sequence model. Set the critical mass term to zero and make the transport coefficient change sign across a learnable interface, producing a localized mode that pools information near a detected transition rather than averaging uniformly over the sequence.

Useful4/10
Difficulty5/10
Novelty8/10
Paper: Critical Topological Photonics in Synthetic Dimensions arXiv:2608.21791