Architecture ideas

Attention variants, state-space and recurrent cells, normalization and token-mixing schemes — each tested against the standard block it replaces.

Unverified 2026

SURE-Adaptive Derivative Front End

Prepend an adaptive Savitzky-Golay derivative bank to a temporal neural network. For each input channel and derivative order, select the local window by minimizing Stein's unbiased risk estimate, then concatenate the raw signal with the estimated derivatives. This supplies denoised velocity and acceleration features without requiring clean derivative targets or forcing the backbone to learn unstable finite-difference filters.

Useful5/10
Difficulty3/10
Novelty6/10
Paper: PDE Identification Using Noise Adaptive Differentiation in Strong Form (S-IDENT) arXiv:2606.31776
Unverified 2026

Fisher-Geometry Expert Menu

Construct a finite menu of experts or LoRA adapters by quantizing the oracle action manifold under a task-aware Fisher-information distortion rather than Euclidean parameter distance. The router can choose an installed expert after observing the input, but only k experts are stored or evaluated. The paper's frontier rate gives a falsifiable accuracy-versus-menu-size prediction.

Useful5/10
Difficulty6/10
Novelty4/10
Paper: Pre-Disclosure Experiment Menus: Oracle-Relative Risk and Joint Sample--Menu Asymptotics arXiv:2608.22905
Unverified 2026

Coherent-Fluctuating Amplitude Units

Represent selected hidden features as z = sqrt(N) exp(i theta), with a persistent phase and an explicitly stochastic amplitude. Regularize the ratio between coherent power |E[z]|^2 and total power E[|z|^2] toward the condensate prediction pi/4, while optionally matching higher amplitude moments.

Useful4/10
Difficulty5/10
Novelty8/10
Paper: Coherent Bose-Einstein condensation with fluctuating density arXiv:2607.12926