Unverified
2026
Replace unconstrained low-rank compression of a neural state with an augmented basis that always contains vectors representing known conserved quantities or diagnostically important linear statistics. After each learned transition, project the state back onto the affine constraint set with an exact minimum-norm correction, preventing rank truncation and model error from accumulating in those statistics.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Construct one reference Lanczos basis for a symmetric propagation operator H, then derive several seed-specific spectral responses for Q_a(H)x_0 through finite-band polynomial connectors. With degree-r seeds, each transformed basis vector uses at most 2r+1 neighboring reference basis vectors, avoiding a separate Lanczos factorization for every seed.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Build a recurrent cell that uses a filtered predecessor state and explicitly accounts for stale communicated features, following the paper's delay-augmented state-space construction. The cell is trained under variable activation delays and constrained so that local closed-loop dynamics remain stable, targeting robustness of long-horizon rollout rather than only one-step prediction.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Add a selective redistribution branch to recurrent or graph propagation layers whose local Jacobian gains are too large. Instead of globally shrinking the layer, blend the unstable update at only the offending coordinates with a volume-weighted average of those coordinates and their upstream neighbors, using the paper's explicit threshold as the minimum stabilizing blend.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace a dense token or state-mixing matrix with an inverse-capacitance operator whose couplings decay with graph distance, while introducing trainable heterogeneous diagonal capacitances to break spatial symmetries. The layer is cheap because the capacitance matrix is sparse and banded, but its inverse produces global responses with controllable locality.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Train a learned latent transition not merely to fit one-step data, but to require only a small operator correction before its selected spectral modes become exact eigenmodes. The correction is a measurable backward error, so the regularizer penalizes models whose apparent eigenstructure is highly sensitive to noise or finite-sample error. At inference time, the correction norm can trigger conservative rollout or mode suppression.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Use the spectral time constant of a memory operator to decide when a sequence layer should retain state, refresh it, or bypass expensive long-memory computation. A mode with eigenvalue near one is treated as valuable long memory, while unstable modes are suppressed, yielding an adaptive-computation mechanism driven by operator dynamics rather than token magnitude alone.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace a large stable linear state-space or recurrent layer by a lower-order balanced realization computed from frequency-targeted controllability and observability Gramians. Use generalized low-rank ADI with imaginary-axis shifts concentrated at frequencies that dominate the training data, then retain states associated with the largest approximate Hankel singular values. This should reduce recurrent inference cost while preserving the layer's input-output response in the selected frequency…
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace the explicit Euler, Heun, or fixed-step midpoint update used for a neural ODE or diffusion probability-flow trajectory with a two-stage randomized SDIRK step. Draw one random scalar per time step, use it in both implicit stage equations, and solve each stage with Newton or damped fixed-point iteration. The randomness targets quadrature error caused by nonsmooth score networks, while the singly diagonal structure permits reuse of the same Jacobian preconditioner for both stage solves.
Useful6/10
Difficulty7/10
Novelty6/10
Unverified
2026
Implement a neural controlled differential equation update using a truncated planar-binary-tree expansion rather than a first-order Euler step. Select the truncation order from driver regularity and the observed magnitudes of elementary differentials, while using a cancellation-aware remainder monitor to avoid computing unnecessarily high-order terms.
Useful6/10
Difficulty6/10
Novelty5/10
Unverified
2026
Insert a learnable semigroup layer that evolves features according to a positive operator combining frequency damping and spatially varying confinement. Unlike isotropic Gaussian smoothing, the layer can damp selected frequencies differently along different axes and can suppress activations in learned spatial regions, while the positive-semigroup construction prevents amplification.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Construct a second-order recurrent cell with an odd high-degree restoring force and lower-degree state-dependent velocity feedback, while representing time-dependent coefficients as a finite Fourier series. At each training or inference window, retain and normalize only Fourier modes below K = c_* log A, where A is the current hidden-state amplitude; apply bounded corrections to nonresonant low modes and leave the analytically small high-frequency tail untouched. The predicted benefit is…
Useful6/10
Difficulty7/10
Novelty8/10
Unverified
2026
Use the paper's fast-layer/reduced-problem decomposition as a training schedule: first optimize a cheap reduced neural dynamics on the critical manifold, then gradually restore the fast dynamics by increasing the stiffness parameter. This provides a continuation path from an easy slow problem to the intended recurrent or implicit model and supplies a concrete stopping criterion based on normal-hyperbolicity loss.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Replace the plain fixed-point iteration of an implicit neural layer with nonlinear GMRES residual minimization over a short history of iterates. Use the measured residual reduction from each least-squares problem to increase depth when acceleration is effective, and restart or reduce depth when the predicted gain disappears.
Useful6/10
Difficulty5/10
Novelty4/10
Unverified
2026
Replace a dense token-mixing matrix in a sequence model with a fixed or learnable SBP derivative operator D=P^{-1}Q. The discrete integration-by-parts identity makes the interior mixing energy-neutral or boundary-dissipative, reducing exploding activations in deep residual stacks while preserving directional information along the sequence.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Represent a rational-like feature transformation with an auxiliary state y constrained by polynomial equations G(x,y)=0, and update x and y jointly along the tangent space of that constraint manifold. This creates residual blocks in which nonlinear feature identities remain consistent over many layers or time steps, reducing auxiliary-variable drift and potentially stabilizing rational activations and implicit recurrent dynamics.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Replace a polynomial graph filter or repeated matrix multiplications in a graph neural network with a small rational filter evaluated at several shifts. Treat the incoming feature matrix as a block of probes rather than processing scalar probe vectors independently, allowing one set of shifted solves to expose multiple spectral directions simultaneously. The expected gain is higher approximation quality at the same number of operator applications, especially when the target filter has sharp or…
Useful6/10
Difficulty6/10
Novelty6/10
△ Mechanism confirmed, baseline not beaten
2026
Use a symplectic Hamiltonian update as a recurrent or state-space neural block, preserving a learned modified energy across many layers or time steps. This targets residual and recurrent architectures where ordinary Euler updates accumulate drift during long rollouts.
Useful6/10
Difficulty5/10
Novelty5/10
✓✓ Beats tuned baseline
2026
Replace the usual explicit residual update with a nonstandard general-linear block containing several internal feature stages. The effective step is a positive denominator function rather than the raw depth step, allowing the block to take large nominal steps while damping the update and preserving bounded activations. This is most promising for deep residual MLPs, neural ODE discretizations, and state-space sequence models where exploding hidden states limit usable depth.
Useful6/10
Difficulty6/10
Novelty6/10
✗ Mechanism failed
2026
Replace explicit RK integration in a stiff neural ODE or continuous-depth residual network with the paper's stiffly accurate SDIRK4 discretization. Instead of performing a dense Newton solve for each implicit stage, solve the diagonal stage equation using a Chebyshev-accelerated residual iteration whose polynomial damps the negative, high-magnitude Jacobian modes responsible for stiffness.
Useful6/10
Difficulty7/10
Novelty7/10
✗ Mechanism failed
2026
Replace a dense recurrent transition matrix with a periodic CMV-style product of alternating local 2x2 unitary cores. The transition is exactly norm-preserving, has O(n) trainable parameters under periodic tying, and can be applied through local factor operations rather than stored as an n-by-n matrix. Use turnover refactorization when changing the ordering or boundary connection of cores, enabling a compact cyclic unitary state-space layer.
Useful6/10
Difficulty5/10
Novelty5/10
✗ Mechanism failed
2026
Replace the usual linear predictor in continuation of an implicit neural state with a fractional-power predictor fitted from recent states, then correct the prediction using a pseudo-arclength constraint. This is designed for equilibrium layers, implicit sequence models, or homotopy training schedules where the state Jacobian becomes nearly singular and ordinary Newton correction or fixed-point iteration becomes unstable.
Useful6/10
Difficulty6/10
Novelty8/10
△ Mechanism confirmed, baseline not beaten
2026
Add a learned Riesz-transform branch that extracts normalized spatial gradients after diffusion by a positive parabolic operator. The diffusion branch carries smooth semantic content, while the Riesz branch represents boundaries, motion changes, and graph discontinuities. Resolvent smoothing makes the derivative branch less sensitive to feature noise than directly applying a finite difference.
Useful6/10
Difficulty5/10
Novelty7/10
✓✓ Beats tuned baseline
2026
Add a fixed or weakly parameterized residual mixer whose interaction between sequence positions at distance \(r\) is proportional to \(1/(r\log^2 r)\). Instead of truncating the kernel at a short radius, represent its heavy tail with dyadic distance bands and compute each band using prefix sums or block pooling, giving every token access to arbitrarily distant context at roughly \(O(L\log L)\) cost.
Useful6/10
Difficulty5/10
Novelty6/10