△ Mechanism confirmed, baseline not beaten
2026
Replace scalar FedAvg synchronization with matrix-weighted synchronization that averages only a designated shared parameter subspace and leaves client-specific directions unconstrained. Use the paper's cut condition to detect whether every client partition has enough communication support to synchronize the shared directions; this prevents apparently connected federated graphs from silently failing to align important low-rank parameter modes.
Useful8/10
Difficulty5/10
Novelty6/10
△ Mechanism confirmed, baseline not beaten
2026
Replace full-dimensional node or weight perturbation with perturbations in an input-conditioned d-dimensional tangent subspace, where d is the input or feature dimension and is much smaller than the reservoir width or parameter count. Estimate the update using only scalar self-supervised losses from positive and negative perturbations, then map the low-dimensional update back to the trainable parameters.
Useful8/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Replace an unconstrained recurrent or state-space update with a block whose state Jacobian is contractive and whose input Jacobian has a controlled gain. This should make hidden-state discrepancies caused by initialization, quantization, or input noise decay geometrically rather than explode, while retaining a finite and predictable response to persistent input perturbations.
Useful8/10
Difficulty5/10
Novelty5/10
✗ Mechanism failed
2026
Replace the standard squared pointwise PDE residual in an elliptic PINN by its discrete $H^{-1}$ norm. The residual is passed through an inverse Dirichlet Laplacian, reducing the dominance of rapidly varying residual modes and acting as a mathematically specified preconditioner for the PINN training gradients.
Useful8/10
Difficulty5/10
Novelty7/10
✗ Mechanism failed
2026
Replace the ordinary average of task or client gradients with an iterative spectral filter that removes tasks whose gradient vectors explain an anomalously large covariance direction. The global model uses the filtered gradient, while each task still maintains its own personalized parameters and local optimizer state. Unlike parameter-center regularization, the robustification acts directly on the vector messages and is designed to avoid an additional \(\sqrt d\) contamination penalty.
Useful8/10
Difficulty5/10
Novelty5/10
✗ Mechanism failed
2026
Give a single spiking layer a persistent vector-valued apical compartment that stores the current online linear predictor for the task. On each labeled context pair, its subthreshold state performs a leaky LMS update; on the query, the state is read without updating, allowing in-context adaptation without attention or inference-time synaptic plasticity.
Useful8/10
Difficulty5/10
Novelty7/10
✗ Mechanism failed
2026
Replace a full neural-network Gauss–Newton solve with a damped solve in an adaptively constructed low-dimensional parameter subspace. The subspace contains the current gradient, recent accepted updates, Krylov curvature directions, and randomized Jacobian-curvature probes, and is enlarged whenever its projected gradient fails to capture enough descent information.
Useful8/10
Difficulty6/10
Novelty7/10
✗ Mechanism failed
2026
Replace pointwise cross-modal or prototype-to-instance matching with a loss that compares source pairwise inner products to inner products between target conditional means. A source prototype can align to a cloud of target instances while preserving its semantic barycenter, instead of being forced to match every target instance individually.
Useful8/10
Difficulty5/10
Novelty6/10
✗ Mechanism failed
2026
Use the behavior-subspace gap as a trust-region constraint when applying a shared update to multiple recurrent modules or experts. A proposed common update is accepted only when post-update behavior subspaces remain close to their leader and their graph subspaces remain sufficiently transverse, preventing one shared optimizer step from destabilizing dynamically different members.
Useful7/10
Difficulty6/10
Novelty9/10
△ Mechanism confirmed, baseline not beaten
2026
Treat the hidden-state update of an RNN, SSM, or neural ODE as a linearized input-output system and penalize its frequency-response peaks. The regularizer targets amplification caused by nonnormal state matrices, which may be large even when all eigenvalues are stable, and therefore controls transient oscillations and long-horizon sensitivity more directly than an eigenvalue-radius penalty.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Mechanism failed
2026
Replace Euclidean or unprojected covariance averaging with a projected Bures-Wasserstein barycenter layer. Each unit-step barycenter update is followed by eigenvalue clipping into \([\alpha,\beta]\), preserving positive definiteness and preventing ill-conditioning without an additional eigendecomposition.
Useful7/10
Difficulty5/10
Novelty6/10
△ Mechanism confirmed, baseline not beaten
2026
Run several heterogeneous recurrent or state-space network copies and couple their hidden states through a directed hypergraph with proportional and integral feedback. The proportional term contracts disagreement, while the integral state rejects persistent replica-specific biases that ordinary consensus coupling can only bound. This creates a controllable synchronization-versus-divergence transition rather than an unstructured regularization coefficient.
Useful7/10
Difficulty6/10
Novelty8/10
✗ Mechanism failed
2026
Replace a fragile learned similarity score for continuous object coordinates with a projection residual against a learned signal subspace. Candidate coordinates are represented by normalized Fourier or positional feature vectors, and the score is the fraction of feature energy outside the estimated subspace. The score remains useful even when the estimated subspace is adversarially rotated, because the perturbation is controlled directly by a sine-theta distance rather than by assumptions about…
Useful7/10
Difficulty5/10
Novelty7/10
✗ Mechanism failed
2026
Replace a monolithic nonlinear latent transition in a neural world model or sequence predictor with two lifted latent channels: a global channel encoding scene-wide or sequence-wide structure and local channels encoding patches, segments, tokens, or objects. Propagate both channels with a block-structured linear operator and decode them jointly, so the encoder remains nonlinear but multi-step latent rollouts do not repeatedly apply a deep transition network.
Useful7/10
Difficulty5/10
Novelty5/10
△ Mechanism confirmed, baseline not beaten
2026
Construct a continuous-depth or recurrent residual block with a prescribed polynomial Lyapunov decay near its equilibrium. The architecture combines a fixed radial stabilizer with a learned component that is constrained to have zero radial projection, allowing slow algebraic transients and long memory while preventing asymptotic hidden-state growth.
Useful7/10
Difficulty6/10
Novelty8/10
✗ Failed on benchmark
2026
Replace an unconstrained token mixer or feed-forward residual map with a feature-conditioned rational operator whose transfer matrix is positive real on the positive orthant. Apply it through a resolvent, rather than an additive residual, so that the accretivity certificate yields a nonexpansive implicit update and suppresses activation explosions.
Useful7/10
Difficulty6/10
Novelty7/10
✓✓ Beats tuned baseline
2026
Give every possible pairwise relation its own recurrent latent state, stored in a dictionary keyed by stable node identities, instead of discarding the state whenever the edge is absent from the current graph. At each timestep, active edges retrieve their old state, update it with the current pair features and neighborhood messages, and write it back after message passing. This should improve predictions in dynamic graphs with intermittent interactions and reduce the burden on node states to…
Useful7/10
Difficulty5/10
Novelty6/10
△ Mechanism confirmed, baseline not beaten
2026
Replace the usual isotropic Gaussian random Fourier features with a frequency distribution matched to the expected spectral regularity of the target function. For coordinate fields, operator-learning maps, or PDE solution surrogates, this should place more features where the target Fourier energy lies and improve approximation at the same feature count. Stabilize the resulting feature matrix with whitening or ridge regression because spectral accuracy can create severe ill-conditioning.
Useful7/10
Difficulty4/10
Novelty5/10
△ Mechanism confirmed, baseline not beaten
2026
Replace an expensive nonlinear rollout of a recurrent or neural state-space model by a locally affine rollout whose Jacobian is evaluated once at the current state and then frozen over a short horizon. Use the resulting transition matrix as an explicit stability monitor and optionally penalize or clip its spectral radius, reducing exploding long-horizon predictions without forcing the entire nonlinear network to be globally contractive.
Useful7/10
Difficulty5/10
Novelty5/10
△ Mechanism confirmed, baseline not beaten
2026
Add an explicit transport-delay state to a recurrent neural network, state-space model, or learned optimizer whenever actions, gradients, or control inputs arrive after a fixed delay. Use the queued inputs to construct a finite-horizon predictor state and apply the neural transition or controller to that predicted state rather than to the stale state. The design transfers the paper's delay-as-transport-PDE and backstepping-to-stable-target strategy into a differentiable predictor with an…
Useful7/10
Difficulty6/10
Novelty6/10
✗ Mechanism failed
2026
Add a bounded probing perturbation to the inputs or intermediate outputs of a neural sensor-fusion model, and choose the perturbation by maximizing separation between the predicted trusted-output set and output sets induced by candidate sensor attacks. Bounded feature and measurement uncertainty are propagated through local neural Jacobians as zonotopes, giving a conservative, geometry-based exposure objective rather than relying on random noise. Training can use the resulting margin as a…
Useful7/10
Difficulty6/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Use the adapted linear latent model as a cheap receding-horizon planner or training-time controller around a nonlinear neural predictor. Optimize a short sequence of latent corrections with a quadratic objective, while constraining latent states and inputs to remain inside the region where the Koopman approximation has been identified and its transition spectrum is stable.
Useful7/10
Difficulty7/10
Novelty7/10
✗ Mechanism failed
2026
Use a spherical-design codebook and the paper's polar slack factorization to create a nonnegative geometric interaction bias for attention or expert routing. The resulting kernel is generated by a rank-one term and a rank-at-most-d term, and entries close to zero can define a structured sparse mask instead of relying only on learned top-k selection.
Useful7/10
Difficulty6/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Use several phase-locked states as distinct attractors of one recurrent network and shape their basin asymmetry through the phase-delay composite spectrum. This creates a controllable associative-memory architecture in which a desired memory receives a larger basin without adding a separate classifier or explicit nearest-neighbor lookup.
Useful7/10
Difficulty7/10
Novelty8/10