✗ Failed on benchmark
2026
Use the paper's finite-dimensional second-moment equations to compute the stationary covariance induced by a Markov-switched recurrent layer before training, then whiten or scale each mode's hidden state using that covariance. This can prevent mode-specific saturation and eliminate a long burn-in period in long-context RNNs and state-space models.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
When a federated or decentralized client leaves, transmit a small gradient-anchored quadratic surrogate instead of discarding its loss. The surrogate preserves the client's gradient exactly at the departure model and supplies a controlled approximation away from that point, allowing training to retain information from unavailable clients with constant memory and communication.
Useful7/10
Difficulty4/10
Novelty7/10
✗ Failed on benchmark
2026
Augment an optimizer with a measurable redistribution time for its internal state and compare it with the time scale of the changing gradient field. Use the resulting Damkohler number to interpolate between a fast quasi-static preconditioner and a history-preserving, non-equilibrium update, rather than applying one optimizer regime throughout training.
Useful7/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Treat the hidden-state evolution of an RNN or state-space model as a parameterized dynamical system and globally continue its attractors over a grid of inputs, perturbation amplitudes, and training checkpoints. Penalize or stop training when the task-relevant attractor loses basin mass, rather than relying only on local Jacobian eigenvalues at one nominal trajectory.
Useful7/10
Difficulty6/10
Novelty8/10
✗ Failed on benchmark
2026
Build a neural PDE surrogate that predicts changes in equilibrium variables rather than changes in conservative state variables. The network receives the local state and geometry, predicts an equilibrium-coordinate increment, and subtracts the network output evaluated at a reference equilibrium, forcing the reference state to have exactly zero learned residual.
Useful7/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Replace the usual averaged Jacobian test for a periodically modulated neural update with a finite harmonic-transfer model that explicitly couples perturbation frequencies separated by the modulation frequency. Use the resulting lifted spectral radius to cap the learning rate or reduce modulation amplitude when sideband interactions create an instability that is invisible in the averaged model.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Train a neural state-space model using all replayed transitions, but assign larger weights to samples near the current operating context rather than discarding distant samples. Add a strictly positive weight floor so local adaptation cannot eliminate global coverage or make the regression problem rank-deficient. This should improve prediction across nonlinear regimes while retaining the numerical robustness of full-data training.
Useful7/10
Difficulty4/10
Novelty5/10
✗ Failed on benchmark
2026
Construct a finite-range, translation-equivariant recurrent convolutional module with an absorbing inactive state, then train its local dynamics so that seeded activity crosses coarse-grained space-time blocks with probability above an oriented-percolation threshold. This should produce reliable long-range propagation without dense global attention while remaining robust to non-monotone local updates and perturbations. Block statistics also provide a diagnostic for vanishing propagation or…
Useful7/10
Difficulty5/10
Novelty8/10
✗ Failed on benchmark
2026
Use the reachability verifier as an optimization controller: permit a neural controller update only when the proposed parameter step remains inside a certified STL-safe trust region, and shrink the region when the reachable robustness margin collapses. This turns verification from an expensive final check into feedback that prevents gradient descent from crossing a temporal-logic feasibility boundary.
Useful7/10
Difficulty7/10
Novelty8/10
✗ Failed on benchmark
2026
Measure how validation forecast error grows with prediction horizon and fit exponential and Mittag-Leffler models. When the Mittag-Leffler fit is decisively better, activate a fractional-memory SSM or long-memory residual branch and use its fitted effective order to set the branch's kernel decay and horizon-loss weights; otherwise retain a conventional recurrent or finite-memory branch.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Replace an unconstrained second-order residual or state-space block with a position-velocity system whose damping is the gradient or subgradient of a convex function. Compute the next state implicitly, so the damping cannot inject energy and the resulting layer is robust to large learned damping nonlinearities, nonsmooth activations, and long rollouts.
Useful7/10
Difficulty5/10
Novelty5/10
✗ Failed on benchmark
2026
Treat the diffusion drift Lipschitz constant K as an explicit capacity knob and tune it from the amount of trajectory data. Enforce K directly with spectral normalization or a product-of-layer-norm constraint, then select among a small set of budgets using held-out return or behavior-cloning likelihood rather than allowing unconstrained networks to acquire an uncontrolled effective Lipschitz constant.
Useful7/10
Difficulty4/10
Novelty5/10
✗ Failed on benchmark
2026
Replace an unconstrained recurrent or neural-ODE vector field with a Lie-algebra-valued connection depending on time, input position, and an auxiliary spectral parameter. Train the model both for prediction and for approximate zero curvature, so evolution along different discretized paths is compatible rather than accumulating arbitrary noncommutative drift.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Attach a sampling-based rollout correction head to a neural policy or learned world model, and adapt its temperature and number of rollouts so that approximation error stays within the contraction margin of a nominal policy. The controller should spend samples only when the local state-dependent error gain is close to violating the small-gain condition, instead of using a fixed MPPI sample count everywhere.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Replace a weight-tied residual or neural-ODE stepper with an explicit Runge–Kutta method satisfying the reused-last-stage conditions. The final derivative is evaluated at the exact endpoint and becomes the first derivative of the next step, saving one expensive neural-vector-field call per step while preserving the designed integration order.
Useful7/10
Difficulty5/10
Novelty5/10
✗ Failed on benchmark
2026
Replace an opaque adaptive-optimizer state update with a small controller variable obtained by minimizing a strongly convex energy jointly associated with the proposed parameter motion. The controller is allowed to relax toward the current gradient before the parameter update, while the visible update uses the reduced energy and its envelope gradient. This creates an optimizer whose hidden geometry is optimized rather than inherited from a fixed exponential-moving-average recurrence.
Useful7/10
Difficulty6/10
Novelty6/10
✗ Failed on benchmark
2026
Replace the fixed numerical stabilizer in signSGD by an exponentially decaying stability path, so the optimizer remains sign-like for a controllable duration instead of eventually reverting toward ordinary gradient descent as gradients become small. Sweep the decay rate as an explicit implicit-bias parameter: slower annealing should retain the non-Euclidean, barrier-like bias, while faster annealing should approach the sign endpoint more closely.
Useful7/10
Difficulty4/10
Novelty6/10
✗ Failed on benchmark
2026
Use a small number of learned low-mode controls and a fixed bank of Lie words to generate structured high-mode updates. This gives a parameter-efficient adapter for spectral operators or sequence models: the trainable degrees of freedom live only in the low modes, while commutator compositions provide deterministic propagation paths to larger offsets. The design is especially suitable for fine-tuning a pretrained Fourier or state-space model under a strict parameter budget.
Useful7/10
Difficulty6/10
Novelty9/10
✗ Failed on benchmark
2026
Use the paper's parameterized invariant-torus residual and pseudo-arclength Newton correction to train a neural ODE across a continuous family of latent dynamical regimes. The continuation constraint allows the solver to pass through saddle-node folds, where stepping a physical control parameter alone would fail or jump to a different branch.
Useful7/10
Difficulty7/10
Novelty8/10
✗ Failed on benchmark
2026
Replace the sign-flip-only dynamics of high-index saddle search with low-rank inverse-curvature scaling on the estimated negative-curvature subspace. Directions with small negative Hessian eigenvalues then receive approximately curvature-independent updates instead of extremely slow updates proportional to their tiny curvature.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Build a recurrent or state-space layer whose transition matrix depends on a scalar pooled from the current hidden state. Estimate the local derivative of the scalar closure and penalize feedback gains that approach the fold threshold, preventing abrupt branch changes and excessive sensitivity.
Useful7/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Add a latent mode bank whose coordinates are learned by neural power iteration on observed state transitions rather than by jointly fitting an unconstrained latent dynamics model. Each mode is repeatedly regressed toward its one-step pushforward, normalized under the data distribution, and deflated against previously learned modes. The resulting latent coordinates are constrained to have approximately linear, diagonal dynamics, which should improve long-horizon prediction and make the…
Useful7/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Add a loss term requiring a neural optimizer or recurrent module to decrease a nonnegative Lyapunov-like energy over M update steps, rather than forcing monotonic one-step decrease. The term includes an empirically estimated mismatch allowance, so stochastic or delayed updates are tolerated while persistent instability remains penalized.
Useful6/10
Difficulty4/10
Novelty7/10
✗ Failed on benchmark
2026
Replace the usual hand-designed expert-load penalty with a heterogeneous survival penalty derived from a susceptibility distribution. Each expert receives an availability factor q_e=G(A_e), where A_e is its cumulative recent routing pressure and G_e is a learned or fixed mixture of exponentials; highly used experts are suppressed smoothly, while heterogeneous experts can have different resistance to pressure. The mixture produces adaptive curvature and long-tailed penalties that may reduce…
Useful6/10
Difficulty4/10
Novelty6/10