△ Mechanism confirmed, baseline not beaten
2026
Use the paper's non-permutation-invariant overshoot bound as a runtime guard for large learning rates. A proposed step is accepted only if its predicted overshoot contribution is compatible with the observed gradient residual; otherwise the optimizer clips or shrinks the step, preventing isolated very large updates from causing delayed divergence.
Useful6/10
Difficulty4/10
Novelty7/10
✗ Mechanism failed
2026
Use the observed power-law decay of a scalar training signal to estimate the effective fractional order of the optimization dynamics, instead of choosing the memory exponent by hand. Then run a fractional-memory optimizer with the estimated order, allowing the algorithm to use stronger long-range memory during slow plateaus and weaker memory when the loss relaxes rapidly.
Useful6/10
Difficulty6/10
Novelty6/10
✗ Mechanism failed
2026
Replace the ordinary gradient of a spatially indexed parameter tensor by a Fourier-domain inverse-metric gradient. FFT the gradient over its spatial dimensions, divide every frequency by a positive spectral symbol, inverse FFT, and then apply the optimizer step. Use a Bessel/Sobolev symbol as a parameter-free baseline and optionally estimate a task-specific symbol from gradient power spectra.
Useful6/10
Difficulty4/10
Novelty6/10
✓✓ Beats tuned baseline
2026
Train an unconstrained branch and a geometry-aware branch in parallel, then learn how much to trust the analytic branch. This preserves the benefit of explicit geometry on correctly specified tasks while allowing the model to ignore a misleading or irrelevant prior.
Useful6/10
Difficulty3/10
Novelty7/10
✓ Mechanism works
2026
Replace unconstrained per-frequency recurrent dynamics in a Fourier neural operator or spectral state-space model with oscillators initialized from the plasma dispersion relation \(\omega_k=\sqrt{\underline{b}^{2}+|k|^{2}}\). Each Fourier mode first undergoes a norm-preserving rotation at its prescribed frequency, while a small learned residual and optional nonnegative damping account for task-specific dynamics. This should reduce phase drift and exploding or vanishing activations when modeling…
Useful6/10
Difficulty5/10
Novelty6/10
✗ Failed on benchmark
2026
Treat a coupled neural training loop as a delayed feedback system with two hard delays and two first-order implementation filters. Estimate the dominant coupled Jacobian mode and use the characteristic equation to distinguish a recoverable delay-induced oscillation from a filter-induced instability; then reduce stale-gradient delay only in the former case, and slow or retune EMA or relaxation filters in the latter.
Useful6/10
Difficulty5/10
Novelty6/10
✓✓ Beats tuned baseline
2026
Replace an unconstrained feature vector entering a rational or resolvent-like neural operator by a polynomial feature whose first nonzero Taylor coefficient lies in a pole-safe subspace. For a pole of order m, the simplest guaranteed construction is psi(z)=(z-beta)^m v, which makes Q(z)psi(z) bounded even when Q(z) diverges. For lower-order cancellation, solve linear constraints among Taylor coefficients of psi so that all negative Laurent powers vanish.
Useful6/10
Difficulty5/10
Novelty8/10
✗ Failed on benchmark
2026
Insert a scalar flux-correction-style limiter after a neural operator predicts a conservative state or residual. Interpolate between a known-admissible baseline state and the learned high-order candidate, choosing the largest coefficient that satisfies a geometric family of linear inequalities encoding positive density, positive pressure, and subluminal velocity. This retains as much of the neural prediction as possible instead of independently clipping physical variables.
Useful6/10
Difficulty5/10
Novelty7/10
✗ Mechanism failed
2026
Regularize a neural network's response along an ordered variable by requiring its sampled values to form a positive Hankel moment sequence. This upgrades ordinary pairwise monotonicity or log-convexity penalties into simultaneous constraints on several higher-order interactions, while remaining differentiable and inexpensive for small Hankel order.
Useful6/10
Difficulty3/10
Novelty8/10
✗ Mechanism failed
2026
Add a two-sided cone-restricted spectral penalty to a recurrent or state-space model. Instead of estimating growth using a symmetric singular-value surrogate, jointly optimize a positive right vector and positive left vector in the extended quotient from the paper, targeting a real generalized eigenvalue of the learned non-selfadjoint transition operator.
Useful6/10
Difficulty5/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Parameterize a relative-position or lag-decay function as a finite positive mixture of exponentials instead of learning arbitrary attention bias values. The resulting kernel is completely monotone on positive distances, so it is nonnegative, decreasing, and has alternating derivative signs; the mixture provides several learned memory scales without allowing oscillatory or unstable long-range biases.
Useful6/10
Difficulty4/10
Novelty7/10
✓✓ Beats tuned baseline
2026
Augment a recurrent or state-space layer with a finite-order causal Volterra compensator that models and cancels dominant nonlinear feedback around a stable linear transition. Use quadratic terms by default and add cubic terms only when the model must operate farther from equilibrium, making truncation order an explicit compute and robustness control.
Useful6/10
Difficulty5/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Wrap a learned residual policy or neural world-model controller around a stabilizing LQR feedback law, and permit sampling-based action refinement only when its estimated Monte Carlo and temperature errors fit inside a Lyapunov perturbation budget. Increase the rollout sample count, reduce temperature, or fall back to the baseline LQR action when the budget is violated. The controller should therefore trade computation for a measurable reduction in unstable or unsafe rollouts.
Useful6/10
Difficulty5/10
Novelty6/10
✗ Mechanism failed
2026
Replace pointwise spectral normalization of an RNN transition with a stability constraint on the entire family of input-conditioned matrices. Use a learned positive-definite metric P so every transition contracts in the same state geometry, approximating the paper's uniform exponential stability and input-forgetting guarantee.
Useful6/10
Difficulty5/10
Novelty6/10
✓ Mechanism works
2026
Replace spectral-radius-only stabilization of a recurrent or state-space transition matrix with a numerical-range constraint. Penalize directions in which the Hermitian part of a rotated transition matrix has a large maximal eigenvalue, controlling nonnormal transient amplification and polynomial state propagation.
Useful6/10
Difficulty5/10
Novelty7/10
✓✓ Beats tuned baseline
2026
Construct a latent layer whose node states are small positive-definite matrices and whose local updates follow a weighted cluster exchange relation rather than an unconstrained affine map. The update is reversible when the old state is retained, while noncommuting matrix products preserve relational structure that scalar cluster variables cannot represent.
Useful6/10
Difficulty6/10
Novelty8/10
✗ Mechanism failed
2026
Replace a time-dependent neural velocity field with a neural initial phase whose evolution is determined by the Madelung equations. Particles are sampled once from a reference density and then moved deterministically along the characteristic velocity field, while the quantum potential supplies a density-dependent smoothing and curvature correction.
Useful6/10
Difficulty7/10
Novelty6/10
✗ Mechanism failed
2026
Replace the usual softmax router or soft one-hot penalty with a vector-valued phase-field regularizer whose low-energy states are exactly the expert one-hot vectors. Component-wise barriers create stable categorical phases, while a weaker coupling term suppresses invalid states such as the all-zero vector or multi-expert activation; annealing \(\varepsilon\) produces increasingly discrete routing.
Useful6/10
Difficulty4/10
Novelty6/10
✗ Mechanism failed
2026
Bootstrap the optimizer curvature scale from a deliberately nondegenerate pair of gradient queries, then perform steepest descent in lp geometry with a local secant backtracking rule. The method does not require a supplied learning rate, smoothness constant L, initial distance R, or optimum value f*, and it automatically uses the dual norm associated with p.
Useful6/10
Difficulty5/10
Novelty6/10
✓✓ Beats tuned baseline
2026
Store a convex object as a direction-indexed vertex tuple and implement composition of objects through componentwise Minkowski addition and nonnegative scaling. This creates a structured residual or compositional layer where convexification is nonexpansive, making perturbation amplification controllable and avoiding repeated generic geometric optimization.
Useful6/10
Difficulty4/10
Novelty8/10
✗ Mechanism failed
2026
Replace a standard nonlinear recurrent transition with a truncated Carleman lift containing levels $z_j\approx u^{\otimes j}$, coupled by linear maps that represent quadratic, linear, and forcing terms. The resulting transition is linear in the lifted state but still expresses nonlinear dynamics in the original state, while the highest-order omitted interaction supplies an explicit truncation-defect signal that can be used for adaptive order selection or regularization.
Useful6/10
Difficulty6/10
Novelty7/10
✗ Mechanism failed
2026
Insert a weighted negative-semidefinite fourth-order mixing operator into a residual or state-space layer. Instead of learning an unconstrained token-mixing matrix, parameterize its dissipative component as Q = -a W^{-1} B^T W B, ensuring that this component cannot increase the chosen weighted feature energy. Use a boundary-aware finite-difference matrix B along the sequence axis, optionally with learnable banded coefficients while preserving the factorization.
Useful6/10
Difficulty5/10
Novelty5/10
✗ Mechanism failed
2026
Use the paper's heavy-ball recursion as a runtime diagnostic for momentum optimizers. Detect when recent parameter differences form an approximately periodic orbit or when the estimated local two-step transition matrix has spectral radius near or above one, then reduce the learning rate and momentum temporarily. This targets the failure mode proved in the paper: fixed momentum parameters can produce attracting cycles even on smooth potentials with bounded curvature.
Useful6/10
Difficulty5/10
Novelty6/10
△ Mechanism confirmed, baseline not beaten
2026
Add a diagnostic and optional regularizer that measures whether a neural block's multi-step directed interactions differ strongly when traversed forward versus backward. This catches transient directional amplification in deep acyclic or nearly nilpotent networks, which eigenvalue or spectral-radius penalties can miss because all eigenvalues may be zero even though short directed walks are large.
Useful6/10
Difficulty5/10
Novelty7/10