✗ Mechanism failed
2026
Replace a fixed momentum and learning-rate schedule with a batch-aware stability controller derived from the paper's critical-learning-rate scalings. Polyak learning rates should scale approximately with B(1-rho), whereas Nesterov learning rates can scale as B^beta(1-rho) until reaching the base stability ceiling; this may allow larger batches without crossing the instability boundary.
Useful7/10
Difficulty5/10
Novelty6/10
△ Mechanism confirmed, baseline not beaten
2026
Replace a purely memoryless optimizer step by a partially observed feedback controller for parameters evolving under colored, active gradient fluctuations. Estimate the hidden persistent component of the gradient from parameter displacement and observed minibatch gradients, then use that estimate to cancel predictable activity or adapt the effective update target without directly observing the latent disturbance.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Mechanism failed
2026
Treat neural-network parameters as the state of a controlled dynamical system and optimize a short sequence of parameter updates instead of committing immediately to the next optimizer step. A cheap guiding optimizer, such as Adam or SGD, is rolled out to produce a moving terminal center; the lookahead optimizer is penalized or constrained when its endpoint leaves a neighborhood of that center. This transfers the paper's policy-relative feasibility and performance idea without requiring a…
Useful7/10
Difficulty7/10
Novelty7/10
✗ Mechanism failed
2026
Use an online estimate of the loss barrier separating the current basin from candidate neighboring basins to tune optimizer noise or a trust-region radius. The paper predicts that the current- or power-maximizing barrier is nonzero and approximately matched to an effective harmonic-mean temperature, U_0^* approximately equal to T_act, providing a concrete schedule for increasing or decreasing exploration.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Mechanism failed
2026
Add a bounded probing perturbation to the inputs or intermediate outputs of a neural sensor-fusion model, and choose the perturbation by maximizing separation between the predicted trusted-output set and output sets induced by candidate sensor attacks. Bounded feature and measurement uncertainty are propagated through local neural Jacobians as zonotopes, giving a conservative, geometry-based exposure objective rather than relying on random noise. Training can use the resulting margin as a…
Useful7/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Add a fading-memory consensus force to parameter dynamics, pulling the current parameter toward a distributed average of its past while preserving the ordinary gradient step. Implement the infinite memory through one or several recursive exponential states, and tune the memory decay so that quadratic-mode dynamics remain exponentially stable. This should suppress oscillations and catastrophic steps without relying on conventional momentum alone.
Useful7/10
Difficulty4/10
Novelty6/10
△ Mechanism confirmed, baseline not beaten
2026
When a model, dataset, or parameterization has an involutive symmetry, transform gradients and curvature into symmetry sectors before applying adaptive updates. The Hessian and optimizer can then be handled as independent even and odd blocks, preventing curvature from one sector from forcing an unnecessarily conservative learning rate in the other.
Useful7/10
Difficulty4/10
Novelty6/10
△ Mechanism confirmed, baseline not beaten
2026
Treat a momentum optimizer or recurrent state update as a damped oscillatory feedback system whose local closed-loop dynamics have a cubic characteristic polynomial. Estimate local damping, oscillation frequency, and feedback gain, then cap the learning-rate or momentum gain using the cubic Routh-Hurwitz inequality so that oscillatory divergence is prevented before it appears in the loss.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Replace a fixed gradient-clipping threshold or fixed optimizer trust region by a dynamic envelope that expands when proposed parameter updates are repeatedly clipped, contracts after clipping disappears, and tightens further during sustained unsaturated convergence. This transfers the paper's bidirectional modification mechanism to training while retaining an explicit safety cap on the actual parameter update.
Useful7/10
Difficulty4/10
Novelty6/10
✗ Mechanism failed
2026
Replace a fixed PAGE refresh schedule with a restart policy selected from the PL condition-number regime. For well-conditioned objectives, use frequent full-gradient refreshes and short inner phases; for ill-conditioned objectives, use the conventional condition-number-scaled PAGE phase length. The goal is lower component-gradient cost to a target loss while retaining PAGE's low-variance updates.
Useful7/10
Difficulty5/10
Novelty5/10
✗ Mechanism failed
2026
Treat a recurrent or state-space network as a locally linear dynamical system and select a small set of hidden-state or module coordinates that have unusually high leverage on a target output through a dominant unstable or weakly damped eigenmode. Use the ranking both for red-team targeted perturbations and for defense: penalize, prune, or damp selected coordinates so that target amplification is reduced without uniformly shrinking all recurrent dynamics.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Turn a latent recurrent model into an observer that continuously corrects its hidden state from noisy or partial observations while certifying both estimation-error convergence and disturbance attenuation. The bounded-real operator inequality becomes a trainable regularizer for a neural correction gain, providing a principled alternative to unconstrained teacher forcing or ad hoc residual correction.
Useful7/10
Difficulty7/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Add an observer correction to a recurrent or state-space neural model and constrain its local dynamics so latent-state errors contract according to a quadratic Lyapunov certificate. The design tolerates nonlinear residuals that are not globally Lipschitz, provided their one-sided growth and quadratic inner-bound constants satisfy a computable matrix inequality.
Useful7/10
Difficulty6/10
Novelty8/10
✗ Failed on benchmark
2026
Add a low-dimensional feedback correction to the neural reference so that accumulated position mismatch is removed when actuator saturation or kinematic mismatch causes the shaped trajectory to lag the requested one. Unlike ordinary integral action, the correction is passed through the same feasibility-preserving reference shaper, preventing integral windup while ensuring that compensation cannot violate current, voltage, speed, or acceleration limits.
Useful7/10
Difficulty5/10
Novelty5/10
△ Mechanism confirmed, baseline not beaten
2026
Replace a fixed learning-rate and momentum rule with a low-order dynamic feedback controller mapping gradients, optimizer state, loss trends, and parameter statistics to the update magnitude. Synthesize or fit the controller against structured uncertainty in curvature, gradient noise, minibatch delay, and layerwise scaling, then enforce a worst-case closed-loop gain below one. This targets catastrophic optimization failures caused by combinations of uncertainties that are not visible in a…
Useful7/10
Difficulty8/10
Novelty8/10
✗ Mechanism failed
2026
Constrain a student policy to transform its action in the same way that the input state is transformed, while constraining its value estimate to remain unchanged. During distillation, augment every teacher-student pair with several symmetry-transformed copies and penalize disagreement after transforming the student action back to the original frame.
Useful7/10
Difficulty5/10
Novelty4/10
✓✓ Beats tuned baseline
2026
Partition a neural network into interacting modules and constrain the product of their local finite-region gains and coupling strengths so that the resulting gain matrix has spectral radius below one. This transfers the paper's small-gain-like mechanism and gives a quantitative large-signal boundary: instability or exploding activations should emerge as the spectral radius approaches one, while a weighted Lyapunov function should contract below that boundary.
Useful7/10
Difficulty5/10
Novelty6/10
✗ Mechanism failed
2026
Require Lyapunov decrease not only under the nominal learned transition, but throughout a bounded uncertainty set around that transition. The policy is therefore optimized against identification error and distribution shift rather than trusting a potentially overconfident world model.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Modify an L-BFGS curvature pair only when the observed secant curvature is negative. Replace the gradient-difference vector by the smallest Euclidean or inverse-metric correction that enforces positive curvature, then use the unmodified BFGS update and two-loop recursion. This avoids the computational and conditioning cost of adding a large isotropic damping term to the whole inverse-Hessian approximation.
Useful7/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Partition neural-network parameters into blocks and update each block using a stochastic proximal best response, followed by Krasnoselskii relaxation. The relaxation factor and minibatch size become explicit stability knobs: aggressive stochastic updates are damped, while larger batches are used when the estimated update variance approaches the mean-square stability boundary.
Useful7/10
Difficulty5/10
Novelty6/10
✗ Failed on benchmark
2026
Replace a dense Koopman autoencoder latent with a sparse code whose active-coordinate support can represent the local dynamical regime or basin. Train reconstruction, latent linear prediction, and multi-step rollout losses jointly; use the learned support as a label-free regime variable and optionally select a local transition matrix for forecasting.
Useful7/10
Difficulty5/10
Novelty5/10
✗ Failed on benchmark
2026
Replace a full Hermitian curvature matrix, such as a Hessian or empirical Fisher matrix, by its block-diagonal version only when the paper's perturbation certificate predicts a small eigenvalue change. Use the certificate online to merge poorly separated blocks and retain independent preconditioners for well-separated blocks, yielding a controllable accuracy-memory tradeoff rather than a fixed block-diagonal approximation.
Useful7/10
Difficulty6/10
Novelty5/10
△ Mechanism confirmed, baseline not beaten
2026
Replace an unconstrained recurrent or state-space update with a delayed continuous-time hidden-state block and constrain its local closed-loop Jacobian using an output-to-output dissipativity LMI. The certificate bounds amplification from external perturbations, such as corrupted observations, injected hidden-state noise, or delayed-input errors, to the task output. Training rejects or penalizes parameter updates for which the certified gain becomes too large.
Useful7/10
Difficulty7/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Wrap a neural policy with a backup controller synthesized by finite-horizon SOS backward reachability. The neural policy is used whenever it remains inside the certified feasible region; otherwise, a time-indexed backup controller drives the state into a terminal-safe set while respecting actuator limits.
Useful7/10
Difficulty7/10
Novelty7/10