✗ Mechanism failed
2026
Replace a fixed first-order parameter update by a finite-horizon controlled local model for each important curvature mode of the network. The optimizer computes the Hamiltonian flow and its Riccati feedback gain; if the chosen horizon approaches a conjugate point, it shortens the horizon or increases control cost before the gain becomes singular. This converts the paper's finite-time transition into a measurable trust-region and scheduling mechanism for neural training.
Useful8/10
Difficulty6/10
Novelty8/10
✗ Mechanism failed
2026
Treat the optimization error as a Lyapunov-like state and adapt the learning rate so that its measured decrease follows a chosen stability degree. Instead of requiring exponential decrease, the controller targets dE/dt approximately equal to -c E^(1+m), which is appropriate near flat minima or marginally stable training regimes where exponential contraction may be impossible.
Useful8/10
Difficulty5/10
Novelty7/10
✗ Mechanism failed
2026
Approximate the minibatch loss Hessian by a positive-semidefinite bulk curvature plus a small signed transverse correction, and treat only the correction with explicit negative-curvature steps. This imports the paper's observation that all unstable directions can be confined to a low-dimensional subspace, producing a curvature-aware optimizer whose step-size boundary is governed by a small matrix rather than the full Hessian.
Useful8/10
Difficulty5/10
Novelty5/10
✗ Mechanism failed
2026
Train network parameters on a constrained Riemannian manifold using a loss-plus-barrier potential and a two-power normalized gradient flow. The sublinear term rapidly removes optimization errors near the target, while the superlinear term prevents arbitrarily slow convergence from distant initializations; the barrier keeps iterates inside a prescribed feasible region.
Useful8/10
Difficulty5/10
Novelty7/10
✗ Mechanism failed
2026
Represent a small neural state-update map or optimizer update by polynomial constraints and certify decrease of a polynomial Lyapunov function on the nonnegative activation or state region using successive Parrilo SOS levels. Use the monotone shift-threshold construction to distinguish genuine instability from failure of a weak certificate, and raise the SOS level only when necessary.
Useful8/10
Difficulty7/10
Novelty7/10
✗ Mechanism failed
2026
Train or initialize a Lyapunov certificate for a recurrent, state-space, or neural-ODE model on an inner set, then actively discover a larger stable state envelope instead of assuming that the certificate generalizes out of distribution. A Gaussian process models the signed stability margin or binary long-horizon outcome, and new simulations are selected where posterior uncertainty and proximity to the estimated boundary are both high.
Useful8/10
Difficulty5/10
Novelty7/10
✗ Mechanism failed
2026
Wrap a neural controller with an explicit robust-MPC shield represented by affine feedback laws indexed by polyhedral state regions. The neural action is accepted when it satisfies robust one-step constraints and a decrease condition; otherwise the shield applies the precomputed affine MPC action or the smallest correction toward it. This gives neural control fixed inference time and a verifiable fallback without solving an online quadratic program.
Useful8/10
Difficulty5/10
Novelty5/10
✗ Mechanism failed
2026
Replace a first-order optimizer update by an extrapolation point followed by one damped Newton or Newton-CG solve, while selecting the acceleration weight from an explicit cubic Hessian-Lipschitz budget. Use a displacement-based safeguard in place of the unavailable distance to the optimum, turning the proof condition into a practical trust-region-like rule that limits unstable momentum.
Useful8/10
Difficulty6/10
Novelty6/10
✗ Mechanism failed
2026
Replace a single optimizer update rule by a finite set of update modes, such as conservative SGD, momentum SGD, high-step SGD, and Adam-like preconditioned descent. Because the selected mode is applied with a one-step delay, score every candidate using a nominal predictor and choose the mode with the greatest certified decrease of a phase-dependent Lyapunov function around a short periodic optimizer orbit. This creates a controlled limit cycle in parameter or loss-state space, allowing stable…
Useful8/10
Difficulty6/10
Novelty7/10
✗ Mechanism failed
2026
Attach a hard control-barrier-function quadratic-program safety filter to a neural policy, but solve the filter with operator splitting and differentiate through its fixed-point map using projection Jacobian-vector products. The network learns the nominal action and task objective end to end, while the deployed action remains the feasible filtered action rather than an unconstrained penalty-based approximation.
Useful8/10
Difficulty6/10
Novelty6/10
✗ Mechanism failed
2026
Add a slowly updated adversarial sampler over training contexts, domain shifts, perturbation levels, or task instances. The neural network trains normally on samples from the current mixture, while a contextual bandit increases probability on contexts with high recent validation loss or catastrophic constraint violation. Unlike static domain randomization, this curriculum explicitly targets current failure modes without changing the model architecture.
Useful8/10
Difficulty4/10
Novelty5/10
✗ Mechanism failed
2026
Treat stochastic optimization as a perturbed stochastic dynamical system and adapt the magnitude of gradient noise, minibatch error, or parameter perturbations using an estimated Lyapunov decay margin. Perturbations may remain larger far from a solution, but their allowed magnitude is reduced when the local stability margin becomes small, implementing the paper's state-dependent robustness and stochastic input-to-state stability mechanism.
Useful8/10
Difficulty5/10
Novelty7/10
✗ Mechanism failed
2026
Replace the ordinary average of task or client gradients with an iterative spectral filter that removes tasks whose gradient vectors explain an anomalously large covariance direction. The global model uses the filtered gradient, while each task still maintains its own personalized parameters and local optimizer state. Unlike parameter-center regularization, the robustification acts directly on the vector messages and is designed to avoid an additional \(\sqrt d\) contamination penalty.
Useful8/10
Difficulty5/10
Novelty5/10
✗ Mechanism failed
2026
Replace a full neural-network Gauss–Newton solve with a damped solve in an adaptively constructed low-dimensional parameter subspace. The subspace contains the current gradient, recent accepted updates, Krylov curvature directions, and randomized Jacobian-curvature probes, and is enlarged whenever its projected gradient fails to capture enough descent information.
Useful8/10
Difficulty6/10
Novelty7/10
✗ Mechanism failed
2026
Partition a large graph into induced subgraphs and perform most parameter updates using only local subgraphs, interleaving them with inexpensive global updates on a randomly subsampled coarse graph. The coarse correction preserves information about cross-partition dependencies while reducing full-graph message passing and communication cost.
Useful8/10
Difficulty5/10
Novelty6/10
✗ Mechanism failed
2026
Use the behavior-subspace gap as a trust-region constraint when applying a shared update to multiple recurrent modules or experts. A proposed common update is accepted only when post-update behavior subspaces remain close to their leader and their graph subspaces remain sufficiently transverse, preventing one shared optimizer step from destabilizing dynamically different members.
Useful7/10
Difficulty6/10
Novelty9/10
✗ Mechanism failed
2026
Replace a fixed momentum and learning-rate schedule with a batch-aware stability controller derived from the paper's critical-learning-rate scalings. Polyak learning rates should scale approximately with B(1-rho), whereas Nesterov learning rates can scale as B^beta(1-rho) until reaching the base stability ceiling; this may allow larger batches without crossing the instability boundary.
Useful7/10
Difficulty5/10
Novelty6/10
✗ Mechanism failed
2026
Treat neural-network parameters as the state of a controlled dynamical system and optimize a short sequence of parameter updates instead of committing immediately to the next optimizer step. A cheap guiding optimizer, such as Adam or SGD, is rolled out to produce a moving terminal center; the lookahead optimizer is penalized or constrained when its endpoint leaves a neighborhood of that center. This transfers the paper's policy-relative feasibility and performance idea without requiring a…
Useful7/10
Difficulty7/10
Novelty7/10
✗ Mechanism failed
2026
Use an online estimate of the loss barrier separating the current basin from candidate neighboring basins to tune optimizer noise or a trust-region radius. The paper predicts that the current- or power-maximizing barrier is nonzero and approximately matched to an effective harmonic-mean temperature, U_0^* approximately equal to T_act, providing a concrete schedule for increasing or decreasing exploration.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Mechanism failed
2026
Add a bounded probing perturbation to the inputs or intermediate outputs of a neural sensor-fusion model, and choose the perturbation by maximizing separation between the predicted trusted-output set and output sets induced by candidate sensor attacks. Bounded feature and measurement uncertainty are propagated through local neural Jacobians as zonotopes, giving a conservative, geometry-based exposure objective rather than relying on random noise. Training can use the resulting margin as a…
Useful7/10
Difficulty6/10
Novelty7/10
✗ Mechanism failed
2026
Train a convex surrogate attached to a neural network, such as a sparse linear probe or adapter, and use its primal and Fenchel-dual representations to produce mutually consistent feature and sample masks. The same screening operation can be evaluated on columns of the primal design matrix or rows of the dual representation, allowing data and feature reduction without independently tuned heuristics.
Useful7/10
Difficulty5/10
Novelty6/10
✗ Mechanism failed
2026
Replace a fixed PAGE refresh schedule with a restart policy selected from the PL condition-number regime. For well-conditioned objectives, use frequent full-gradient refreshes and short inner phases; for ill-conditioned objectives, use the conventional condition-number-scaled PAGE phase length. The goal is lower component-gradient cost to a target loss while retaining PAGE's low-variance updates.
Useful7/10
Difficulty5/10
Novelty5/10
✗ Mechanism failed
2026
Replace fixed Gaussian noise in a private optimizer with generalized-Gaussian noise whose shape p is selected for the actual clipped-gradient sensitivity and privacy budget. For every candidate p, numerically find the minimum scale b satisfying the hockey-stick privacy constraint, then choose the p minimizing a gradient-update utility moment such as variance or expected absolute magnitude.
Useful7/10
Difficulty5/10
Novelty7/10
✗ Mechanism failed
2026
Constrain a set of learnable or batch-produced unit-norm embeddings by matching their spherical-harmonic power spectrum to a target spectrum rather than relying only on pairwise Euclidean repulsion. This creates an explicit, tunable mechanism for suppressing low-frequency density fluctuations or enhancing a selected angular frequency, which can improve uniformity and reduce representation collapse on hyperspherical embeddings.
Useful7/10
Difficulty5/10
Novelty7/10