△ Mechanism confirmed, baseline not beaten
2026
Replace a fixed learning-rate and momentum rule with a low-order dynamic feedback controller mapping gradients, optimizer state, loss trends, and parameter statistics to the update magnitude. Synthesize or fit the controller against structured uncertainty in curvature, gradient noise, minibatch delay, and layerwise scaling, then enforce a worst-case closed-loop gain below one. This targets catastrophic optimization failures caused by combinations of uncertainties that are not visible in a…
Useful7/10
Difficulty8/10
Novelty8/10
✓✓ Beats tuned baseline
2026
Use a fixed sparse graph for local message passing, but let each edge input be generated recursively from non-adjacent node states or latent states. This represents long-range interactions without densifying the graph, while retaining an explicit separation between local edge physics and learned global feedback.
Useful7/10
Difficulty5/10
Novelty6/10
△ Mechanism confirmed, baseline not beaten
2026
Construct a recurrent layer whose hidden states evolve as directed phase oscillators with a prescribed nonzero common frequency and fixed phase offsets. Train task-relevant dynamics in the quotient space that removes the global phase-shift direction, so a rotating latent representation is not incorrectly penalized as unstable.
Useful7/10
Difficulty6/10
Novelty7/10
✓✓ Beats tuned baseline
2026
Partition a neural network into interacting modules and constrain the product of their local finite-region gains and coupling strengths so that the resulting gain matrix has spectral radius below one. This transfers the paper's small-gain-like mechanism and gives a quantitative large-signal boundary: instability or exploding activations should emerge as the spectral radius approaches one, while a weighted Lyapunov function should contract below that boundary.
Useful7/10
Difficulty5/10
Novelty6/10
✗ Mechanism failed
2026
Require Lyapunov decrease not only under the nominal learned transition, but throughout a bounded uncertainty set around that transition. The policy is therefore optimized against identification error and distribution shift rather than trusting a potentially overconfident world model.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Use the random-attractor construction as a training and inference diagnostic: initialize latent trajectories far in the past with different states but the same recent noise sequence, then measure whether they contract toward the same current set. This detects whether a stochastic recurrent model has a bounded, reproducible random attractor or instead exhibits discretization-induced divergence and spurious long-term modes.
Useful7/10
Difficulty4/10
Novelty8/10
✗ Failed on benchmark
2026
Partition neural-network parameters into blocks and update each block using a stochastic proximal best response, followed by Krasnoselskii relaxation. The relaxation factor and minibatch size become explicit stability knobs: aggressive stochastic updates are damped, while larger batches are used when the estimated update variance approaches the mean-square stability boundary.
Useful7/10
Difficulty5/10
Novelty6/10
✗ Failed on benchmark
2026
Replace a recurrent update by a time-inhomogeneous random choice among candidate maps, and regulate the candidate Jacobian gains so that the expected product of gains contracts geometrically. This should make hidden-state distributions forget their initial state even when the map family and selection probabilities vary over time, improving long-horizon stability without requiring every individual candidate map to be strongly contractive.
Useful7/10
Difficulty5/10
Novelty6/10
△ Mechanism confirmed, baseline not beaten
2026
Replace an unconstrained recurrent or state-space update with a delayed continuous-time hidden-state block and constrain its local closed-loop Jacobian using an output-to-output dissipativity LMI. The certificate bounds amplification from external perturbations, such as corrupted observations, injected hidden-state noise, or delayed-input errors, to the task output. Training rejects or penalizes parameter updates for which the certified gain becomes too large.
Useful7/10
Difficulty7/10
Novelty7/10
✗ Failed on benchmark
2026
Wrap stochastic optimization or iterative neural inference in a controller that measures how far the state distribution moves during each interval and compares this motion with the available noise-dependent entropy-production budget. The controller increases the learning rate or reduces inference steps only while the trajectory remains inside the predicted speed-limit region, preventing fast jumps that cause accuracy collapse.
Useful7/10
Difficulty5/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Wrap a neural policy with a backup controller synthesized by finite-horizon SOS backward reachability. The neural policy is used whenever it remains inside the certified feasible region; otherwise, a time-indexed backup controller drives the state into a terminal-safe set while respecting actuator limits.
Useful7/10
Difficulty7/10
Novelty7/10
✗ Failed on benchmark
2026
Attach a robust, horizon-dependent uncertainty tube to a recurrent neural state-space model or learned policy. Instead of training only the nominal rollout, propagate state-estimation, model, and disturbance uncertainty through local Jacobians and impose a loss that keeps the tube inside task constraints. The method should be especially useful when short-horizon predictions are accurate but small Jacobian gains cause long-horizon divergence.
Useful7/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Partition neural-network parameters into competing blocks, such as LoRA adapters, mixture-of-experts heads, or task-specific heads, and update each block by minimizing its local quadratic model while holding the other blocks fixed. Use the exact Jacobi coupling spectral radius to decide whether simultaneous updates are stable; near the boundary, apply damping or fall back to sequential Gauss-Seidel updates.
Useful7/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Wrap a neural policy with an online disturbance estimator and a zonotopic reachability shield. Instead of rejecting actions using a permanently worst-case disturbance set, update the disturbance zonotope from observed transition residuals and accept an action only when the resulting reachable set remains inside the safe region.
Useful7/10
Difficulty6/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Add a curvature-margin regularizer to a neural latent-state estimator or world model so that every initial-state direction is sufficiently constrained by the observation history and prior. The regularizer targets the smallest posterior-curvature eigenvalue, not total information, making the estimator resistant to systematic transition-model mismatch in poorly observed latent directions.
Useful7/10
Difficulty5/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Apply the paper's compositional PAS idea to recurrent or state-space networks by propagating a polytope of possible hidden states and input perturbations over multiple time blocks. Instead of validating one hidden trajectory at a time, maintain a trusted convex family and re-linearize only when its nonlinear-fidelity tolerance is exceeded. This creates a runtime monitor and adaptive horizon mechanism for long-sequence inference, forecasting, and learned world models.
Useful7/10
Difficulty7/10
Novelty8/10
△ Mechanism confirmed, baseline not beaten
2026
Represent a family of nearby neural-network parameter updates by a low-dimensional polytope around the current parameters, and retain only the convex inner region whose predicted nonlinear training dynamics remain close to actual dynamics. Optimize the training objective over this trusted family with a small quadratic program rather than testing many independent candidate steps. The method turns a scalar learning-rate choice into a reusable set of jointly safe update directions.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Treat the optimized surrogate and the training trajectory as objects that require a decision-level audit. Use multistart optimization to count phantom optima, and periodically evaluate whether stochastic training has changed the surrogate optimum even when validation prediction error remains nearly constant; stop, roll back, or average checkpoints when decision drift exceeds a threshold.
Useful7/10
Difficulty4/10
Novelty8/10
✗ Failed on benchmark
2026
Constrain a recurrent or state-space neural network to keep its hidden state inside an ellipsoid that is robustly invariant under bounded feature inputs, hidden-state perturbations, and model mismatch estimated from offline trajectories. The ellipsoid and a stabilizing recurrent gain are fitted from data through an SDP-inspired certificate, then used either as a training regularizer or as a projection layer at inference time.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
For a neural network with a trainable linear head or low-rank adapter, store feature vectors from recent minibatches and select a finite set that is sufficiently independent. Apply Modified Gram-Schmidt to obtain orthonormalized memory directions, then add residual corrections along these directions so the local parameter-error dynamics have an identity coefficient matrix rather than a poorly conditioned empirical Gramian. The method predicts a sharp transition after the buffer first contains…
Useful7/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Train a neural controller or learned dynamics model against a finite-horizon set-valued certificate rather than only sampled trajectories. Represent uncertain states and bounded disturbances with hybrid zonotopes, propagate them through affine dynamics and a piecewise-linear neural network, and penalize reachable-set violations and failure to contract into a terminal set. This turns rare worst-case failures into a directly optimized geometric objective.
Useful7/10
Difficulty7/10
Novelty7/10
✗ Mechanism failed
2026
Build a recurrent or state-space network from heterogeneous dynamical modules and characterize each module through sampled frequency-response passivity and Davis–Wielandt shell bounds. Constrain inter-module coupling so that the composed frequency response retains a positive passivity margin, providing a model-based alternative to blindly shrinking all recurrent weights.
Useful7/10
Difficulty6/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Replace an unconstrained neural ODE or recurrent update field with the negative gradient of a learned scalar energy \(E_\theta(z,t)\). The resulting hidden-state dynamics have an exact Lyapunov certificate: energy decreases continuously, bounded trajectories cannot exhibit nonstationary recurrence, and the Łojasiewicz mechanism predicts convergence to a single equilibrium rather than persistent oscillation or chaos.
Useful7/10
Difficulty5/10
Novelty6/10
✗ Mechanism failed
2026
Treat stochastic optimization with a time-dependent learning-rate, momentum, weight-decay, or data-mixture schedule as a nonautonomous Markov process. Estimate the entropy production of each parameter trajectory by comparing its forward transition likelihood with the likelihood under a separately simulated optimizer driven by the reversed schedule, then use this estimate to adapt the learning rate or injected gradient noise. The controller is designed to remain in a low-dissipation regime…
Useful7/10
Difficulty6/10
Novelty8/10