✗ Mechanism failed
2026
Replace a fixed first-order parameter update by a finite-horizon controlled local model for each important curvature mode of the network. The optimizer computes the Hamiltonian flow and its Riccati feedback gain; if the chosen horizon approaches a conjugate point, it shortens the horizon or increases control cost before the gain becomes singular. This converts the paper's finite-time transition into a measurable trust-region and scheduling mechanism for neural training.
Useful8/10
Difficulty6/10
Novelty8/10
△ Mechanism confirmed, baseline not beaten
2026
Construct a residual network from independently attachable modules, but permit only a number of modules whose aggregate feedback gain lies inside a delay-dependent admissible interval. Estimate deployed end-to-end latency and each module's local Jacobian gain, then reject or bypass additional modules when the predicted delayed-loop stability boundary is crossed. This turns variable-width or depth scaling into a falsifiable control problem rather than an empirical choice.
Useful8/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Replace a single recurrent state update with fast feature relaxation, activity evolution, and a slow adaptive state that modulates the activity vector field. Tune the activity subsystem near a controllable saddle-node so that it retains a useful transient regime for a predictable number of steps, enabling delayed switching and long-horizon memory without requiring a large hidden state.
Useful8/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
For a neural ODE, residual flow, or deep equilibrium model with a dominant polynomial component, compute the directional dynamics induced by its highest-degree homogeneous term on the unit sphere. Penalize or reject parameter regions containing radially growing attracting directions, preventing finite-time activation blow-up while preserving nonlinear dynamics in safe directions.
Useful8/10
Difficulty6/10
Novelty8/10
△ Mechanism confirmed, baseline not beaten
2026
Replace the direct Newton solve used in an implicit or equilibrium neural layer with a pseudo-arclength homotopy solve that augments the potentially singular layer Jacobian by one continuation direction. The layer can then track a solution branch through generic folds, where ordinary inversion becomes unbounded, while selecting the minimum-norm state and continuation update.
Useful8/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Replace deterministic binary-tree pooling or hierarchical feature aggregation by a stochastic merge that chooses either elementwise addition or elementwise minimum. The mixing probability p controls whether zero or sparse states proliferate or disappear, with a predicted absorbing-state transition at p = 1/2.
Useful7/10
Difficulty5/10
Novelty8/10
✗ Failed on benchmark
2026
Replace an ordinary contracting recurrent state with two spatially coupled competing latent populations whose nonlinear interaction admits a stable finite-amplitude coexistence state even when the infinitesimal invasion eigenvalue is negative. This creates hysteretic, robust memory: a representation survives small perturbations and weak evidence, but can be switched by a sufficiently large input pulse.
Useful7/10
Difficulty6/10
Novelty8/10
△ Mechanism confirmed, baseline not beaten
2026
Use the switched nonlinear extension to distinguish stability of the linearized modes from stability of the full neural dynamics. Stabilize worst-case linear products and limit the variation of each nonlinear Jacobian inside a specified radius, yielding an explicit local basin estimate and a penalty that prevents mode interactions from destroying attraction.
Useful7/10
Difficulty5/10
Novelty8/10
Unverified
2026
Use the min-plus phase transition as a training-time controller: begin near p = 1/2 to preserve the initial active-state fraction across depth, then move above or below criticality to deliberately remove or create sparse pathways. The controller uses a measurable state variable, the activation zero fraction, rather than an arbitrary regularization coefficient.
Useful6/10
Difficulty5/10
Novelty9/10
Unverified
2026
Replace an unconstrained momentum update by a bounded-acceleration, four-arc bang-bang maneuver in an augmented state containing parameter position, velocity, and an oscillator coordinate. Each micro-maneuver targets a gradient-derived displacement while ending with zero velocity and zero oscillator amplitude, so flexible or momentum-like modes do not carry ringing into the next update.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Assign separate sharpness or temperature parameters to two nonlinear subnetworks and anneal them according to a directional chart instead of driving both to their singular limits at the same rate. The optimizer explicitly tracks the ratio of the two scales and changes the schedule when the local Jacobian approaches a stability or bifurcation boundary. This tests whether the order and relative rate of sharpening, rather than only the final activation shape, controls optimization stability and…
Useful6/10
Difficulty5/10
Novelty8/10