△ Mechanism confirmed, baseline not beaten
2026
Replace the exact matrix-polar normalization in Muon with the smoothed feedback \(h_\epsilon(M)=M(M^\top M+\epsilon I)^{-1/2}\). This retains singular-vector-aware updates and approximately unit-normalizes dominant spectral modes, but avoids unstable behavior when the momentum matrix is rank deficient or has tiny singular values.
Useful7/10
Difficulty5/10
Novelty4/10
✗ Mechanism failed
2026
Use a finite-state Markov router to select recurrent or expert Jacobians, and regularize or optimize the router through the top Lyapunov exponent computed from state-conditioned projective statistics. The paper's mechanism predicts that this exponent varies smoothly with routing probabilities when the transition matrix is primitive and the dominant exponent is simple, while loss of primitivity, resonance, or exponent collision marks a detectable boundary where routing gradients may become…
Useful7/10
Difficulty6/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Partition a neural network into N interacting modules and constrain the Jacobian of its implicit residual map to be block diagonally dominant. Each module can compute its update locally while cross-module coupling is monitored through a normalized block-row margin. The certificate guarantees local nonsingularity of the equilibrium equations and predicts a sharp loss of robustness when the largest BDD ratio approaches one.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Keep the empirically effective post-LMO sign update, but reject it whenever a fresh minibatch estimates that it is poorly aligned with the gradient. Fall back to the gradient-side error-feedback candidate in those cases. This converts the paper's constructive divergence warning into an inexpensive runtime safeguard rather than assuming that any sign placement is universally safe.
Useful7/10
Difficulty4/10
Novelty7/10
✗ Failed on benchmark
2026
Use the disorder-controlled stability boundary as a training schedule. Start with strong damping so optimization is well behaved, then reduce the damping margin toward zero to create long-lived oscillatory state memory after the network has learned useful representations.
Useful7/10
Difficulty4/10
Novelty7/10
✗ Failed on benchmark
2026
Design distributed training workers so checkpoint service is anonymous: every active writer receives a throughput determined only by the current number of active writers, not by worker identity, age, or phase. For identical compute periods and checkpoint durations shorter than the period, this removes pairwise phase attraction and prevents deterministic checkpoint synchronization; controlled timing jitter can then be added when rapid phase mixing is desired.
Useful7/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Replace unconstrained neural-network updates by updates projected toward directions supported by a recent, regularized gradient or feature subspace. This transfers PRPC's errors-in-variables correction: directions that are weakly identified by noisy or rank-deficient minibatches receive stronger shrinkage, preventing large updates caused by accidental correlations. The method is especially suitable for recurrent, world-model, and small-data fine-tuning problems where minibatch covariance is…
Useful7/10
Difficulty6/10
Novelty6/10
△ Mechanism confirmed, baseline not beaten
2026
Replace a single parameter iterate by two coupled replicas with unequal cross-couplings: replica 1 receives a force proportional to k_1(theta_1-theta_2), while replica 2 receives a force proportional to k_2(theta_2-theta_1), with k_1 not equal to k_2. The asymmetric coupling creates a controlled circulating component in the stochastic training dynamics, potentially helping escape flat saddles or correlated minibatch-noise traps without requiring an external periodic schedule. The coupling must…
Useful7/10
Difficulty5/10
Novelty7/10
✗ Mechanism failed
2026
Construct a recurrent or state-space layer as a skew product: an expanding bounded feature coordinate drives a linearly contracting hidden state. Constrain the hidden transition matrix A to have spectral radius below one, and monitor the predicted transition ell times the absolute determinant of A equals one: below it, hidden trajectories should occupy a thin or fractal set, while above it they should have substantially higher-dimensional state coverage without losing local contraction.
Useful7/10
Difficulty5/10
Novelty7/10
✗ Mechanism failed
2026
Replace an unconstrained recurrent or state-space transition Jacobian by a passive Gram-like component plus a controlled non-reciprocal perturbation, and regularize the resulting resolvent norm. The goal is not merely to reduce eigenvalue magnitude: it is to suppress soft and highly non-normal modes whose transient amplification can destabilize long-horizon inference even when all eigenvalues appear stable.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Mechanism failed
2026
Make the observation-injection gain state dependent, increasing it only when the projected unobserved dynamics approach the Hurwitz boundary. This creates a feedback controller for latent drift while avoiding the observation-noise amplification caused by using a globally oversized gain.
Useful7/10
Difficulty7/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Add a controlled antisymmetric component to the local parameter update so optimization can circulate around ill-conditioned valleys instead of moving only along gradient directions. The symmetric component supplies dissipation, while the skew component produces the oscillatory non-reciprocal response predicted by the paper. Adapt the skew strength only while the estimated discrete-time dynamics remain stable.
Useful7/10
Difficulty6/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Use measured local Jacobian growth to set the variance of dropout, feature noise, or stochastic-depth perturbations, implementing the paper's fluctuation-response idea that multiplicative noise is tied to the positive scrambling or Lyapunov rate. The controller maintains a target growth regime instead of applying a fixed noise schedule throughout training. It predicts a stability transition when the estimated growth rate crosses zero and a variance-growth proportionality that can be tested…
Useful7/10
Difficulty4/10
Novelty6/10
△ Mechanism confirmed, baseline not beaten
2026
Augment SGD or momentum with a state observer that estimates the slowly varying component of minibatch-gradient disturbance from one-step parameter-transition residuals. Cancel the estimated disturbance with feedforward correction, then apply a curvature-dependent robust feedback gain whose closed-loop dynamics satisfy a discrete stability or bounded-gain condition.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Replace ordinary gradient descent in a chosen approximately linear parameter block with gradient descent plus a controlled negative quadratic penalty, and stop before the unstable directions explode. The finite-time spectral filter can amplify well-supported directions while retaining shrinkage or limited exposure on weak directions, which is unavailable to a stable negative-ridge endpoint.
Useful7/10
Difficulty5/10
Novelty7/10
✓✓ Beats tuned baseline
2026
Train a mixture-of-experts router by solving its regularized nonnegative simplex least-squares subproblem with a matrix-free active-set conjugate-gradient method instead of projected gradient or Adam. The router coefficients remain exactly nonnegative and sum to one, while CG rapidly solves each free-set quadratic and the active-set pivots identify sparse expert assignments.
Useful7/10
Difficulty5/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Represent the propagation of hidden states, layer states, or optimizer states by a locally estimated transfer operator and monitor its leading eigenvalue gap. When two dominant modes undergo an avoided crossing, reduce the update scale or increase damping; after the gap reopens, restore the normal schedule. This imports the paper's sharp-but-continuous pseudo-transition mechanism rather than treating instability as a binary divergence event.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Construct a robust covariance estimate of layer activations by replacing each feature with its empirical Gaussian normal score before eigendecomposition, then applying coordinate-wise nonlinear eigenvalue shrinkage rather than multiplying all eigenvalues by one scalar. Use the cleaned covariance to whiten activations or precondition updates to the associated linear layer. This targets unstable directions caused by small batches, heavy-tailed activations, and rare outliers while retaining…
Useful7/10
Difficulty6/10
Novelty6/10
✗ Failed on benchmark
2026
Replace ordinary graph propagation by diffusion with a positive node-dependent mass matrix \(\mathbf V\), so high-volume nodes update slowly and low-volume nodes update rapidly. Use node volumes as fixed metadata, a function of degree, or learned positive gates; this makes the architecture sensitive to dynamical localization that degree-normalized GCNs cannot represent.
Useful7/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Replace the raw DFA outer-product update with a damped left-right preconditioned update that whitens both presynaptic activity directions and local-error directions. The activity factor removes nuisance-dominated input anisotropy, while the error factor equalizes postsynaptic credit coordinates; separate damping prevents noisy error covariances from destabilizing training.
Useful7/10
Difficulty5/10
Novelty5/10
✗ Mechanism failed
2026
Train a recurrent or state-space network together with a periodic hidden-state trajectory, then use the Fourier-domain Hill operator of its linearized dynamics to penalize positive Floquet growth rates. The method can retain algebraic hidden-state constraints, avoiding the inaccurate practice of treating a singular descriptor matrix as invertible.
Useful7/10
Difficulty6/10
Novelty8/10
✗ Failed on benchmark
2026
Replace a stationary optimizer by a periodic two- or multi-phase schedule, such as alternating large and small learning rates, SGD and momentum, or gradients from different loss components. Stability is assessed over the complete period using the product of phase-wise linearized update maps, allowing a phase that is individually expansive to be safely combined with a contracting phase.
Useful7/10
Difficulty5/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Use small-gain diagnostics to jointly learn module normalization and a communication partition rather than imposing a fixed global spectral constraint. Clusters should be formed around high-gain feedback loops, because grouping weakly related modules cannot improve the certificate and only adds bookkeeping.
Useful7/10
Difficulty7/10
Novelty7/10
✗ Mechanism failed
2026
Replace unconditional stochastic MGDA in a multi-task network with a regularity-gated update. Compute the conflict-avoidant simplex combination when the objective-gradient geometry is sufficiently regular, but use a fixed scalarization weight when the MGDA solution is near a degenerate simplex face or changes sharply between mini-batches. The gate targets the paper's distinction between 1/2-Hölder behavior in the worst case and Lipschitz behavior on regular subproblems.
Useful7/10
Difficulty5/10
Novelty5/10