✓✓ Beats tuned baseline
2026
Use a neural network to predict an operating point or latent state, then pass it through a sparse differentiable implicit layer that solves governing nonlinear equilibrium equations. This replaces soft physics penalties with an exact or tightly solved equality projection and can be combined with primal-dual inequality handling and deterministic restoration.
Useful9/10
Difficulty7/10
Novelty5/10
✓✓ Beats tuned baseline
2026
Replace a purely nonlinear recurrent transition with a learned observable map followed by an explicitly linear latent evolution model. Include the original latent state and a small set of nonlinear observables, and update the linear transition online with forgetting-factor recursive least squares when the environment or task dynamics change.
Useful8/10
Difficulty6/10
Novelty6/10
△ Mechanism confirmed, baseline not beaten
2026
Build a continuous-time or discretized recurrent network whose interaction graph has trainable magnitudes and phase delays, then regularize the spectrum of the phase-corrected interaction matrix around each desired latent phase-locked state. The cosine-weighted composite matrix determines whether perturbations contract or grow, providing a computable stability margin instead of relying only on empirical exploding-gradient detection.
Useful8/10
Difficulty5/10
Novelty7/10
✗ Mechanism failed
2026
Train a latent state-space neural network so that its effective pole geometry remains consistent when identified by low-frequency moments and finite-window trajectories. Penalize disagreement between the two reductions, and penalize proximity to the oscillatory/non-oscillatory boundary, to reduce spurious ringing after distillation or context truncation.
Useful8/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Replace selected residual, recurrent, or state-space blocks by modules whose input-output Jacobians satisfy an IODP inequality throughout a prescribed activation domain. The constraint controls incremental amplification between two trajectories without requiring either trajectory to remain near one fixed equilibrium, so it should improve robustness to changing contexts and prevent exploding long-horizon sensitivities.
Useful8/10
Difficulty6/10
Novelty6/10
✗ Failed on benchmark
2026
Replace dense attention over structured object tokens with attention over role-filler tensor-product representations. A learned query specifies both a role and a filler, retrieves objects matching that binding, extracts a target role, and rebinds the extracted filler into an output object.
Useful8/10
Difficulty5/10
Novelty6/10
△ Mechanism confirmed, baseline not beaten
2026
Replace an unconstrained neural ODE vector field with a learned port-Hamiltonian vector field whose energy gradient drives the dynamics, whose interconnection matrix is skew-symmetric, and whose dissipation matrix is positive semidefinite. The resulting model remains expressive through state-dependent neural matrices while guaranteeing non-increasing learned energy in the unforced case.
Useful8/10
Difficulty5/10
Novelty6/10
△ Mechanism confirmed, baseline not beaten
2026
Represent a learned optimizer or recurrent training controller as a discrete-time feedback system and certify its sensitivity to one-sample dataset replacement using an IQC dissipativity inequality. Penalize the smallest certified disturbance-to-state gain during meta-training or use it as a post-training acceptance test, favoring update dynamics that do not amplify microscopic data perturbations over many iterations.
Useful8/10
Difficulty6/10
Novelty8/10
✗ Failed on benchmark
2026
Add an observability objective to an RNN so that a finite trajectory of selected hidden coordinates preserves information about the initial hidden state. The regularizer maximizes the smallest singular value or log determinant of the finite-horizon observation Jacobian, counteracting ReLU activation masks that erase hidden-state directions.
Useful8/10
Difficulty6/10
Novelty7/10
✗ Mechanism failed
2026
Train a neural policy together with a positive neural Lyapunov function so that the learned closed-loop transition decreases the function at every sampled state in a prescribed operating region. This converts policy learning from an unconstrained reward problem into a constrained dissipativity problem and provides an inference-time monitor that can reject or damp actions when the certificate is violated.
Useful8/10
Difficulty5/10
Novelty6/10
✗ Mechanism failed
2026
Represent a small neural state-update map or optimizer update by polynomial constraints and certify decrease of a polynomial Lyapunov function on the nonnegative activation or state region using successive Parrilo SOS levels. Use the monotone shift-threshold construction to distinguish genuine instability from failure of a weak certificate, and raise the SOS level only when necessary.
Useful8/10
Difficulty7/10
Novelty7/10
✗ Mechanism failed
2026
Replace ordinary topology-sensitive message passing with scalar-gated aggregation followed by an explicit correction that aligns local node states with a graph-wide consensus component. The correction should make node embeddings less sensitive to line or edge removals while preserving local information needed for prediction. This is suitable for graph neural networks and graph-based world models exposed to changing graph sizes or sparsity patterns.
Useful8/10
Difficulty5/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Use the exact Kac–Ward conditional sampler as an oracle teacher for a neural autoregressive distribution over planar Ising configurations. At each prefix, supervise the network with the exact next-spin probability rather than only a sampled next spin, then retain the oracle as an evaluation and active-correction mechanism for prefixes where the student is inaccurate. This converts an approximate variational sampler into a calibrated amortized approximation with an exact, independently sampled…
Useful8/10
Difficulty6/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Replace penalty-based orthogonality training for an \(n\times k\) weight or feature matrix \(X\) with a projected spectral flow driven by a symmetric matrix \(A\), such as a minibatch covariance or task-derived curvature estimate. The update rotates the subspace toward the top or bottom eigenspaces while preserving \(X^{\top}X=I_k\) through QR or Cayley retraction, avoiding the ill-conditioning caused by large orthogonality penalties.
Useful8/10
Difficulty5/10
Novelty7/10
✓✓ Beats tuned baseline
2026
Replace pointwise prediction of the next field with prediction of a learned flux followed by a discrete divergence. Combine Fourier spatial mixing with a causal temporal kernel over the recent resolved-history slab, so the model learns finite-memory closure effects while preserving local conservation exactly under periodic or compatible boundary conditions. The architecture should reduce spurious mass drift and improve autoregressive rollout stability on coarse-grained PDE data.
Useful8/10
Difficulty5/10
Novelty6/10
✗ Failed on benchmark
2026
Treat a neural-network training update as a control input and impose control-barrier inequalities on quantities that must remain safe, such as parameter norm, activation variance, attention-logit magnitude, or an estimated Lipschitz margin. At each step, solve a small quadratic program that stays as close as possible to the nominal gradient update while guaranteeing a first-order forward-invariance condition.
Useful8/10
Difficulty5/10
Novelty6/10
△ Mechanism confirmed, baseline not beaten
2026
Train and select neural ODE architectures using parameter sensitivities and Fisher information, so that a model is penalized or rejected when different parameters produce nearly indistinguishable trajectory effects. The neural component remains inside the ODE vector field, but its width, depth, and parameterization are selected using predictive error together with the smallest Fisher-information eigenvalue, effective rank, and confidence intervals.
Useful8/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Wrap a learned neural controller or world-model policy with a quadratic-program projection that enforces a robust higher-order control barrier condition. The projection uses a neural estimate of hidden state variables and a certified bound on model and estimator residuals, so the nominal policy is changed only when it approaches a learned safety boundary.
Useful8/10
Difficulty5/10
Novelty5/10
✓✓ Beats tuned baseline
2026
Replace a generic first-order predictor for an aggregate observation with a second-order observable-reduced dynamics module derived by eliminating hidden active and quiescent compartments. Train a neural network only for the unknown growth function while enforcing the exact coefficient structure induced by switching rates, so the model cannot exploit a trajectory-fitting but mechanistically incorrect latent representation.
Useful8/10
Difficulty5/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Construct a finite nondeterministic abstraction of an RNN or neural state-space model by partitioning its hidden-state domain into cells and adding every abstract transition that could contain a concrete successor. Use temporal-logic counterexamples to refine only cells involved in violating paths instead of globally increasing discretization resolution. This provides a falsifiable bridge between long-horizon neural dynamics and formal safety or attractor analysis.
Useful8/10
Difficulty7/10
Novelty8/10
△ Mechanism confirmed, baseline not beaten
2026
Add an explicit unknown-frame variable to a recurrent world model or multimodal sensor-fusion network, and train it only on temporal windows whose latent motion provides enough excitation to identify that frame. The model should use a two-view or multi-view consistency loss and an adaptive gate based on the smallest singular value of the window Jacobian, preventing optimization from confidently fitting geometrically ambiguous trajectories.
Useful8/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Train a neural vector field together with a positive-definite metric \(M_\phi(x,u)\) that certifies local contraction at a prescribed rate. The contraction penalty must include the total derivative of the input-dependent metric, so rapidly changing controls are treated as a source of geometry variation rather than incorrectly claiming stability from a frozen metric.
Useful8/10
Difficulty6/10
Novelty6/10
△ Mechanism confirmed, baseline not beaten
2026
Replace the ordinary gradient step by an update preconditioned by parameter directions actually excited by the observed part of the input. In a neural network, approximate this geometry with a masked Jacobian Gramian and damp directions with low observability, preventing arbitrary drift of parameters associated with missing features.
Useful8/10
Difficulty6/10
Novelty6/10
✗ Mechanism failed
2026
For z neural branches that share a target, state, or routing observation, add a penalty on fluctuations in the branch direction visible to that shared signal. This implements the paper's centered-square conditioning mechanism: branches remain locally independent in hidden directions, while collective deviations that would produce inconsistent shared outputs are suppressed.
Useful8/10
Difficulty4/10
Novelty7/10