△ Mechanism confirmed, baseline not beaten
2026
Turn an iterative optimization or equilibrium computation inside a neural network into a differentiable layer whose backward pass solves the implicit adjoint system with conjugate gradients or GMRES using only automatic-differentiation matrix-vector products. This avoids storing unrolled iterations and avoids explicit Hessian or Jacobian construction, enabling longer solver horizons and lower-memory implicit architectures.
Useful8/10
Difficulty6/10
Novelty5/10
△ Mechanism confirmed, baseline not beaten
2026
Build a forward-mode second-order jet interpreter for the PINN and evaluate the entire PDE residual in one compiled graph. Each intermediate carries its value, first derivative, and Hessian with respect to the collocation coordinates, avoiding repeated nested reverse-mode autodiff calls for every residual component.
Useful8/10
Difficulty5/10
Novelty6/10
✗ Failed on benchmark
2026
Group W consecutive diffusion or flow-model loss terms and approximate every intermediate parameter Jacobian by a time-weighted interpolation of the Jacobians at the group’s two endpoints. Sum the intermediate upstream signals into two endpoint cotangents, then perform only two full DiT backward passes instead of W. Add a cosine-similarity gate comparing predicted and actual intermediate velocity changes so that groups violating the local-linearity assumption use exact backpropagation.
Useful8/10
Difficulty6/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Replace uniform collocation for a fixed random-feature neural PDE solver with sampling from the leverage-score density of the operator-applied features. Whiten the retained residual feature space before solving for output coefficients, so the sampled least-squares matrix has an identity-like expected Gram rather than inheriting severe anisotropy from the differential operator. The same construction can be used for a linearized neural network by treating Jacobian features as the trial functions.
Useful8/10
Difficulty5/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Replace full-dimensional node or weight perturbation with perturbations in an input-conditioned d-dimensional tangent subspace, where d is the input or feature dimension and is much smaller than the reservoir width or parameter count. Estimate the update using only scalar self-supervised losses from positive and negative perturbations, then map the low-dimensional update back to the trainable parameters.
Useful8/10
Difficulty5/10
Novelty7/10
✗ Mechanism failed
2026
Replace the standard squared pointwise PDE residual in an elliptic PINN by its discrete $H^{-1}$ norm. The residual is passed through an inverse Dirichlet Laplacian, reducing the dominance of rapidly varying residual modes and acting as a mathematically specified preconditioner for the PINN training gradients.
Useful8/10
Difficulty5/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Replace ordinary low-precision multiply-add accumulation in selected neural-network reductions with a two-word floating-point accumulator updated by the paper's branch-free DW-FMA network. The high word retains the main sum and the low word stores the rounding residual, improving cancellation behavior without the control-flow divergence of conditional compensated summation.
Useful7/10
Difficulty5/10
Novelty6/10
Unverified
2026
Train a finite-element surrogate by minimizing the assembled discrete potential energy rather than a loss against solved displacement labels. The objective uses only the sparse stiffness matrix and load vector, while its exact energy-gap identity makes it equivalent to supervised regression in the stiffness norm.
Useful6/10
Difficulty3/10
Novelty5/10
Unverified
2026
Instrument selected neural-network operators with cheap stochastic perturbations and estimate how much their outputs change under finite-precision perturbations. Use the resulting per-operator score to identify unstable kernels and selectively switch them to FP32, compensated accumulation, or a stable reformulation instead of running the entire model at high precision.
Useful6/10
Difficulty5/10
Novelty6/10
✗ Failed on benchmark
2026
Use the paper's negative-semidefinite interaction curvature to detect and compensate for destructive coupling among layerwise learning-rate, momentum, or preconditioner mechanisms. Instead of independently tuning mechanism amplitudes, estimate their reduced curvature after hidden optimizer states relax, then apply a low-rank trust-region step or freeze mechanisms whose interaction curvature is too negative.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace uniformly sampled minibatches with batches selected from a small IID candidate pool to match the pool's statistics in a restricted learned feature space. The selection objective is the neural-training analogue of minimizing treatment-assignment imbalance, so the batch should produce a lower-variance estimate of the population gradient for functions represented by those features.
Useful5/10
Difficulty4/10
Novelty5/10
Unverified
2026
Exploit the paper's nested obstruction hierarchy by applying cheap low-order Hankel tests to every example and evaluating larger matrices only for outputs near the current feasibility boundary. This turns higher-order structural validation into an adaptive curriculum rather than an always-on expensive eigendecomposition.
Useful4/10
Difficulty5/10
Novelty8/10