✗ Failed on benchmark
2026
Replace an unconstrained graph-message-passing block with a port-Hamiltonian layer whose edge interactions are generated by a skew-symmetric formation-matrix coupling and whose node damping is positive semidefinite. The layer can model relative graph structure while preventing unforced hidden-state energy growth, reducing exploding activations and oversmoothing caused by arbitrary repeated propagation.
Useful8/10
Difficulty5/10
Novelty6/10
✗ Failed on benchmark
2026
Train a neural dynamical surrogate not only to reproduce measured trajectories, but also to reproduce the plant's economically optimal decision and objective value. Add a differentiable decision loss obtained by solving the surrogate's inner optimization problem, and reject models that fit observations while producing extra local optima or a shifted optimum.
Useful8/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Use the condition discriminator's residual and predictive variance to decide which unlabeled streaming samples may update a model at deployment. Only samples whose condition prediction is both calibrated and close to the currently expected condition are admitted, preventing unreliable operating regimes from causing catastrophic test-time drift.
Useful8/10
Difficulty5/10
Novelty6/10
✗ Failed on benchmark
2026
Model one period of a cyclic optimizer or periodically modulated recurrent network as a discrete-time linear time-periodic system obtained by linearizing the update around its current trajectory. Estimate a periodic Lyapunov matrix sequence and scale the next learning-rate or modulation amplitude so that every phase contracts according to a certified energy decrease. This should prevent delayed divergence caused by resonance with the schedule, even when individual phase Jacobians are…
Useful8/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Replace the global EMA update for each linear-layer momentum matrix with a delta-rule update that learns the current output-side gradient value only along the current input-key direction. Frequently occurring directions are corrected repeatedly, while rarely visited directions are not unnecessarily overwritten or uniformly decayed. Use the resulting matrix as the ordinary momentum buffer in SGD, AdamW, or another optimizer.
Useful8/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Treat a neural-network training update as a control input and impose control-barrier inequalities on quantities that must remain safe, such as parameter norm, activation variance, attention-logit magnitude, or an estimated Lipschitz margin. At each step, solve a small quadratic program that stays as close as possible to the nominal gradient update while guaranteeing a first-order forward-invariance condition.
Useful8/10
Difficulty5/10
Novelty6/10
✗ Failed on benchmark
2026
Wrap an observation-based neural policy with a real-time safety filter that accounts for uncertainty in its latent-state estimate. The policy proposes an action, while a quadratic program minimally modifies that action so a control-barrier/value function remains nonnegative for every state inside a conformally calibrated error set.
Useful8/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Wrap a learned neural controller or world-model policy with a quadratic-program projection that enforces a robust higher-order control barrier condition. The projection uses a neural estimate of hidden state variables and a certified bound on model and estimator residuals, so the nominal policy is changed only when it approaches a learned safety boundary.
Useful8/10
Difficulty5/10
Novelty5/10
✗ Failed on benchmark
2026
Replace full-precision communication in decentralized or federated optimization with a sparsified uniform quantizer whose scale decreases geometrically, while maintaining an error state at each worker. Choose the scale so that quantization disturbance decays at least as fast as the contraction of the gradient-tracking dynamics; this should preserve linear convergence instead of creating the usual fixed-quantization error floor.
Useful8/10
Difficulty5/10
Novelty5/10
✗ Failed on benchmark
2026
Train a neural policy through a differentiable dynamics model while enforcing a Control Barrier Function condition at every rollout state, rather than applying a penalty only to observed constraint violations. The barrier residual becomes a local certificate that the learned policy points inward at the boundary of the safe set, allowing safety to be checked on unseen states when combined with a margin and Lipschitz bound.
Useful8/10
Difficulty5/10
Novelty5/10
✗ Failed on benchmark
2026
Replace a standard softmax-gradient update for a probability vector with a two-stage KL Mirror-Prox update. The predictor evaluates the population-dependent cost at the current distribution, and the corrector evaluates it at the predicted distribution, reducing oscillation when routing or attention costs are coupled across tokens or samples.
Useful8/10
Difficulty5/10
Novelty5/10
✗ Failed on benchmark
2026
Train a neural vector field together with a positive-definite metric \(M_\phi(x,u)\) that certifies local contraction at a prescribed rate. The contraction penalty must include the total derivative of the input-dependent metric, so rapidly changing controls are treated as a source of geometry variation rather than incorrectly claiming stability from a frozen metric.
Useful8/10
Difficulty6/10
Novelty6/10
✗ Failed on benchmark
2026
Replace a fixed learning rate for each layer or parameter block with a bounded gain selected by the one-step-ahead predictive loss. The sign of the product between the current gradient and the next gradient estimates whether the previous update moved downhill: aligned gradients increase the gain, while sign reversals decrease it. A mirror-descent update on a bounded interval prevents the runaway step sizes that can occur with exponential or unconstrained learning-rate parameterizations.
Useful8/10
Difficulty5/10
Novelty6/10
✗ Failed on benchmark
2026
Train a graph cost predictor not only on the nominal shortest-path decision, but on budget-limited edge perturbations that cause its predicted path to disagree with the true shortest path. The perturbation is an interdiction vector that adds known delays to selected edges, forcing the model to learn path-cost margins and relative rankings rather than merely any cost function that reproduces the nominal argmin.
Useful8/10
Difficulty6/10
Novelty6/10
✗ Failed on benchmark
2026
Train a neural forecaster or policy network to preserve the pairwise ordering that determines profitable charge and discharge decisions, rather than optimizing only pointwise forecast error. Combine a conventional prediction loss with a pairwise ranking loss weighted by the economic price gap, then pass the prediction through a feasibility-aware storage scheduler.
Useful8/10
Difficulty5/10
Novelty5/10
✗ Failed on benchmark
2026
For sparse terminal-reward RL, first solve a discounted version of the fixed-policy Bellman equation to detect states with zero probability of ever reaching success. Clamp these dead states to value zero, retain successful terminal states at value one, and then run undiscounted stochastic policy evaluation and greedy improvement on the reduced state space. The clamp removes the nonunique harmonic solutions that make direct undiscounted TD unstable or initialization-dependent.
Useful8/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Replace periodic all-reduce in federated or distributed training with local broadcasts triggered by a prescribed parameter-disagreement envelope. Each worker maintains held copies of the latest parameters received from neighbors and applies a consensus correction to its local optimizer update. After an asynchronous reception causes a discontinuous change in sampled disagreement, a receiver-side exponentially decaying correction temporarily enlarges the allowable envelope, preventing false…
Useful8/10
Difficulty6/10
Novelty8/10
✗ Failed on benchmark
2026
Train the raw neural policy to anticipate the safety shield instead of relying on it indefinitely. Add the expected process-correction distance to the PPO objective and adapt its multiplier with a primal-dual update so that policy correction remains below a specified budget.
Useful8/10
Difficulty5/10
Novelty6/10
✗ Failed on benchmark
2026
Attach a quadratic-program safety filter to a neural policy that outputs a desired reference rather than directly replacing the underlying stabilizing controller. The filter uses a model of the complete closed-loop dynamics to make the smallest reference modification satisfying a control-barrier inequality, allowing aggressive neural behavior while preventing violations of state constraints.
Useful8/10
Difficulty5/10
Novelty6/10
✗ Failed on benchmark
2026
Replace nominal optimizer stability checks based only on the Hessian or Jacobian with a robust covariance tube that includes minibatch noise, Jacobian variation, and nonlinear Taylor remainders. The learning rate is accepted only when the predicted parameter covariance and domain-exit probability remain below prescribed limits, yielding a principled trust-region scheduler for nonlinear optimization dynamics.
Useful8/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Replace a slow sequence of resolvent or contractive fixed-point updates by a blockwise averaged-reflection extrapolation. The method computes reflected iterates R^j y_0, averages them with equal weights, and uses the result as the next macro-iterate. Unlike unconstrained Anderson acceleration, this construction has a uniform residual guarantee for every maximal monotone operator.
Useful8/10
Difficulty4/10
Novelty6/10
✗ Failed on benchmark
2026
Replace an unconstrained recurrent or neural-ODE state update with a copy of the known or learned plant dynamics plus a neural output-error correction, and train both the correction and a contraction metric using a pointwise matrix inequality penalty. The resulting observer should forget initialization exponentially and should amplify measurement noise by a quantitatively bounded factor rather than exhibiting unconstrained recurrent error growth.
Useful8/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Insert an online errors-in-variables subspace estimator into a latent state-space neural network. A fixed recent window of encoder features and controls is used to estimate a noise-corrected low-dimensional state subspace and refit the latent transition and readout matrices, allowing the model to follow sensor degradation or changing operating conditions without replaying the entire dataset.
Useful8/10
Difficulty6/10
Novelty6/10
✗ Failed on benchmark
2026
Model a multi-timescale optimizer as a controlled dynamical system and use several Lyapunov-like quantities to regulate loss, momentum energy, and constraint violation simultaneously. The explicit high-order control-Lyapunov feedback becomes a low-cost correction to an SGD-momentum or Adam step. A Hurwitz comparison matrix supplies a measurable stability certificate and predicts the decay rate of the controlled training dynamics.
Useful8/10
Difficulty6/10
Novelty8/10