✗ Mechanism failed
2026
Replace a globally chosen constant learning rate with a blockwise rate calibrated to the local flatness exponent of the objective. If the local Hessian decays like \(\|x-x_\star\|^{m-2}\), choose the rate so that the predicted stationary parameter radius \(\alpha^{1/m}\) matches a prescribed exploration or optimization radius, rather than incorrectly using the quadratic rule \(\sqrt{\alpha}\).
Useful7/10
Difficulty5/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Replace uniform tuning of neural-network hyperparameters with a Pick-to-Learn-style compression procedure that selects the few scenarios most informative for constraint satisfaction. A scenario can be a domain-randomization seed, adversarial perturbation, task instance, or rollout. Tune the network or optimizer on the selected compression set, then evaluate fresh scenarios using a finite-sample certificate for the probability of violating a prescribed robustness, safety, or stability constraint.
Useful7/10
Difficulty5/10
Novelty7/10
✗ Mechanism failed
2026
Train a neural policy against the same dynamically reconstructed barrier used during inference. Penalize barrier violations using the current observer uncertainty margin, causing the policy to avoid states where safety would require large corrective projections.
Useful7/10
Difficulty5/10
Novelty7/10
✗ Mechanism failed
2026
Treat parameter-space curvature modes as RG momentum shells and use a smooth cutoff to construct a scale-dependent preconditioner rather than abruptly clipping eigenmodes. The optimizer should expose measurable crossovers between overdamped, KPZ-like, and nearly inviscid relaxation, allowing the learning rate and damping to change at empirically detected transitions instead of following a fixed schedule.
Useful7/10
Difficulty6/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Replace ordinary momentum-like accumulation with a PI controller whose integral state is reset when the proportional error changes sign, indicating that the trajectory has crossed its local target. Apply the mechanism to each parameter block or to a scalar block residual, and impose a dwell time so that minibatch noise cannot trigger arbitrarily frequent resets.
Useful7/10
Difficulty5/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Add a learned phase coordinate to an RNN, state-space model, or latent neural ODE and train it to advance at constant angular velocity along recurrent trajectories. This separates genuine phase progression from amplitude and embedding distortions, encouraging coherent long-horizon oscillations while providing a quantitative monitor for impending loss of a limit cycle.
Useful7/10
Difficulty5/10
Novelty7/10
✗ Mechanism failed
2026
Replace unconditional stochastic MGDA in a multi-task network with a regularity-gated update. Compute the conflict-avoidant simplex combination when the objective-gradient geometry is sufficiently regular, but use a fixed scalarization weight when the MGDA solution is near a degenerate simplex face or changes sharply between mini-batches. The gate targets the paper's distinction between 1/2-Hölder behavior in the worst case and Lipschitz behavior on regular subproblems.
Useful7/10
Difficulty5/10
Novelty5/10
△ Mechanism confirmed, baseline not beaten
2026
Turn a path-complete graph into a stability regularizer for a recurrent or state-space neural network whose update can switch among M learned operators. Maintain a neural quadratic or positive scalar certificate V_alpha for each graph node and penalize every graph edge that violates contraction under its corresponding operator. The resulting architecture is designed to remain stable even when the mode sequence is arbitrary rather than generated by a trained gate.
Useful7/10
Difficulty6/10
Novelty8/10
△ Mechanism confirmed, baseline not beaten
2026
Use the family predictor not only as a post-processing estimator but also as a feedback controller for data collection. Reweight Monte Carlo proposals or minibatch selection toward under-sampled families whose signed contribution and predictive uncertainty are large, rather than spending samples on already well-known positive families.
Useful7/10
Difficulty6/10
Novelty5/10
✗ Failed on benchmark
2026
Fine-tune a denoiser by matching its action to a target-domain proximal operator, instead of minimizing only pixelwise denoising error. Apply the loss on the intermediate states and noise levels actually encountered by the downstream iterative solver, so the adaptation directly reduces the error that controls PnP reconstruction stability.
Useful7/10
Difficulty5/10
Novelty6/10
△ Mechanism confirmed, baseline not beaten
2026
Train a conditional flow-matching model against a sequence of intermediate states generated by an expensive optimisation or refinement process, rather than only matching noise to the final sample. The resulting vector field should require fewer inference steps and remain closer to the solver's feasible trajectory than endpoint-only flow matching.
Useful7/10
Difficulty5/10
Novelty6/10
✓✓ Beats tuned baseline
2026
Replace the usual projected gradient step with a relaxed projection in a positive-definite metric that changes with the current parameter state. The metric acts as a continuous preconditioner before projection, so updates can be large along poorly conditioned directions while remaining feasible.
Useful7/10
Difficulty5/10
Novelty6/10
△ Mechanism confirmed, baseline not beaten
2026
Replace ordinary gradient descent or momentum with a discrete PI update whose integral gradient state is accumulated only while the gradient direction remains consistent. When the proportional gradient term changes sign, reset the integral state, preventing stale gradients from producing overshoot near minima or after sharp curvature changes.
Useful7/10
Difficulty4/10
Novelty6/10
△ Mechanism confirmed, baseline not beaten
2026
Replace a fixed temperature schedule in a population-based, derivative-free neural-network optimizer with a feedback controller driven by the entropy of candidate importance weights. When candidate losses are diffuse, the optimizer cools rapidly to exploit progress; when one or a few candidates dominate, cooling slows to prevent irreversible population collapse and loss of exploration.
Useful7/10
Difficulty5/10
Novelty6/10
✓✓ Beats tuned baseline
2026
Treat unresolved inference items as active threats and allocate a fixed budget of C module evaluations per round. Each evaluation has an item-dependent probability of completing the item, while the scheduler observes only completion or failure after the round. Use fair allocation when completion probabilities are unknown or nearly homogeneous, then switch to a marginal-success greedy policy as feedback estimates become reliable.
Useful7/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Use a two-mode optimizer: a learned preconditioned update for normal training and a bounded contractive fallback when the learned update is predicted to increase a monitored energy. Use separate entry and exit thresholds so minibatch noise does not cause rapid switching.
Useful7/10
Difficulty5/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Replace a network head that independently predicts coupled physical source terms with a low-dimensional rate head followed by a fixed stoichiometric map. This makes conservation of total mass or other linear invariants exact by construction and leaves the network responsible only for learning the kinetics of admissible exchange channels.
Useful7/10
Difficulty3/10
Novelty6/10
✗ Failed on benchmark
2026
When a neural network is placed inside a Newton, SQP, or interior-point optimization loop, replace its ReLUs only in the embedded inference graph by a smooth algebraic approximation. The approximation is uniformly close to ReLU but has well-defined first and second derivatives, improving Hessian-based action optimization without retraining or changing the learned weights.
Useful7/10
Difficulty3/10
Novelty4/10
△ Mechanism confirmed, baseline not beaten
2026
Maintain a posterior over heterogeneous neural policies, simulate each policy on the same revealed disturbance sequence, and track a posterior-weighted counterfactual reference instead of directly switching among deployed policies. A stabilizing feedback correction keeps the physical state close to the reference, while exponential-weights updates favor policies with low counterfactual cost.
Useful7/10
Difficulty5/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Train a generative watermark so that its information about the payload is deliberately distributed across positions or overlapping windows instead of being concentrated in a few easily cropped tokens. The objective uses the paper's conditional information profile and the footprint-resolution lower bound to select the smallest carrier support compatible with a target crop size, while preserving generation quality outside that support.
Useful7/10
Difficulty5/10
Novelty7/10
✓✓ Beats tuned baseline
2026
Use a bounded stochasticity control during an initial preparation window to shape the gradient or parameter-update distribution before ordinary training. The control is restricted to its minimum or maximum value, with at most one switch, because the reduced moment dynamics are affine in the control; this gives a falsifiable alternative to smooth noise or learning-rate annealing.
Useful7/10
Difficulty5/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Train a matrix-valued neural layer under an exact or near-exact Stiefel constraint while using an l1 or row-group sparsity penalty. During early training, use manifold proximal-gradient steps to identify a stable nonzero support; once the support stops changing, switch to Newton-CG steps restricted to the smooth intersection of the Stiefel tangent space and the fixed-support subspace. This can reduce the number of optimizer iterations needed to obtain sparse, well-conditioned projections.
Useful7/10
Difficulty6/10
Novelty7/10
✓✓ Beats tuned baseline
2026
Add an exact linear-constraint projection to the output solve of a neural operator or physics-informed model. The network produces an unconstrained prediction or coefficient vector, while a small constrained least-squares layer removes the component violating known conservation laws and separately penalizes residuals that cannot be enforced exactly.
Useful7/10
Difficulty5/10
Novelty5/10
△ Mechanism confirmed, baseline not beaten
2026
Augment a neural policy with differentiable environment or data-generation parameters and optimize both using the environment-parameter policy-gradient theorem. The current transition is differentiated with respect to the design parameter, while the continuation value is evaluated under a frozen copy of that parameter; this isolates the local causal effect and avoids repeatedly differentiating through arbitrarily long rollouts. Suitable applications include learnable domain randomization…
Useful7/10
Difficulty5/10
Novelty7/10