ML: Optimizer

Machine-learning ideas tagged Optimizer in the ML taxonomy of the Math2NN corpus.

728 ideas found

Mechanism confirmed, baseline not beaten 2026

Work-trained neural Hamiltonian bridge

Train a neural finite-time Hamiltonian-style path from an easy base density to a Boltzmann target by minimizing its generalized nonequilibrium work. The work is a path-space log-density ratio, so its mean is a forward KL divergence up to a constant and the endpoint marginal mismatch is bounded by the same quantity. Unlike an uncorrected neural sampler, this produces a global proposal whose bias and overlap can be measured quantitatively.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Neural Non-Equilibrium Hamiltonian Monte Carlo for Corrected Boltzmann Sampling arXiv:2607.15682
Mechanism confirmed, baseline not beaten 2026

Zero-Crossing Reset Integral Optimizer

Replace ordinary momentum-like accumulation with a PI controller whose integral state is reset when the proportional error changes sign, indicating that the trajectory has crossed its local target. Apply the mechanism to each parameter block or to a scalar block residual, and impose a dwell time so that minibatch noise cannot trigger arbitrarily frequent resets.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: A PI+R Control Scheme Based on Multi-agent Systems for Economic Dispatch in Isolated BESSs arXiv:2607.15572
Mechanism failed 2026

Regularity-Gated MGDA

Replace unconditional stochastic MGDA in a multi-task network with a regularity-gated update. Compute the conflict-avoidant simplex combination when the objective-gradient geometry is sufficiently regular, but use a fixed scalarization weight when the MGDA solution is near a degenerate simplex face or changes sharply between mini-batches. The gate targets the paper's distinction between 1/2-Hölder behavior in the worst case and Lipschitz behavior on regular subproblems.

Useful7/10
Difficulty5/10
Novelty5/10
Paper: Regularity-Aware Stochastic MGDA with Adaptive Conflict-Avoidant Update Direction Control arXiv:2607.15412
Mechanism confirmed, baseline not beaten 2026

Uncertainty-guided family sampling

Use the family predictor not only as a post-processing estimator but also as a feedback controller for data collection. Reweight Monte Carlo proposals or minibatch selection toward under-sampled families whose signed contribution and predictive uncertainty are large, rather than spending samples on already well-known positive families.

Useful7/10
Difficulty6/10
Novelty5/10
Paper: Learning the Fermion sign structure in path-integral Monte Carlo arXiv:2607.15060
Failed on benchmark 2026

Proximal-Mismatch Fine-Tuning

Fine-tune a denoiser by matching its action to a target-domain proximal operator, instead of minimizing only pixelwise denoising error. Apply the loss on the intermediate states and noise levels actually encountered by the downstream iterative solver, so the adaptation directly reduces the error that controls PnP reconstruction stability.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: Domain Adaptation of Mismatched Proximal Denoiser for Plug-and-Play Image Reconstruction arXiv:2607.14894
✓✓ Beats tuned baseline 2026

Periodic-Delay Bifurcation Monitor

Build a delayed recurrent layer whose state update contains explicit taps at lags k tau, and monitor whether its linearized dynamics support periodic or antiperiodic modes over a window of length m tau. Use the smallest singular value of the corresponding periodic-boundary residual as a bifurcation margin: values near zero indicate that a new oscillatory memory mode is being created or destroyed. The margin can be used either as a diagnostic or as a regularizer that keeps training away from…

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Bifurcation of periodic and antiperiodic solutions in non-autonomous potential-type delay systems arXiv:2607.14538
✓✓ Beats tuned baseline 2026

State-Dependent Metric Projected Optimizer

Replace the usual projected gradient step with a relaxed projection in a positive-definite metric that changes with the current parameter state. The metric acts as a continuous preconditioner before projection, so updates can be large along poorly conditioned directions while remaining feasible.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: State-Dependent Metric Projection Neural Network for Variational Inequalities arXiv:2607.14519
Mechanism confirmed, baseline not beaten 2026

Sign-Reset PI Optimizer

Replace ordinary gradient descent or momentum with a discrete PI update whose integral gradient state is accumulated only while the gradient direction remains consistent. When the proportional gradient term changes sign, reset the integral state, preventing stale gradients from producing overshoot near minima or after sharp curvature changes.

Useful7/10
Difficulty4/10
Novelty6/10
Paper: A Distributed PI+Reset Scheme for Discrete-Time Economic Dispatch of A Grid-connected BESS Network arXiv:2607.14508
Mechanism confirmed, baseline not beaten 2026

Entropy-Feedback Zeroth-Order Cooling

Replace a fixed temperature schedule in a population-based, derivative-free neural-network optimizer with a feedback controller driven by the entropy of candidate importance weights. When candidate losses are diffuse, the optimizer cools rapidly to exploit progress; when one or a few candidates dominate, cooling slows to prevent irreversible population collapse and loss of exploration.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: Information-Theoretic Adaptive Cooling for Deterministic MPPI via Entropy Feedback arXiv:2607.14245
Failed on benchmark 2026

ISS-Constrained Modular Recurrent Network

Replace an unconstrained recurrent block with two coupled modules: a contractive perceptual estimator and an input-to-state-stable cognitive state transition. Spectral normalization and a controlled Euler residual step enforce a quantitative gain condition, preventing hidden-state explosion while retaining long memory when the contraction factor is chosen close to one.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: A modular state-space model of human perception, cognition, and decision dynamics arXiv:2607.14078
Mechanism confirmed, baseline not beaten 2026

Effective-resistance natural-gradient routing

Replace independent expert activation or ordinary softmax routing with an exact fixed-m external-field subset router. Parameterize expert weights by logits, use the subset covariance as the Fisher matrix, and precondition router gradients with its Moore-Penrose pseudoinverse on the sum-zero subspace. The paper's resistance bound supplies a data-dependent ceiling for pairwise logit updates, preventing unstable motion when some experts have low inclusion variance.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Effective Resistance in Fixed-Rank External-Field Measures and Constant-Stretch Correlated Sampling on the Hypersimplex arXiv:2607.13990
Failed on benchmark 2026

Hysteretic Safe Optimizer

Use a two-mode optimizer: a learned preconditioned update for normal training and a bounded contractive fallback when the learned update is predicted to increase a monitored energy. Use separate entry and exit thresholds so minibatch noise does not cause rapid switching.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Non-asymptotic Bounds of Learning-based Linear MPC With Input Constraints and Unbounded Stochastic Noise arXiv:2607.13513
Unverified 2026

Change-Gated Online Adaptation

Attach a CPDNet-like monitor to a sequential neural model and use its soft change probability to gate online parameter updates. The model should update little or not at all during nominal operation, but rapidly increase adaptation after residuals and internal features indicate a regime change, avoiding both stale parameters and continual self-training drift.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: Change-Aware Self-Adaptive AI-Aided Kalman Filters With Neural Change Point Detection arXiv:2607.13387
✓✓ Beats tuned baseline 2026

One-Bang Gradient-Noise Preparation

Use a bounded stochasticity control during an initial preparation window to shape the gradient or parameter-update distribution before ordinary training. The control is restricted to its minimum or maximum value, with at most one switch, because the reduced moment dynamics are affine in the control; this gives a falsifiable alternative to smooth noise or learning-rate annealing.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Optimal preparation and reachable-state constraints in the Mpemba effect arXiv:2607.12955
Mechanism confirmed, baseline not beaten 2026

Support-Identified Newton Optimizer for Sparse Orthogonal Layers

Train a matrix-valued neural layer under an exact or near-exact Stiefel constraint while using an l1 or row-group sparsity penalty. During early training, use manifold proximal-gradient steps to identify a stable nonzero support; once the support stops changing, switch to Newton-CG steps restricted to the smooth intersection of the Stiefel tangent space and the fixed-support subspace. This can reduce the number of optimizer iterations needed to obtain sparse, well-conditioned projections.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: From Manifold Identification to Newton Acceleration on Intersections: Sparse Stiefel Optimization arXiv:2607.12877
✓✓ Beats tuned baseline 2026

Null-space conservation projection

Add an exact linear-constraint projection to the output solve of a neural operator or physics-informed model. The network produces an unconstrained prediction or coefficient vector, while a small constrained least-squares layer removes the component violating known conservation laws and separately penalizes residuals that cannot be enforced exactly.

Useful7/10
Difficulty5/10
Novelty5/10
Paper: A Structure-Preserving Method of Fundamental Solutions for the Multi-Phase Mullins-Sekerka Flow arXiv:2607.12759
Mechanism confirmed, baseline not beaten 2026

Decoupled Environment Gradient for Joint Policy and Simulator Learning

Augment a neural policy with differentiable environment or data-generation parameters and optimize both using the environment-parameter policy-gradient theorem. The current transition is differentiated with respect to the design parameter, while the continuation value is evaluated under a frozen copy of that parameter; this isolates the local causal effect and avoids repeatedly differentiating through arbitrarily long rollouts. Suitable applications include learnable domain randomization…

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Environment Parameter Gradient Theorem for Policy-Environment Co-Design in Reinforcement Learning arXiv:2607.12590
✓✓ Beats tuned baseline 2026

Spectral-Width Prethermal Training Schedule

Use the paper's lifetime law as a controller for training or rollout difficulty. Estimate the active perturbation bandwidth R of hidden states or forecast errors and reduce the residual gain, increase the dispersion order W, or inject controlled bandwidth whenever the estimated prethermal lifetime becomes too short.

Useful7/10
Difficulty5/10
Novelty8/10
Paper: From stable periodic orbits to many-body chaos: doubly tunable prethermalization via engineering of an emergent band structure arXiv:2607.12355
Failed on benchmark 2026

Gaussian-Remainder Tail-Risk Optimizer

Replace the assumption that a minibatch gradient is fully Gaussian by a Gaussian center plus an explicit single-example big-jump correction. At each update, estimate the distribution of per-example gradient projections along the proposed update direction and use the predicted aggregate tail probability to reduce the step size or increase clipping only when the minibatch is in its non-Gaussian crossover regime.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: A Gaussian-Remainder Hierarchy for Sums of Random Variables with Big-Jump Statistics arXiv:2607.12357
Mechanism confirmed, baseline not beaten 2026

Extreme-Marginal Conditioning Certificate

Use the extreme-eigenvector marginal test to decide whether a Kronecker preconditioner is condition-optimal, rather than blindly running expensive factor refinement. If the certificate fails, construct a low-cost factor correction from the mismatch between tensor marginals of the worst-conditioned spectral states and accept it only with a condition-number line search.

Useful7/10
Difficulty7/10
Novelty8/10
Paper: Structured Preconditioning in Affine-Invariant Geometry: Projection, Certificates, and Kronecker Separation arXiv:2607.12286
Mechanism confirmed, baseline not beaten 2026

Certificate-Aware Gradient-Noise Probing

Maintain a posterior over the effective stochastic-gradient noise scale and trigger expensive diagnostics or conservative optimizer changes only when uncertainty in that scale threatens a training-stability certificate. Unlike entropy-based exploration, the trigger depends on the predicted excess loss or stability gap caused by calibrating the optimizer to the wrong noise level.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Active Noise Floor Estimation for Reliability-Optimal POMDPs: A Value-of-Noise-Information Approach arXiv:2607.11822
Mechanism confirmed, baseline not beaten 2026

Branch-Free Double-Word FMA Accumulator

Replace ordinary low-precision multiply-add accumulation in selected neural-network reductions with a two-word floating-point accumulator updated by the paper's branch-free DW-FMA network. The high word retains the main sum and the low word stores the rounding residual, improving cancellation behavior without the control-flow divergence of conditional compensated summation.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: Performance evaluation of branch-free fused multiply-add algorithms for multi-component-type multiple-precision floating-point arithmetic arXiv:2607.11391
Mechanism confirmed, baseline not beaten 2026

Instrument-Godambe Preconditioner

Build a low-dimensional neural-network geometry from trainable observables or probes instead of estimating the full Fisher matrix. Precondition the parameter gradient by the inverse variability of the probes and their parameter sensitivity, producing a task-adapted update that can remain usable for implicit models, heavy-tailed data, and parameter-dependent-support distributions.

Useful7/10
Difficulty6/10
Novelty6/10
Paper: Weak Information Geometry: Riemannian Structures from Distributional Inference Functions and Stein Discrepancies arXiv:2607.11246
Mechanism confirmed, baseline not beaten 2026

Tikhonov-Stabilized Stochastic Extragradient

Replace the raw stochastic saddle objective by a strongly convex-strongly concave, quadratically anchored objective before applying stochastic extragradient. For a generator-discriminator or policy-rewarder game, anchor the minimizing and maximizing parameter vectors to reference parameters with opposite signs, suppressing persistent stochastic rotations and improving the quality of the final iterate.

Useful7/10
Difficulty4/10
Novelty6/10
Paper: Last-Iterate Convergence of Single-Loop Stochastic Methods for Constrained Convex-Concave Minimax Problems arXiv:2607.11056