Research ideas

Every idea extracted from recent arXiv mathematics papers — verified and unverified. Click an idea to open its full card; badges show the empirical verdict.

146 ideas found

Status: Failed on benchmark ML: Optimizer Clear all

✗ Failed on benchmark 2026

Double-Geometric Layerwise ES

Replace Gaussian perturbations in a low-dimensional neural-network optimizer with independent double-geometric integer mutations and adapt each mutation scale using its exponential-family natural gradient. Apply the method to layerwise quantization scales, adapter coefficients, pruning thresholds, or other integer/discrete hyperparameters rather than to every individual weight.

Useful6/10

Difficulty5/10

Novelty7/10

Optimization Accuracy Sample efficiency Stability

Paper: Integer Natural Evolution Strategies arXiv:2608.23714

✗ Failed on benchmark 2026

Finite-horizon Lyapunov regularization for neural updates

Add a loss term requiring a neural optimizer or recurrent module to decrease a nonnegative Lyapunov-like energy over M update steps, rather than forcing monotonic one-step decrease. The term includes an empirically estimated mismatch allowance, so stochastic or delayed updates are tolerated while persistent instability remains penalized.

Useful6/10

Difficulty4/10

Novelty7/10

Dynamics Stability Generalization Optimizer

Paper: Distributed model predictive control via finite-step control Lyapunov functions arXiv:2608.22382