Unverified
2026
Represent each trainable parameter block as a global scale multiplied by a normalized shape, and evolve the shape through a projected Hamiltonian optimizer. The optimizer is designed so that normalized weights can approach a stable central configuration while auxiliary momenta retain phase-space volume that prevents ordinary Hamiltonian dynamics from having a full-space attractor.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Treat stochastic gradient training as motion in a random potential given by the neural-network loss, and use local curvature and barrier estimates to control injected Langevin noise. Instead of applying a fixed temperature, adapt the optimizer noise so that the observed escape rate from a basin matches a target rate predicted by thermal activation. This should reduce premature trapping in sharp minima while avoiding destabilization from excessive gradient noise.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Use the paper's stationarity-floor scale to set the SAM radius from a desired gradient tolerance, and reduce the radius when training approaches that tolerance. This turns an otherwise opaque SAM hyperparameter into a curvature- and accuracy-aware schedule.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Replace fixed-period federated averaging or distributed all-reduce with a Bernoulli communication decision whose probability is selected from estimated network connectivity and optimization conditioning. Local workers continue making corrected updates between communication events, while the contraction theorem exposes when communication is worth its cost.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Represent stochastic layer execution, branching, retries, and early exit as a finite continuous-time Markov chain, with the completed-prediction state absorbing. Learn transition rates jointly with neural-network weights, but use MFPT sensitivities to allocate rate changes according to their available control budget rather than allowing one routing edge to dominate halting-time control.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Use the Bregman objective's exact residual-dependent curvature to build a positive-semidefinite Gauss-Newton preconditioner for a neural network's scalar regression head. Negative curvature weights are clipped or damped before solving the update, preserving the original gradient while preventing residual patterns from producing unstable parameter steps.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Use the paper's linearized Beltrami equation as a custom Jacobian-vector product or implicit backward rule for a differentiable deformation solver. Instead of differentiating through an ill-conditioned solve naively, solve a normalized linearized equation whose source is scaled by the coefficient derivative; the derivative-to-ellipticity cancellation keeps sensitivity bounded even when the learned warp approaches extreme distortion.
Useful6/10
Difficulty8/10
Novelty8/10
Unverified
2026
Replace a fixed-batch SGD or proximal-gradient update by a stochastic proximal-subgradient step whose step size is backtracked against an empirical sufficient-decrease condition. If the condition is too noisy or repeatedly fails, enlarge the batch and retry; otherwise retain the current batch, allowing sample size to grow only when needed.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Partition a low-dimensional projection of optimizer state into oriented h-sets and require each optimizer update to map one set across the next while remaining bounded in transverse coordinates. The chain acts as a finite-horizon topological certificate that training cannot leave the intended corridor before reaching a target loss basin.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Replace uniform or purely loss-driven update allocation with a scheduler that targets both the mean update rate and the temporal variance of updates for each parameter group, task, or expert. At every training step, assign the available minibatch slots or accelerator workers to groups with the largest weighted deficits, preventing starvation while avoiding highly bursty update streams that can produce optimizer oscillations.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace a fixed global learning-rate estimate in an accelerated optimizer with a curvature envelope that depends on the current estimated optimality gap. Use phase restarts and a descent backtracking test so that the method remains safe when the gap or \(H_1\) estimate is inaccurate. The expected benefit is faster progress on objectives whose curvature is large early in training but decreases substantially near a good solution.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
When a learned operator changes during training, add a frame-connection correction that transports its current Arnoldi representation instead of allowing hidden states to jump between evolving spectral directions. This is a geometry-aware residual or optimizer correction intended to reduce representation drift during aggressive learning-rate schedules, fine-tuning, and continual learning.
Useful6/10
Difficulty7/10
Novelty8/10
Unverified
2026
Add a periodic coarse optimization phase to SGD or Adam that operates on a compressed parameterization and returns a prolongated correction to the full network. Retain nonsmooth constraints or regularizers explicitly through a primal-dual update instead of relying on penalty smoothing. Accept the correction only when it improves a cheap fine-batch merit test, making the method useful even when the coarse objective is only approximately coherent with the fine objective.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Train the critic on the action that the environment actually received after safety filtering, not only on the actor's nominal action. Prioritize transitions whose estimation residual, barrier proximity, or filter intervention is large, so replay concentrates on the distribution shift introduced by the safety controller instead of repeatedly sampling benign nominal behavior.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Use the paper’s observation that the fully irreducible vertex is approximately local after crossed-channel ladders are removed to build a block-local curvature correction for neural-network optimization. Estimate a cheap bare covariance and subtract the inverse full covariance to obtain a local irreducible correction, avoiding a dense four-point model while retaining interaction effects that ordinary diagonal preconditioners miss.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace a standard diagonal optimizer preconditioner with a small Riccati-derived feedback controller for a block of neural parameters. The controller explicitly accounts for update-dependent stochasticity, potentially preventing unstable steps in noisy or strongly coupled training dynamics while permitting larger effective learning rates.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Replace Euclidean projection onto a smooth convex parameter constraint by a local tangent-halfspace linear minimization step. The method is particularly suitable for convex softmax heads or low-dimensional adapter parameters constrained to an ellipsoid, where projections require matrix solves or expensive nonlinear routines but membership and boundary-normal queries are cheap.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Reparameterize all Bayesian neural-network weights by a bounded latent vector in the unit ball and use a simple ball-constrained MCMC kernel instead of unconstrained HMC or random-walk sampling. A radial diffeomorphism expands points near the ball boundary into arbitrarily large weights, preserving heavy-tailed posterior mass while preventing the sampler from numerically wandering through an unbounded parameter space.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace fixed momentum with an online controller that selects the momentum coefficient from an upper bound on the next-step momentum second moment. The controller lowers momentum when minibatch noise dominates and permits higher momentum when the gradient estimate is stable.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Replace a Euclidean position-plus-rotation recurrent state with an SE(3)-valued latent pose and predict six-dimensional algebra increments rather than directly regressing a rotation matrix or Euler angles. Jointly propagate a pose covariance and penalize Gaussian chance-constraint violations, so the model learns both a nominal trajectory and feedback-like uncertainty contraction.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Inject scale-mixture noise into SGD by sampling the perturbation magnitude from an inverse-gamma distribution rather than using fixed-variance Gaussian noise. The resulting gradient updates have kappa or Student-t tails, allowing rare large exploratory steps while retaining an explicit control parameter for the Gaussian limit and for the existence of noise moments.
Useful6/10
Difficulty3/10
Novelty6/10
Unverified
2026
Use the mode-wise instability condition as a controller for a learned cross-channel transport gain. During training or inference, estimate the linearized feature dynamics and adjust the chemotactic strength to remain below a stability margin for robust processing, or deliberately cross the threshold during a controlled pattern-forming stage. This replaces blind gain tuning with a measurable dynamical criterion.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Measure time-reversal asymmetry in coarse-grained parameter or update trajectories and convert it into a lower bound on the irreversibility of training dynamics. Use this bound as a feedback signal: when irreversible circulation increases sharply, reduce the learning rate or momentum; when it remains low and the loss decreases, permit larger steps.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Insert a recurrent layer that repeatedly replaces a three-by-three feature affinity matrix by the Pearson correlations of its rows. Unlike an unconstrained recurrent affinity update, the state remains a valid correlation matrix, becomes rank at most two after one step, and in dimension three converges globally to one of seven fixed points. Use the converged patterned fixed point as a differentiable or stop-gradient clustering/relational embedding, while monitoring rank and kernel-coordinate…
Useful6/10
Difficulty5/10
Novelty7/10