Solves: Stability

Machine-learning ideas tagged Stability in the Solves taxonomy of the Math2NN corpus.

2330 ideas found

Mechanism confirmed, baseline not beaten 2026

Lipschitz Forward-Invariant Policy Certification

Certify during or after RL training that a neural policy keeps the closed-loop state inside a prescribed safe set under bounded disturbances and observation errors. Use spectral normalization or a Lipschitz penalty to reduce policy gain, then compute a conservative one-step safety margin that must remain positive over reachable states.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Safe Deep Reinforcement Learning for Energy-Efficient HVAC Control in Multi-Zone Residential Buildings arXiv:2608.17235
Failed on benchmark 2026

Dual Information-Demand Curiosity

Train a latent world model with a conditional-mutual-information lower-bound constraint instead of using a fixed curiosity or information-gain coefficient. The dual multiplier increases only when predicted observations contain less information about latent states and model parameters than the goal prior demands, and decreases when the target is exceeded; this produces an adaptive epistemic-pressure schedule with explicit inactive and saturated regimes.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: Expected free energy as an information constraint on the Bethe Lagrangian arXiv:2608.17167
Mechanism confirmed, baseline not beaten 2026

Singular-Value-Robust Projector-Splitting LoRA

Train a fixed-rank neural weight update Y=USV^T with a projector-splitting Runge–Kutta step instead of independently applying Adam or gradient descent to U, S, and V. The update evolves the full low-rank matrix using the neural gradient but performs QR-based factor updates, avoiding S^{-1} and remaining stable when adapter singular values collapse or cross zero. Use a common-base midpoint construction so every internal stage starts from the same U,V basis and remains rank r.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: Robust Projector-Splitting Runge-Kutta Integrators of Orders Two and Three arXiv:2608.17157
✓✓ Beats tuned baseline 2026

Randomized-QMC gradient batches

Replace IID latent or diffusion-noise samples used inside a neural expectation with a randomized low-discrepancy point set. Each randomized point has the correct marginal distribution, while the complete set covers the sampling domain more uniformly, reducing variance in minibatch loss and gradient estimates when the integrand is smooth in the base-noise coordinates.

Useful7/10
Difficulty4/10
Novelty6/10
Paper: Randomized quasi-Monte Carlo integration arXiv:2608.17143
Failed on benchmark 2026

TD-to-PDE Continuation Training

Train a neural value or latent-dynamics model with temporal-difference targets before enforcing a stiff differential-equation residual, and ramp the physics weight only after the critic has become predictive. For a stochastic dynamical model, the residual is computed using the infinitesimal generator, while terminal, safe, and failure boundary conditions are imposed through separate penalties.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Physics-informed Reinforcement Learning for Stochastic Reach-Avoid Analysis arXiv:2608.17117
Mechanism confirmed, baseline not beaten 2026

Causal E/I Micro-Event Cell

Replace signed-input aggregation in a spiking recurrent cell with a causal micro-event queue that processes excitatory and inhibitory arrivals in timestamp order, applying threshold and reset after each event. This preserves computations that disappear when all events in a timestep are replaced by one net current, particularly near threshold.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Order-Sensitive Fast-Synapse Limits in Sparse Excitatory-Inhibitory Threshold-Reset Networks arXiv:2608.16701
Mechanism confirmed, baseline not beaten 2026

Energy-Riesz checkpoint selector

Replace raw neural PDE training-loss checkpoint selection with a residual monitor measured in the variational energy geometry. For every archived network, solve an auxiliary conforming Riesz problem and select the checkpoint with the smallest reconstructed residual norm; nested auxiliary spaces make this score converge monotonically to the inaccessible energy error.

Useful7/10
Difficulty4/10
Novelty7/10
Paper: Reference-free logged energy-oracle recovery for neural approximations of symmetric coercive variational problems: conforming Riesz reconstruction and archive-level selection arXiv:2608.16473
✓✓ Beats tuned baseline 2026

Uniform-Certificate Bayesian Feature Head

Replace the final layer of a neural predictor with Bayesian linear regression over deterministic trigonometric features, retaining a computable posterior variance and a high-probability confidence envelope over the full bounded input domain. Use this envelope to reject unsafe actions, downweight uncertain training targets, or restrict optimizer updates in regions where the network is extrapolating.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: Scalable Gaussian Process Regression via Deterministic Trigonometric Features: Uniform Bounds for Safe Model Predictive Control arXiv:2608.16415
Failed on benchmark 2026

Adaptive Proximal Quasi-Newton Training

Replace the raw gradient step for a neural-network parameter block with a proximal quasi-Newton step, using the proximal operator to enforce nonsmooth constraints or structured regularization and an adaptive linesearch that enlarges the stepsize after several successful iterations. The method should permit much larger steps than conservative monotone backtracking while retaining a residual-decrease safeguard near unstable regions.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: PANDA: A Matrix-Free Differentiable NMPC Solver via Proximal Averaged Quasi-Newton with Adaptive Linesearch Algorithm arXiv:2608.16280
Failed on benchmark 2026

MI-Guided Latent Protection

Use the estimated task relevance of each latent coordinate to allocate corruption, precision, or redundancy non-uniformly rather than applying uniform dropout or quantization noise. Coordinates with larger mutual-information sensitivity receive lower noise or more bits, while low-relevance coordinates are compressed or corrupted more aggressively.

Useful7/10
Difficulty4/10
Novelty6/10
Paper: Adaptive Unequal Error Protection for Semantic Split Learning over Wireless Channels arXiv:2608.16227
Failed on benchmark 2026

Fisher-Observable Latent State Training

Add an observability regularizer to a recurrent state-space model or world model so that short sequences of predicted multimodal observations identify the latent state. The regularizer penalizes poorly conditioned Fisher information, preventing the model from storing important state variables in directions that its available observations cannot distinguish.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: Improving Observability of Relative Orbit Estimation Using Bearing Measurements and Light Curves arXiv:2608.16135
Unverified 2026

Digital-Recurrence Lyapunov Monitor

Add a numerical-health monitor that distinguishes genuine contraction or chaos from finite-precision periodicization. It tracks hidden-state recurrence, effective cycle length, and the divergence between single-rollout and independent-restart Lyapunov estimates, then triggers precision escalation, rollout truncation, perturbation, or training early stopping when the diagnostic enters the recurrence-collapse regime.

Useful7/10
Difficulty5/10
Novelty8/10
Paper: When More Data Become Less Informative: Finite-Precision Periodicization and Collapse of Forecast-Error Lyapunov Estimates arXiv:2608.16120
Unverified 2026

Differentiable Simulation-Regularized Neural Dynamics

Train a neural controller or latent dynamics model together with a finite abstraction whose cells and successor relations are optimized using a smooth reverse-simulation surrogate. Penalizing concrete-to-abstract mismatch should suppress locally inconsistent or overly expansive latent transitions, while a separate reachability containment check preserves soundness. This creates a verification-aware training signal that targets spurious branching rather than only one-step prediction error.

Useful7/10
Difficulty6/10
Novelty8/10
Paper: $S^3$: A Smooth Simulation Surrogate for Optimizing Discrete Abstractions of Dynamical Systems arXiv:2608.15920
Unverified 2026

Dimension-Free Brenier Transport Layer

Build a neural transport layer by parameterizing a convex potential whose gradient maps a semi-log-concave latent distribution into a compact convex data domain. Use the paper's dimension-free Lipschitz certificate to set the layer's Jacobian scale, initialize the potential, and reject or regularize parameter updates that create excessive curvature. The goal is a bounded-output transport module that is less sensitive to latent dimension than diameter-based spectral heuristics.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Dimension-Free Lipschitz Bounds for Brenier Maps to Compactly Supported Log-Concave Targets arXiv:2608.15906
Unverified 2026

Structure-preserving SU(1,1) recurrent scan

Replace an unconstrained recurrent transition by a sequence of exact SU(1,1) hyperbolic updates. The layer processes each token with a 2-complex-dimensional state and preserves the indefinite energy |a|^2-|b|^2=1 exactly, preventing numerical drift while retaining non-unitary amplification and attenuation.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: The nonlinear Hausdorff-Young inequality arXiv:2608.15895
Unverified 2026

Bennett-whitened gradient trust region

Use the paper's self-normalized martingale bound to monitor cumulative stochastic gradient noise in covariance-whitened coordinates. Convert its time-uniform confidence boundary into a trust-region multiplier: retain the normal optimizer update while the observed noise is within the boundary, and shrink or clip the update after an exceedance.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: Self-normalised Bennett inequalities for Hilbert-valued martingales arXiv:2608.15874
Unverified 2026

Exact-Curl Neural Field Output

Make a neural network predict a vector potential rather than a magnetic or velocity field, then obtain the physical vector field with a fixed differentiable discrete curl. The reconstructed field satisfies the discrete divergence-free constraint exactly, eliminating divergence-penalty tuning and preventing constraint drift during long rollouts.

Useful7/10
Difficulty4/10
Novelty5/10
Paper: A Structure- and Pressure-Positivity-Preserving Semi-implicit IMEX Finite Volume Scheme for Ideal MHD at All Acoustic Mach and Alfvén Mach Numbers with Generic Equation of State arXiv:2608.15837
Unverified 2026

Prescribed-Performance Hidden-State Observer

Add an auxiliary prescribed-performance observer to a recurrent or state-space neural network so that latent prediction errors are estimated from observable output residuals rather than relying only on backpropagation through long histories. The observer uses a transformed normalized innovation and gains that change with the desired error envelope, allowing fast early correction without permanently using a large unstable gain. It can operate online during inference or provide an auxiliary…

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Output Feedback Adaptive Performance Control arXiv:2608.15758
Unverified 2026

OT Primitive Universal Flow

Parameterize a generative or density-evolving model as a composition of diffeomorphic optimal-mass-transport maps rather than unconstrained residual layers. Each layer transports one smooth positive density to another through a learned squared-distance OT map, while compositions provide a principled universal family for transformations connected to the identity.

Useful7/10
Difficulty7/10
Novelty6/10
Paper: The Holonomy of Optimal Mass Transport: The Smooth Case arXiv:2608.15585
Unverified 2026

Ultra-Local Neural Safety Shield

Wrap a neural policy or sequence-model controller with an online-estimated ultra-local model of a scalar safety output, such as distance-to-obstacle, queue length, battery margin, or constraint slack. Estimate the unknown drift and control effectiveness directly from recent observations, then impose a robust control-barrier constraint that subtracts an empirical uncertainty envelope before allowing the neural action.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Model-Free Based Computations of Recursive Control Barrier Function: Ultra-Local Model Approach arXiv:2608.15361
Unverified 2026

Drift-Balanced Adaptive Constraint Multiplier

Use a projected dual variable as a feedback controller for terminal feasibility rather than selecting a fixed penalty coefficient. The multiplier increases after infeasible batches and decreases after feasible batches, with an explicit cap and drift-balance diagnostic that detects whether the policy-dual loop is stable.

Useful7/10
Difficulty3/10
Novelty5/10
Paper: Ranking-Augmented On-Policy Optimization with Adaptive Advantage-Normalization for Constrained Control arXiv:2608.15359
Unverified 2026

Feasibility-Ranked Group Policy Gradient

Replace a learned critic with group-relative trajectory advantages whose weights are explicitly ordered by terminal feasibility. Feasible rollouts receive larger positive update weight than violating rollouts, while per-timestep normalization prevents high-variance late-horizon returns from dominating the policy gradient.

Useful7/10
Difficulty4/10
Novelty6/10
Paper: Ranking-Augmented On-Policy Optimization with Adaptive Advantage-Normalization for Constrained Control arXiv:2608.15359
Unverified 2026

Anchored Whitening Layer

Replace a conventional whitening transform with a constrained whitening layer that minimizes cross-channel covariance while requiring every output channel to remain correlated with its designated input channel by at least a threshold \(\rho_{\min}\). The layer exploits the orthogonal freedom in whitening to find a rotation that preserves channel identity instead of arbitrarily mixing features. It can be inserted before an MLP, convolution, or attention projection and compared directly against…

Useful7/10
Difficulty5/10
Novelty6/10
Paper: CORAL: Constrained Oblique Rotation with Anchored Loadings for Fidelity-Constrained Decorrelation arXiv:2608.15319
Mechanism confirmed, baseline not beaten 2026

Bifurcation-Aware Adaptive Compute Controller

Use the estimated distance to a saddle-node ghost as an inference-time controller for recurrent or neural-ODE computation. Far from a fold, take large integration steps or update only the fast state; near the fold, reduce the step size or allocate extra recurrent evaluations because the state is expected to linger and become sensitive to small parameter changes.

Useful7/10
Difficulty5/10
Novelty8/10
Paper: Ghost Dynamics in Receptor Signalling Networks: A Fast--Slow Adaptive Extension of Competitive Cancer Inhibition Models arXiv:2608.15300