Solves: Stability

Machine-learning ideas tagged Stability in the Solves taxonomy of the Math2NN corpus.

2414 ideas found

Unverified 2026

Cross-Channel Scattering Front End

Add a differentiable SNST layer before an EEG classifier or sequence model. For every local channel pair and wavelet band, compute the magnitude of the complex cross-channel analytic response, then average it over a controllable temporal window and concatenate it with ordinary channelwise features. This gives the model an explicit, phase-robust amplitude-coupling representation that is especially useful when labeled training data are scarce.

Useful6/10
Difficulty4/10
Novelty7/10
Paper: Spatial Neighboring Scattering Transform: A Cross-Channel Amplitude Coupling Measure for EEG Connectivity arXiv:2607.08855
Unverified 2026

Sparse Lyapunov Search for Safe Optimizer Hyperparameters

Use the paper's certificate-sparsification procedure to search for a small Lyapunov proof of an optimizer's contraction on local strongly convex quadratic models. The active interpolation inequalities and resulting sparse Lyapunov coefficients become a data-driven rule for limiting learning rate and momentum per layer or parameter block, instead of relying only on global heuristics.

Useful6/10
Difficulty7/10
Novelty7/10
Paper: Finding Simple Proofs for First-Order Optimization arXiv:2607.08753
Unverified 2026

Invariant nonstandard residual blocks

Replace the usual explicit residual update with a nonstandard general-linear block containing several internal feature stages. The effective step is a positive denominator function rather than the raw depth step, allowing the block to take large nominal steps while damping the update and preserving bounded activations. This is most promising for deep residual MLPs, neural ODE discretizations, and state-space sequence models where exploding hidden states limit usable depth.

Useful6/10
Difficulty6/10
Novelty6/10
Paper: Some properties of high-order nonstandard multistep multistage methods arXiv:2607.08694
Unverified 2026

Gaussian Barycentric Constraint Layer

Construct a differentiable approximate projection layer for a convex feasible set by averaging Gaussian perturbations conditioned on feasibility. Unlike hard projection or penalty methods, the output is smooth in the input and inherits firm nonexpansiveness in the convex case.

Useful6/10
Difficulty4/10
Novelty5/10
Paper: Sharp bounds for stochastic proximal and projection estimators via radial dominance arXiv:2607.08670
Unverified 2026

Passivity-Regularized Sequence Layer

Use the paper's scattering energy balance as a measurable regularizer for an existing recurrent or state-space model instead of replacing its architecture. Penalize positive violations of the per-step energy inequality and, for paired examples, penalize violations of incremental passivity so that the model learns not to amplify perturbations over long sequences.

Useful6/10
Difficulty3/10
Novelty6/10
Paper: Aclass of incrementally scattering-passive nonlinear systems arXiv:2607.08637
Unverified 2026

Robust Parameter-Update Envelope

Replace an optimizer's endpoint-only step acceptance rule with a robust envelope rule that requires all monitored neural-network constraints to remain feasible for every interpolation point between the old and proposed parameters. This targets transient instability during a large update, such as exploding activations, loss spikes, negative curvature, or violation of a spectral-norm budget, even when the final endpoint appears acceptable.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Robust Dynamic Operating Envelopes in Unbalanced Three-Phase Distribution Systems arXiv:2607.08578
Unverified 2026

Contractive projected residual dynamics

Build a recurrent or continuous-depth block from a dissipative vector field and project every state derivative onto the tangent cone of a closed convex hidden-state set. Unlike ordinary clipping, tangent-cone projection removes only the outward component at the boundary and preserves admissible motion. Under the paper's maximal-dissipativity result, the continuous flow is nonexpansive in its initial state.

Useful6/10
Difficulty5/10
Novelty5/10
Paper: Projected incrementally scattering passive systems on closed convex sets arXiv:2607.08301
Unverified 2026

Cap-free golden-ratio primal-dual optimizer

Replace a standard proximal-gradient or Adam-style update for a composite neural-network objective with a golden-ratio primal-dual iteration. The optimizer separates a nonsmooth regularizer from a locally smooth loss, estimates local curvature from successive gradients, and uses dual variables for explicit constraints instead of forcing all structure into penalty coefficients. The experiment is falsifiable: at equal gradient evaluations, the method should tolerate larger initial steps and show…

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Two Adaptive Accelerated Golden Ratio Primal--Dual Algorithms With an Application to Poisson Imaging Problem arXiv:2607.08174
Unverified 2026

Moment-Sharp Spectral-Norm Control

Replace a noisy or expensive per-layer spectral-norm estimate with a sharp upper bound obtained by maximizing the largest squared singular value subject to several layer spectral moments. The bound uses the paper's few-distinct-values structure, so the optimization scales with the number of moments rather than the width of the layer.

Useful6/10
Difficulty6/10
Novelty6/10
Paper: Sharp Spectral Bounds for Symmetric Positive Definite Tensors via Multiple Algebraic Invariants arXiv:2607.08113
Unverified 2026

Dissipative drift parameterization

Build the diffusion drift as a contractive linear term plus a spectrally controlled residual, so trajectories are pulled toward a state-dependent center while retaining nonlinear expressivity. This directly targets the paper's sharper one-sided dissipative regime rather than hoping that ordinary weight decay produces dissipativity.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Expressivity and Statistical Trade-offs in Diffusion Policy Learning arXiv:2607.07967
Unverified 2026

Separable Ky-Fan spectral regularization

Represent a large positive semidefinite neural operator as the sum of two Kronecker products and regularize an efficiently computed upper bound on its largest eigenvalues. The bound controls not only the spectral norm but every top-k eigenvalue sum, allowing a tunable penalty on concentrated or unstable directions without constructing the exponentially larger operator.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: A majorization relation for a sum of two tensor products of positive semidefinite operators arXiv:2607.07913
Unverified 2026

Distinct-kink complexity regularizer and merger

Replace nominal hidden-unit count by the number of distinct realized ReLU kink hyperplanes, then regularize or prune this effective count. Neurons whose normalized affine boundaries coincide can be exactly merged by summing their canonical coefficients, reducing memory without changing the represented function and aligning the model's complexity measure with the theorem.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: A law of robustness for two-layer neural networks with arbitrary weights arXiv:2607.07778
Unverified 2026

Robustness-capacity feasibility controller

Use the paper's lower bound as a feasibility test for robust interpolation: if a model is asked to fit below the estimated noise floor while maintaining a small Lipschitz constant, automatically increase effective width or relax the fit target. This prevents optimization from wasting compute on an impossible low-sensitivity solution and provides a principled width schedule for noisy regression or classification.

Useful6/10
Difficulty4/10
Novelty7/10
Paper: A law of robustness for two-layer neural networks with arbitrary weights arXiv:2607.07778
Unverified 2026

Transient-risk certificate for Langevin training

Attach a quantitative upper bound to the probability that noisy parameter updates enter a predefined unsafe region during training. Use the bound to select a minimum burn-in time or reduce Langevin noise once the transient term is small, preventing the failure mode in which the final stationary distribution is safe but the training trajectory temporarily swells into the unsafe set.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Avoiding unsafe sets when training with Langevin Dynamics arXiv:2607.07538
Unverified 2026

Innovation-Compensated Latent Policy

In a partially observed reinforcement-learning or model-based control agent, expose the state-estimator innovation to the action head through a dedicated residual feedback branch. The policy produces a nominal action from the estimated latent state, while a learned innovation-compensation branch corrects actions when observations disagree with predicted latent dynamics. This explicitly separates nominal policy behavior from estimation-induced corrections and should help during fast transients…

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Revisiting Certainty Equivalence: The Structural Coupling Between Estimation and Control in Underactuated Nonlinear Systems arXiv:2607.07276
Unverified 2026

Residual-Tightened Neural Safety Shield

Use the same residual signal to move a neural policy's action away from a learned safety boundary when its dynamics model is unreliable. The shield evaluates a tightened constraint, so model uncertainty directly produces a larger safety margin while accurate predictions recover the original feasible set.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Residual-Conservative Model Predictive Path Integral Control arXiv:2607.06950
Unverified 2026

Nonreversible latent instanton sampler

Represent a rare transition in a neural latent space by a controlled path whose drift is optimized directly, instead of obtaining it by reversing the relaxation dynamics. Learn a state-dependent mobility or diffusion matrix so that the sampler allocates noise and control effort according to the local stochastic geometry. This should improve generation of low-probability transitions in nonequilibrium world models and reduce the number of failed trajectories.

Useful6/10
Difficulty6/10
Novelty5/10
Paper: Nucleation and time-reversal symmetry breaking in nonconserved scalar field theories arXiv:2607.05194
Unverified 2026

Age-conditioned semi-Markov router

Augment a neural router with the age of its current expert or latent regime and use an age-dependent hazard to determine when switching is likely. Unlike ordinary token-wise softmax routing, the router can learn non-geometric residence times, suppressing unstable expert oscillations while still allowing rapid transitions when the current regime becomes inappropriate.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Semi-Markovian switching in a fluctuating harmonic trap: An age-structured formulation arXiv:2607.05173
Unverified 2026

Weighted-Volume Contractive Optimizer

Replace a fixed optimizer learning-rate field by a positive state-dependent scaling rho(theta) and penalize expansion of weighted parameter-space volume. The optimizer is encouraged to contract regions of parameter initializations that have high weighted divergence, potentially reducing sensitivity to initialization and stabilizing training near sharp or anisotropic loss landscapes.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Weighted Phase Volume Method in Stability Analysis: Integral Criteria and Ellipsoidal Reachable Sets arXiv:2607.05033
Unverified 2026

Residual-Scenario Safety Training

Train a neural dynamics predictor or policy output head against an empirical buffer of observed prediction-error scenarios rather than only nominal targets. For each input, require the predicted output plus every sampled residual trajectory to remain inside the admissible set, using an exact nonnegative slack penalty when robust feasibility is impossible. This should reduce rare but operationally important constraint violations while preserving nominal tracking accuracy.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Scenario-based Data-Enabled Predictive Control: Robustification via the Scenario Approach arXiv:2607.04165
Unverified 2026

Backward-Reachability Distance Head

Retain the iteration at which each state enters each modal winning set and use that integer as a dense training target for a neural critic. The policy is additionally encouraged to choose transitions that decrease every finite modal distance, supplying progress information even when the environment reward is sparse.

Useful6/10
Difficulty3/10
Novelty8/10
Paper: Multimodal Nonblocking Supervisory Control Synthesis arXiv:2607.03263
Unverified 2026

RNCOA Aggregated Collision Loss

Attach an RNCOA-inspired collision loss to a neural trajectory or control-policy head that predicts the pose of a rigid vehicle over time. For each obstacle and time step, aggregate the signed obstacle coordinates of all body vertices using max/min operators, and introduce two nonnegative side slacks whose sum is constrained to at most one. This models the disjunctive fact that the complete body should lie on one admissible side of an obstacle rather than independently penalizing every vertex.

Useful6/10
Difficulty4/10
Novelty6/10
Paper: RCOA Extension and Applications arXiv:2607.02797
Unverified 2026

Conserved Poisson Feature Noise

Replace iid dropout or iid activation noise on spatial tokens with fluctuations generated by a conserved diffusing density. Each token receives a positive mass variable whose total mass is preserved, while Poissonian stochastic flux produces correlated perturbations that explore coherent local patterns rather than independently corrupting every feature. The density is autonomous and detached from autograd, so the regularizer adds little computational overhead.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Non-equilibrium phase transition in the Brownian Ising Model: field theory, renormalization group, and exact results arXiv:2607.02667
Unverified 2026

Moment-Controlled Mutation

Use the paper's mean and variance dynamics to control exploration in a population of neural-network adapters. Estimate local reward curvature from the current candidates, then choose mutation strength so selection contracts diversity only when the reward landscape is locally reliable. Increase diffusion when reward noise or selection causes population collapse.

Useful6/10
Difficulty6/10
Novelty7/10
Paper: Theory of collective learning in populations of adaptive agents arXiv:2607.02171