Solves: Stability

Machine-learning ideas tagged Stability in the Solves taxonomy of the Math2NN corpus.

2362 ideas found

Failed on benchmark 2026

Smooth Spectral Muon

Replace the exact matrix-polar normalization in Muon with the smoothed feedback \(h_\epsilon(M)=M(M^\top M+\epsilon I)^{-1/2}\). This retains singular-vector-aware updates and approximately unit-normalizes dominant spectral modes, but avoids unstable behavior when the momentum matrix is rank deficient or has tiny singular values.

Useful7/10
Difficulty5/10
Novelty4/10
Paper: A Continuous-Time Analysis of Smoothed Matrix-Polar Spectral Gradient Flows for Muon-Type Optimization arXiv:2608.01911
Failed on benchmark 2026

PIPO-PITO bounded recurrent gain

Build a positive continuous-depth RNN or state-space layer in which a nonnegative recurrent-input gain is generated by a PITO controller. If sustained large gain produces sustained large hidden-state output through a PIPO plant, the controller automatically decreases the gain, preventing runaway recurrent dynamics without requiring a globally tiny fixed gain. The construction predicts a quantitative attenuation threshold and exponential decay rate when the hidden output stays above that…

Useful7/10
Difficulty5/10
Novelty7/10
Paper: On input-output persistency and the interconnection of positive nonlinear systems arXiv:2608.01699
Mechanism failed 2026

Analytic Markov-Routing Lyapunov Controller

Use a finite-state Markov router to select recurrent or expert Jacobians, and regularize or optimize the router through the top Lyapunov exponent computed from state-conditioned projective statistics. The paper's mechanism predicts that this exponent varies smoothly with routing probabilities when the transition matrix is primitive and the dominant exponent is simple, while loss of primitivity, resonance, or exponent collision marks a detectable boundary where routing gradients may become…

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Analyticity of Lyapunov Exponents for Mixed Markov Quasi-Periodic Cocycles arXiv:2608.01569
✓✓ Beats tuned baseline 2026

Parallel Quadratic Tree Layer

Replace sequential upward message passing in a tree-structured neural module with rake–compress contraction of quadratic latent-state messages. Each node stores a quadratic value function and each edge stores a linear transition or coupling triple; leaf elimination and unary-node compression are implemented as batched Schur complements, followed by a reverse pass that reconstructs node latents and edge outputs. The layer is exact for Gaussian or quadratic latent models and remains…

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Rake-Compress Riccati Recursions for Parallel Scenario-Tree Model Predictive Control arXiv:2608.01332
Failed on benchmark 2026

Saturation-Adaptive Prefill Chunking

Replace fixed chunked-prefill settings in an LLM serving engine with a feedback controller that decreases the number of prompt tokens processed per scheduling quantum as GPU saturation or long-context load increases. The controller targets a high-quantile bound on the absolute GPU-power ramp while preserving the existing peak-power ceiling and measuring the resulting latency-throughput tradeoff.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: Smoothing the Ramp, Not the Peak: Scheduling-Induced Power Dynamics of LLM Inference and Their Grid-Scale Consequences arXiv:2608.01250
Mechanism confirmed, baseline not beaten 2026

BDD-Certified Modular Equilibrium Network

Partition a neural network into N interacting modules and constrain the Jacobian of its implicit residual map to be block diagonally dominant. Each module can compute its update locally while cross-module coupling is monitored through a normalized block-row margin. The certificate guarantees local nonsingularity of the equilibrium equations and predicts a sharp loss of robustness when the largest BDD ratio approaches one.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Decentralized Control Synthesis in IBR-Dominated Power Systems: A Block Diagonal Dominance Based Approach arXiv:2608.01236
Mechanism failed 2026

Kernel-Zubov Trust Region for Neural Rollouts

Use a convergent kernel approximation of the Zubov invariant as a trust-region monitor for a learned dynamics model. The estimated Zubov sublevel sets become an inference-time gate that rejects, shortens, or dampens transitions predicted to leave the learned attraction region.

Useful7/10
Difficulty5/10
Novelty8/10
Paper: Data-Driven Domain of Attraction Estimation via Convergent Koopman-Zubov Approximation arXiv:2608.01018
Failed on benchmark 2026

Hyperbolic Shadowing RNN

Constrain a recurrent transition so that its dynamically relevant invariant subspaces have no eigenvalues near the unit circle, separating contracting memory directions from expanding prediction directions. Add a pseudo-orbit consistency loss so that trajectories generated with bounded transition perturbations remain close to clean trajectories, as expected from hyperbolic shadowing.

Useful7/10
Difficulty6/10
Novelty6/10
Paper: Shadowing Endomorphisms of Compact Groups arXiv:2608.00955
Failed on benchmark 2026

Weakly Normally Hyperbolic Cyclic Optimizer

Augment an optimizer with a periodic phase and deliberately use a cyclic learning-rate or momentum forcing whose averaged dynamics have an attracting low-dimensional set. Treat the resulting periodic parameter orbit as an invariant torus and tune the schedule so transverse contraction dominates tangential sensitivity and minibatch perturbations. The goal is a robust, phase-locked training orbit that explores parameter space without losing attraction toward a useful solution manifold.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Weakly Normally Hyperbolic Invariant Tori: Persistence and an Averaging Principle arXiv:2608.00812
Mechanism failed 2026

Residual-to-Symbolic Neural Pruning

Use a two-stage residual augmentation loop: first let a residual network explain model mismatch, then project its learned vector field onto a physically constrained candidate library and replace the flexible residual with the accepted sparse terms. This turns an unconstrained neural correction into a low-complexity dynamical law that is easier to roll out over long horizons and can expose unsupported hidden-state explanations.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: SPIRAL-PO: Symbolic Identification of Partially Observed Nonlinear Dynamics with Application to Rotating Machinery arXiv:2608.00466
Mechanism failed 2026

Onsager–Casimir Response Regularizer

Train a sequence model so that measured perturbation responses and spontaneous hidden-state correlations satisfy the paper's off-diagonal fluctuation–response identity. This discourages arbitrary non-reciprocal dynamics while preserving a controlled antisymmetric response that can encode directional temporal dependencies.

Useful7/10
Difficulty6/10
Novelty8/10
Paper: Memory with Onsager-Casimir symmetry: Rotating particle in a viscoelastic fluid arXiv:2608.00344
Failed on benchmark 2026

Cross-Degree Certificate Against Recurrent Oscillation

Add a graph-structural anti-oscillation constraint to binary or thresholded recurrent message-passing networks. The paper shows that a partition with sufficiently many cross-partition neighbors creates an exact period-two orbit, so training can explicitly penalize such high cross-degree bipartite cores or choose the threshold above their strength.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Extinction thresholds in a graph-based model of HIV infection dynamics arXiv:2608.00340
Mechanism failed 2026

Critical-Gain Covariance Controller

Track the covariance of a small recurrent population state and regulate its effective gain before finite-size fluctuations diverge. The controller uses the covariance Jacobian eigenvalues from the paper, making the distance to criticality an explicit adaptive regularization signal for recurrent or state-space neural networks.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: Mechanistic bridges from receptors to whole-brain dynamics: mean-field reductions, validity domains, and computational trade-offs arXiv:2608.00306
Unverified 2026

Fading-Memory Habituation Gate

Add a per-feature or per-token state that accumulates recent stimulation and decays when stimulation is absent, then use a nonlinear decreasing gain to suppress repeatedly activated features. This creates short-term adaptation without changing the core transformer or recurrent weights: familiar inputs are processed with reduced gain, while novel inputs recover their full response.

Useful7/10
Difficulty4/10
Novelty6/10
Paper: Dynamical principles of habituation across substrates and scales arXiv:2608.00249
Failed on benchmark 2026

Robust Physics-Sparse Neural Dynamics

Replace an unconstrained neural transition model with a hybrid sparse dynamics model: retain analytically known first-order relaxation or control terms and learn only a sparse set of candidate interactions from a physics-guided library. Fit the library coefficients using a robust TLS-plus-RANSAC procedure, then use the identified model as the transition function or as a residual correction to a neural state-space model.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Physically Consistent SINDy (Sparse Identification of Nonlinear Dynamics) for Microgrid Identification and Real-Time Frequency Control arXiv:2608.00213
Mechanism confirmed, baseline not beaten 2026

Isometric tensor-network token mixer

Use the relaxed QFT tensor-network topology as a trainable norm-preserving mixer inside a neural block, replacing a dense token-mixing matrix or an expensive global convolution. The network learns data-adapted global interactions while retaining structured O(N log^2 N) application and an exact cheap inverse, making it suitable for image tokens, long sequences, or reversible residual blocks.

Useful7/10
Difficulty6/10
Novelty6/10
Paper: Fast Trainable Multilinear Bases for Image Compression arXiv:2608.00053
Failed on benchmark 2026

Descent-Certified LMO Sign Switching

Keep the empirically effective post-LMO sign update, but reject it whenever a fresh minibatch estimates that it is poorly aligned with the gradient. Fall back to the gradient-side error-feedback candidate in those cases. This converts the paper's constructive divergence warning into an inexpensive runtime safeguard rather than assuming that any sign placement is universally safe.

Useful7/10
Difficulty4/10
Novelty7/10
Paper: Sign compression for Muon: SignMuon, MuonSign, and the Limits of Error Feedback arXiv:2607.29674
✓✓ Beats tuned baseline 2026

Symmetry-Preserving Flow Layer

Construct hidden dynamics from permutation-equivariant vector fields and impose antisymmetry through an explicit antisymmetrizing readout. This prevents optimization from learning multiple equivalent copies of the same configuration and makes forbidden symmetry violations exactly zero, rather than merely penalizing them. The design applies to set models, particle systems, graph networks, and architectures handling unordered tokens.

Useful7/10
Difficulty5/10
Novelty4/10
Paper: Spindrift: Learning quantum degeneracy from thermal purity in restricted path integral Monte Carlo arXiv:2607.29590
Failed on benchmark 2026

Teleporting Simplicial Diffusion Layer

Replace ordinary graph message passing by diffusion over a simplicial complex or hypergraph, using incidence matrices to propagate information through nodes, edges, and higher-order faces. Mix the local higher-order walk with a teleportation operator so that the layer remains globally connected and avoids the slow mixing or oversmoothing caused by poorly connected complexes.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: Optimal Navigation on Simplicial Complexes arXiv:2607.29450
Failed on benchmark 2026

Coupled Workload-Order Gate

Train an admission or MoE routing gate not only to reduce its immediate workload, but also to preserve the ordering between a controlled trajectory and a baseline trajectory under the same request stream. Penalize counterfactual events in which the controlled system, after initially rejecting work, later exceeds the baseline workload because its changed state causes a large job to be admitted.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: When does admission control reduce congestion? A stochastic ordering approach arXiv:2607.29439
Mechanism failed 2026

Entropy-Response Tuning for Recurrent Reservoirs

Tune a recurrent neural reservoir to the operating regime where an input driver produces both a strong hidden-state response and a large discrepancy between driven and innate entropy-production rates. This replaces recurrent-gain selection based only on spectral radius with a measurable non-equilibrium screening criterion. The proposed score should peak near the gain that gives the best downstream prediction accuracy, while weakly driven and excessively unstable regimes should score poorly.

Useful7/10
Difficulty5/10
Novelty8/10
Paper: Entropy production of active matter systems as indicator for computing performance arXiv:2607.29434
Failed on benchmark 2026

Quotient-Fibre Mixing Network

Split a recurrent or state-space model into a coarse quotient state \(z_t\) and a leaf or fibre state \(y_t\), where the quotient evolves autonomously and the fibre is driven conditionally by the quotient. Constrain the two transition operators to have independently measurable contraction or correlation rates, then allocate capacity and regularization to the slower branch. This is intended for sequence tasks containing both slowly evolving global variables and rapidly mixing local variables.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Exponential mixing via invariant foliations and relatively Anosov homeomorphisms arXiv:2607.29391
Mechanism failed 2026

Mesh-Stable Residual Gain Chain

Replace unconstrained residual gains in a deep residual network or state-space model with cooperative, depth-dependent gains whose local ratios satisfy the paper's sufficient non-identical string-stability conditions. Each layer receives both its own state and a communicated predecessor feature, so perturbations from early layers are actively regulated rather than independently amplified through depth.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: A Cooperative Implementation of Mesh Stability in Vehicular Platoons arXiv:2607.28953
Failed on benchmark 2026

Marginal-Stability Disorder Schedule

Use the disorder-controlled stability boundary as a training schedule. Start with strong damping so optimization is well behaved, then reduce the damping margin toward zero to create long-lived oscillatory state memory after the network has learned useful representations.

Useful7/10
Difficulty4/10
Novelty7/10
Paper: Disorder induced time crystal in athermal random field Ising model with non-reciprocal interactions arXiv:2607.28781