Solves: Stability

Machine-learning ideas tagged Stability in the Solves taxonomy of the Math2NN corpus.

2330 ideas found

Mechanism confirmed, baseline not beaten 2026

Van der Corput progressive expert scheduler

Replace random or greedy one-expert-at-a-time activation with a deterministic binary van der Corput sequence. At each training or inference step, the schedule chooses an expert whose cumulative usage remains close to its proportional target, while recursively balancing nested expert groups rather than only balancing individual experts.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: House-monotone multi-level apportionment has logarithmic quota discrepancy arXiv:2608.02559
Failed on benchmark 2026

Smooth Barrier Tube Controller

Treat undesirable neural-network states as obstacles and steer training or inference away from them with a smooth distance barrier while preserving a nominal loss descent direction. The barrier can protect against exploding activations, excessive attention concentration, unsafe controller outputs, or leaving a certified representation region without introducing discontinuous gradient clipping.

Useful7/10
Difficulty4/10
Novelty5/10
Paper: Safe and robust tube-based path-following for robot navigation arXiv:2608.02530
Mechanism confirmed, baseline not beaten 2026

Gradient-Projected Rectified Flow

Replace the unconstrained rectified-flow velocity predictor with the gradient of a learned scalar potential. At every rectification round, fit the potential by weighted least squares to the current displacement field, then integrate the resulting conservative velocity from the source distribution to the target distribution. The gradient restriction is intended to eliminate non-transport rotational motion and improve convergence toward the quadratic optimal-transport coupling.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Computational and Statistical Guarantees of the \textit{c}-Rectified flow arXiv:2608.02487
✓✓ Beats tuned baseline 2026

Entropy-production adaptive diffusion sampler

Use an entropy-production-inspired local discrepancy between full-step and coupled half-step reverse diffusion trajectories as an adaptive error signal. The sampler takes large Euler steps where the estimated marginal mismatch is small and refines only where score variation or reverse-flow mismatch is high, targeting terminal KL rather than path-space error.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: A Unified Kullback--Leibler Divergence Analysis of Generative Diffusion Models via Entropy Production Rate arXiv:2608.02406
Mechanism confirmed, baseline not beaten 2026

Reachset-Conformance Noise Calibration

Calibrate process and observation uncertainty bounds by requiring a learned neural dynamical model to contain calibration trajectories in its reachable sets, instead of fitting a Gaussian noise model. The resulting bounds can control an uncertainty-aware loss, trigger teacher forcing or re-observation, and identify latent coordinates whose dynamics are not adequately modeled. This transfers the paper's conformance principle into a falsifiable training monitor and adaptive rollout schedule.

Useful7/10
Difficulty5/10
Novelty8/10
Paper: A General Set-Based Framework for Cognitive State Estimation: Theory and Application to Conditionally Automated Driving arXiv:2608.02308
Mechanism confirmed, baseline not beaten 2026

Komuro Time-Warp Expansivity Regularizer

Apply Komuro-style expansivity to a continuous-time neural latent flow by requiring distinct latent trajectories to separate even when the second trajectory is allowed an arbitrary increasing time reparametrization. This targets neural ODE world models and irregularly sampled sequence models, where ordinary pointwise separation can mistake clock-speed differences for different states.

Useful7/10
Difficulty6/10
Novelty8/10
Paper: Komuro Expansivity and Periodic Orbit Growth for Multi-Singular Hyperbolic Flows arXiv:2608.02186
Mechanism confirmed, baseline not beaten 2026

Bundle-Glued Neural Field

Represent a field on a manifold with one neural network per chart, while enforcing the exact transition law between chart outputs on overlaps. This avoids the artificial requirement that one coordinate frame work globally and should improve learning on spherical, periodic, or otherwise topologically nontrivial domains. Use an augmented Lagrangian rather than only a pointwise penalty so chart compatibility is enforced strongly without requiring identical local parameterizations.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Finite element discretization of Yang--Mills connections arXiv:2608.02108
Mechanism confirmed, baseline not beaten 2026

Phenotype-Rao-Blackwellized ES

Modify an evolutionary-strategy gradient estimator so that the observed phenotype or trajectory is used to infer the conditional mean of the latent ES perturbation. Instead of multiplying fitness by the raw perturbation, multiply it by the posterior mean perturbation given the realized input; this remains unbiased and has variance no greater than the ordinary ES estimator when the conditional model is correct.

Useful7/10
Difficulty5/10
Novelty8/10
Paper: Accelerating Evolutionary Strategy via Rao-Blackwellizing Realization of Uncertain Input arXiv:2608.02073
Failed on benchmark 2026

Smooth Spectral Muon

Replace the exact matrix-polar normalization in Muon with the smoothed feedback \(h_\epsilon(M)=M(M^\top M+\epsilon I)^{-1/2}\). This retains singular-vector-aware updates and approximately unit-normalizes dominant spectral modes, but avoids unstable behavior when the momentum matrix is rank deficient or has tiny singular values.

Useful7/10
Difficulty5/10
Novelty4/10
Paper: A Continuous-Time Analysis of Smoothed Matrix-Polar Spectral Gradient Flows for Muon-Type Optimization arXiv:2608.01911
Failed on benchmark 2026

PIPO-PITO bounded recurrent gain

Build a positive continuous-depth RNN or state-space layer in which a nonnegative recurrent-input gain is generated by a PITO controller. If sustained large gain produces sustained large hidden-state output through a PIPO plant, the controller automatically decreases the gain, preventing runaway recurrent dynamics without requiring a globally tiny fixed gain. The construction predicts a quantitative attenuation threshold and exponential decay rate when the hidden output stays above that…

Useful7/10
Difficulty5/10
Novelty7/10
Paper: On input-output persistency and the interconnection of positive nonlinear systems arXiv:2608.01699
Mechanism failed 2026

Analytic Markov-Routing Lyapunov Controller

Use a finite-state Markov router to select recurrent or expert Jacobians, and regularize or optimize the router through the top Lyapunov exponent computed from state-conditioned projective statistics. The paper's mechanism predicts that this exponent varies smoothly with routing probabilities when the transition matrix is primitive and the dominant exponent is simple, while loss of primitivity, resonance, or exponent collision marks a detectable boundary where routing gradients may become…

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Analyticity of Lyapunov Exponents for Mixed Markov Quasi-Periodic Cocycles arXiv:2608.01569
✓✓ Beats tuned baseline 2026

Parallel Quadratic Tree Layer

Replace sequential upward message passing in a tree-structured neural module with rake–compress contraction of quadratic latent-state messages. Each node stores a quadratic value function and each edge stores a linear transition or coupling triple; leaf elimination and unary-node compression are implemented as batched Schur complements, followed by a reverse pass that reconstructs node latents and edge outputs. The layer is exact for Gaussian or quadratic latent models and remains…

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Rake-Compress Riccati Recursions for Parallel Scenario-Tree Model Predictive Control arXiv:2608.01332
Failed on benchmark 2026

Saturation-Adaptive Prefill Chunking

Replace fixed chunked-prefill settings in an LLM serving engine with a feedback controller that decreases the number of prompt tokens processed per scheduling quantum as GPU saturation or long-context load increases. The controller targets a high-quantile bound on the absolute GPU-power ramp while preserving the existing peak-power ceiling and measuring the resulting latency-throughput tradeoff.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: Smoothing the Ramp, Not the Peak: Scheduling-Induced Power Dynamics of LLM Inference and Their Grid-Scale Consequences arXiv:2608.01250
Mechanism confirmed, baseline not beaten 2026

BDD-Certified Modular Equilibrium Network

Partition a neural network into N interacting modules and constrain the Jacobian of its implicit residual map to be block diagonally dominant. Each module can compute its update locally while cross-module coupling is monitored through a normalized block-row margin. The certificate guarantees local nonsingularity of the equilibrium equations and predicts a sharp loss of robustness when the largest BDD ratio approaches one.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Decentralized Control Synthesis in IBR-Dominated Power Systems: A Block Diagonal Dominance Based Approach arXiv:2608.01236
Mechanism failed 2026

Kernel-Zubov Trust Region for Neural Rollouts

Use a convergent kernel approximation of the Zubov invariant as a trust-region monitor for a learned dynamics model. The estimated Zubov sublevel sets become an inference-time gate that rejects, shortens, or dampens transitions predicted to leave the learned attraction region.

Useful7/10
Difficulty5/10
Novelty8/10
Paper: Data-Driven Domain of Attraction Estimation via Convergent Koopman-Zubov Approximation arXiv:2608.01018
Failed on benchmark 2026

Hyperbolic Shadowing RNN

Constrain a recurrent transition so that its dynamically relevant invariant subspaces have no eigenvalues near the unit circle, separating contracting memory directions from expanding prediction directions. Add a pseudo-orbit consistency loss so that trajectories generated with bounded transition perturbations remain close to clean trajectories, as expected from hyperbolic shadowing.

Useful7/10
Difficulty6/10
Novelty6/10
Paper: Shadowing Endomorphisms of Compact Groups arXiv:2608.00955
Failed on benchmark 2026

Weakly Normally Hyperbolic Cyclic Optimizer

Augment an optimizer with a periodic phase and deliberately use a cyclic learning-rate or momentum forcing whose averaged dynamics have an attracting low-dimensional set. Treat the resulting periodic parameter orbit as an invariant torus and tune the schedule so transverse contraction dominates tangential sensitivity and minibatch perturbations. The goal is a robust, phase-locked training orbit that explores parameter space without losing attraction toward a useful solution manifold.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Weakly Normally Hyperbolic Invariant Tori: Persistence and an Averaging Principle arXiv:2608.00812
Mechanism failed 2026

Residual-to-Symbolic Neural Pruning

Use a two-stage residual augmentation loop: first let a residual network explain model mismatch, then project its learned vector field onto a physically constrained candidate library and replace the flexible residual with the accepted sparse terms. This turns an unconstrained neural correction into a low-complexity dynamical law that is easier to roll out over long horizons and can expose unsupported hidden-state explanations.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: SPIRAL-PO: Symbolic Identification of Partially Observed Nonlinear Dynamics with Application to Rotating Machinery arXiv:2608.00466
Mechanism failed 2026

Onsager–Casimir Response Regularizer

Train a sequence model so that measured perturbation responses and spontaneous hidden-state correlations satisfy the paper's off-diagonal fluctuation–response identity. This discourages arbitrary non-reciprocal dynamics while preserving a controlled antisymmetric response that can encode directional temporal dependencies.

Useful7/10
Difficulty6/10
Novelty8/10
Paper: Memory with Onsager-Casimir symmetry: Rotating particle in a viscoelastic fluid arXiv:2608.00344
Failed on benchmark 2026

Cross-Degree Certificate Against Recurrent Oscillation

Add a graph-structural anti-oscillation constraint to binary or thresholded recurrent message-passing networks. The paper shows that a partition with sufficiently many cross-partition neighbors creates an exact period-two orbit, so training can explicitly penalize such high cross-degree bipartite cores or choose the threshold above their strength.

Useful7/10
Difficulty5/10
Novelty7/10
Paper: Extinction thresholds in a graph-based model of HIV infection dynamics arXiv:2608.00340
Mechanism failed 2026

Critical-Gain Covariance Controller

Track the covariance of a small recurrent population state and regulate its effective gain before finite-size fluctuations diverge. The controller uses the covariance Jacobian eigenvalues from the paper, making the distance to criticality an explicit adaptive regularization signal for recurrent or state-space neural networks.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: Mechanistic bridges from receptors to whole-brain dynamics: mean-field reductions, validity domains, and computational trade-offs arXiv:2608.00306
Unverified 2026

Fading-Memory Habituation Gate

Add a per-feature or per-token state that accumulates recent stimulation and decays when stimulation is absent, then use a nonlinear decreasing gain to suppress repeatedly activated features. This creates short-term adaptation without changing the core transformer or recurrent weights: familiar inputs are processed with reduced gain, while novel inputs recover their full response.

Useful7/10
Difficulty4/10
Novelty6/10
Paper: Dynamical principles of habituation across substrates and scales arXiv:2608.00249
Failed on benchmark 2026

Robust Physics-Sparse Neural Dynamics

Replace an unconstrained neural transition model with a hybrid sparse dynamics model: retain analytically known first-order relaxation or control terms and learn only a sparse set of candidate interactions from a physics-guided library. Fit the library coefficients using a robust TLS-plus-RANSAC procedure, then use the identified model as the transition function or as a residual correction to a neural state-space model.

Useful7/10
Difficulty6/10
Novelty7/10
Paper: Physically Consistent SINDy (Sparse Identification of Nonlinear Dynamics) for Microgrid Identification and Real-Time Frequency Control arXiv:2608.00213
Mechanism confirmed, baseline not beaten 2026

Isometric tensor-network token mixer

Use the relaxed QFT tensor-network topology as a trainable norm-preserving mixer inside a neural block, replacing a dense token-mixing matrix or an expensive global convolution. The network learns data-adapted global interactions while retaining structured O(N log^2 N) application and an exact cheap inverse, making it suitable for image tokens, long sequences, or reversible residual blocks.

Useful7/10
Difficulty6/10
Novelty6/10
Paper: Fast Trainable Multilinear Bases for Image Compression arXiv:2608.00053