✗ Failed on benchmark
2026
Estimate the local contraction rate along minibatch couplings of neural ODE or flow-matching trajectories instead of using one global Lipschitz lower bound. Use the resulting displacement-weighted rate to trigger adaptive solver tolerances, training-time regularization, or early stopping when the transported distributions have entered a strongly contracting region.
Useful8/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
For a neural ODE, residual flow, or deep equilibrium model with a dominant polynomial component, compute the directional dynamics induced by its highest-degree homogeneous term on the unit sphere. Penalize or reject parameter regions containing radially growing attracting directions, preventing finite-time activation blow-up while preserving nonlinear dynamics in safe directions.
Useful8/10
Difficulty6/10
Novelty8/10
✗ Failed on benchmark
2026
Replace a standard recurrent update with a two-state absolute-value cell whose local dynamics are exactly piecewise affine. Train the coupling parameters while enforcing discrete-time Schur inequalities inside each activation quadrant, preventing exploding recurrent trajectories while retaining nonsmooth gating and richer dynamics than a globally contractive linear cell.
Useful8/10
Difficulty5/10
Novelty6/10
✗ Failed on benchmark
2026
Use a neural network to predict only constitutive exchange coefficients, while a fixed skew-symmetric operator generates the conservative part of the update and a structured thermodynamic operator generates the irreversible source. The resulting layer preserves a chosen energy exactly in continuous time and can enforce nonnegative entropy production through a constrained parameterization of exchange rates.
Useful8/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Replace a dissipative optimizer update with a canonical discrete flow on the extended state $(\theta,p,t,e)$, where $\theta$ are network parameters, $p$ is momentum, $t$ is training time, and $e$ is its conjugate energy variable. Use a symmetric composition of exact Hamiltonian subflows for kinetic energy, loss, and time translation; this preserves the extended symplectic form and avoids artificial phase-volume collapse. Weak restarts or occasional damping can be added separately if convergence…
Useful8/10
Difficulty5/10
Novelty6/10
✗ Failed on benchmark
2026
Model a residual network, recurrent update, or optimizer as a switched linearized system in which each layer type, token, data batch, or optimizer regime selects a matrix mode. Constrain the worst-case product growth over admissible switches, rather than merely constraining every individual Jacobian, so arbitrary mode sequences remain contractive.
Useful8/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Partition a neural network into independently trained or independently monitored modules and constrain their cross-module interaction gain using a compositional contraction certificate. This enables stable deep modular MLPs, graph blocks, or recurrent modules without estimating the full network Jacobian, while providing an explicit coupling threshold for when the architecture loses contraction.
Useful8/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Add a non-autoregressive continuation layer to an RNN, SSM, or world model that predicts a future trajectory by solving for coefficients of a library of past trajectory windows and reusing those coefficients on the corresponding future windows. Unlike nearest-neighbor retrieval, the coefficients interpolate across multiple behaviors and can generalize to unseen systems whose output-visible eigenvalues are represented in the library.
Useful8/10
Difficulty5/10
Novelty6/10
✗ Failed on benchmark
2026
For a recurrent or graph neural network with known local connectivity, estimate each node's local Jacobian row using only graph neighbors rather than all hidden coordinates. Use the resulting sparse Jacobian both to compute a contraction certificate and to regularize training toward dynamically local interactions, reducing estimator variance and the number of samples required for reliable stability decisions.
Useful8/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Attach a streaming contraction monitor to a recurrent, state-space, or neural-ODE model and permit long-horizon rollout or autonomous deployment only when a conservative estimated contraction certificate is positive. The monitor estimates local Jacobian growth from recent state-transition observations and subtracts an uncertainty radius, preventing operation in regimes where apparent stability is caused by insufficient or noisy data.
Useful8/10
Difficulty5/10
Novelty6/10
✗ Failed on benchmark
2026
Replace unconstrained residual updates with blocks whose Jacobian is monitored through a Davis–Wielandt shell. The shell simultaneously measures directional dissipation and non-normal amplification, yielding a per-block step-size or residual-scale bound that is stronger than checking only the largest eigenvalue or spectral norm.
Useful8/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Train a neural ODE or continuous-time recurrent model directly against STL robustness, while requiring the resulting trajectory tube to satisfy the specification for every initial hidden state in a bounded set. Differentiable robustness provides an optimization objective, and interval, zonotope, or other set-based reachability provides a post-update certificate that prevents success caused by a narrow nominal trajectory.
Useful8/10
Difficulty6/10
Novelty8/10
✗ Failed on benchmark
2026
Replace the standard CFG guidance multiplier in each DDIM step by a coefficient obtained from the terminal guided exponent. Given unconditional and conditional denoiser-derived states D_u and D_c, use r^{1+w}-r instead of w(r-1) on the guidance direction D_u-D_c; this preserves the same two denoiser calls and costs no additional NFE while suppressing low-noise residual blow-up at high guidance.
Useful8/10
Difficulty3/10
Novelty8/10
✗ Failed on benchmark
2026
Replace an unconstrained recurrent or state-space update with a block whose state Jacobian is contractive and whose input Jacobian has a controlled gain. This should make hidden-state discrepancies caused by initialization, quantization, or input noise decay geometrically rather than explode, while retaining a finite and predictable response to persistent input perturbations.
Useful8/10
Difficulty5/10
Novelty5/10
✗ Failed on benchmark
2026
Compress each hidden layer by retaining directions that are simultaneously reachable from the observed input distribution and observable at the network output. Unlike PCA or SVD, the retained subspace is weighted by downstream task sensitivity, so high-variance but output-irrelevant directions can be removed while low-variance predictive directions are preserved.
Useful8/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Augment a flow-matching or diffusion sampler with a dual variable for each equality constraint and integrate the sample and dual variables as one coupled ODE. The learned generative velocity is corrected in the constraint-normal direction using the transpose Jacobian of the constraint, while the dual state accumulates residual violations; this replaces per-step projection or nonlinear optimization.
Useful8/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Replace ordinary global gradient clipping with clipping of each stochastic gradient around a robust minibatch center rather than around zero. This preserves the common directional component of the gradients and suppresses only heavy-tailed residuals, making the update usable when gradient noise has a finite α-moment for 1 < α ≤ 2 but no finite variance.
Useful7/10
Difficulty4/10
Novelty6/10
✗ Failed on benchmark
2026
Use the paper's certified-well geometry to turn continuous localization into a cheap grid proposal stage followed by fixed-step refinement. Threshold the projection-residual score on a coarse grid, then run a bandwidth-calibrated gradient map only from accepted points and merge converged duplicates. This avoids dense optimization from every possible coordinate and is suitable for neural slot or source heads that must return a variable number of continuous locations.
Useful7/10
Difficulty4/10
Novelty8/10
✗ Failed on benchmark
2026
Turn constrained-flow generation efficiency into an online diagnostic and controller for neural sampling. When the target ensemble changes faster than the flow can track or becomes internally complex, automatically shorten the training window, increase flow updates, or fall back to local MCMC instead of silently accepting biased or highly correlated samples.
Useful7/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Use the paper's explicit compact factor of a symplectic state-transition matrix to measure aggregate rotation speed in hidden-state dynamics. Penalize excessive or rapidly varying angular velocity rather than penalizing the full recurrent matrix, preserving nontrivial Hamiltonian rotations while suppressing phase drift that can destabilize long sequences.
Useful7/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Replace an unconstrained token mixer or feed-forward residual map with a feature-conditioned rational operator whose transfer matrix is positive real on the positive orthant. Apply it through a resolvent, rather than an additive residual, so that the accretivity certificate yields a nonexpansive implicit update and suppresses activation explosions.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Replace independent residual-block parameters by a stationary correlated sequence and set the residual multiplier according to the sequence's long-memory exponent and Hermite rank. This preserves a nontrivial O(1) input-output transformation as depth grows, while avoiding activation explosion or identity collapse caused by inappropriate residual scaling.
Useful7/10
Difficulty6/10
Novelty8/10
✗ Failed on benchmark
2026
Add a fading-memory consensus force to parameter dynamics, pulling the current parameter toward a distributed average of its past while preserving the ordinary gradient step. Implement the infinite memory through one or several recursive exponential states, and tune the memory decay so that quadratic-mode dynamics remain exponentially stable. This should suppress oscillations and catastrophic steps without relying on conventional momentum alone.
Useful7/10
Difficulty4/10
Novelty6/10
✗ Failed on benchmark
2026
Train a recurrent neural network or state-space model using a Poincare-style event loss: identify two consecutive latent alignment events and require the latent position and velocity at the second event to equal a transformed version of the first. Evaluate the Jacobian of this return map and penalize unstable non-neutral Floquet multipliers, producing long-horizon trajectories that are both periodic or symmetry-periodic and locally stable.
Useful7/10
Difficulty6/10
Novelty7/10