Unverified
2026
Regularize a learned state-space transfer function so its matrix response has positive real part on sampled points in the unit disk and its associated reproducing-kernel Gram matrix is positive semidefinite. This provides a frequency-domain stability signal that complements rollout-based penalties and spectral-radius clipping.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace a generic recurrent transition with two coupled unitary transitions that share one block column and differ by a sign on the other block column. Each transition preserves hidden-state norm exactly, while the structured difference gives a controlled two-path recurrent architecture for long-context modeling.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Replace an unconstrained latent transition by a layer with a distinguished scalar coordinate \(t\) and a symplectic leaf state \(x=(q,p)\). The layer advances \(t\) through a Reeb drift while updating \(x\) with a symplectic Hamiltonian step, preventing arbitrary mixing between progression and content coordinates and potentially improving long-horizon stability.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Choose gradient clipping thresholds from an explicit worst-case tail probability implied by an observed kurtosis bound, rather than using a fixed norm threshold or an empirical percentile. For a standardized centered gradient coordinate, the threshold achieving target outlier probability \(\delta\) is obtained by analytically inverting the paper's sharp tail formula.
Useful6/10
Difficulty4/10
Novelty5/10
Unverified
2026
Extract a small set of stable exponential modes from an observed neural sequence and use them to initialize a diagonal or block-diagonal state-space model. Hankel-pencil eigenvalues propose the modes, while persistence across shifts and contour margins reject modes caused by noise or a short-lived background.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace long unrolled trajectory losses with a direct invariance loss on a Fourier parameterization of a quasiperiodic latent torus. The network is trained to make its vector field tangent to the learned torus at every phase, providing a compact global constraint that can stabilize neural ODEs intended to model oscillatory or quasiperiodic dynamics.
Useful6/10
Difficulty5/10
Novelty9/10
Unverified
2026
Constrain a neural parameter block to a bounded open domain and replace its Euclidean optimizer with a Riemannian gradient induced by the Hessian of the logarithmic barrier g=-log(-rho). The metric diverges near the boundary, so updates automatically become small when parameters approach saturation or an invalid region, while the logarithmic exhaustion has bounded intrinsic gradient.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Model the scalar feedback route in a recurrent layer as a rank-one perturbation of its open-loop transition. Regularize the frequency response of that route so that no mode reaches unit loop gain, directly targeting oscillatory and slowly decaying instabilities rather than relying only on gradient clipping.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Replace standard heavy-ball momentum with an update derived from a discrete kinetic-minus-loss action and a discrete viscous force. The force discretization produces a rational damping factor that remains controlled over a specified range of step sizes, potentially reducing oscillations and instability without Adam-style second-moment state.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Use the paper's non-permutation-invariant overshoot bound as a runtime guard for large learning rates. A proposed step is accepted only if its predicted overshoot contribution is compatible with the observed gradient residual; otherwise the optimizer clips or shrinks the step, preventing isolated very large updates from causing delayed divergence.
Useful6/10
Difficulty4/10
Novelty7/10
Unverified
2026
Use the observed power-law decay of a scalar training signal to estimate the effective fractional order of the optimization dynamics, instead of choosing the memory exponent by hand. Then run a fractional-memory optimizer with the estimated order, allowing the algorithm to use stronger long-range memory during slow plateaus and weaker memory when the loss relaxes rapidly.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Train an unconstrained branch and a geometry-aware branch in parallel, then learn how much to trust the analytic branch. This preserves the benefit of explicit geometry on correctly specified tasks while allowing the model to ignore a misleading or irrelevant prior.
Useful6/10
Difficulty3/10
Novelty7/10
Unverified
2026
Treat a coupled neural training loop as a delayed feedback system with two hard delays and two first-order implementation filters. Estimate the dominant coupled Jacobian mode and use the characteristic equation to distinguish a recoverable delay-induced oscillation from a filter-induced instability; then reduce stale-gradient delay only in the former case, and slow or retune EMA or relaxation filters in the latter.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace an unconstrained feature vector entering a rational or resolvent-like neural operator by a polynomial feature whose first nonzero Taylor coefficient lies in a pole-safe subspace. For a pole of order m, the simplest guaranteed construction is psi(z)=(z-beta)^m v, which makes Q(z)psi(z) bounded even when Q(z) diverges. For lower-order cancellation, solve linear constraints among Taylor coefficients of psi so that all negative Laurent powers vanish.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Insert a scalar flux-correction-style limiter after a neural operator predicts a conservative state or residual. Interpolate between a known-admissible baseline state and the learned high-order candidate, choosing the largest coefficient that satisfies a geometric family of linear inequalities encoding positive density, positive pressure, and subluminal velocity. This retains as much of the neural prediction as possible instead of independently clipping physical variables.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Regularize a neural network's response along an ordered variable by requiring its sampled values to form a positive Hankel moment sequence. This upgrades ordinary pairwise monotonicity or log-convexity penalties into simultaneous constraints on several higher-order interactions, while remaining differentiable and inexpensive for small Hankel order.
Useful6/10
Difficulty3/10
Novelty8/10
Unverified
2026
Add a two-sided cone-restricted spectral penalty to a recurrent or state-space model. Instead of estimating growth using a symmetric singular-value surrogate, jointly optimize a positive right vector and positive left vector in the extended quotient from the paper, targeting a real generalized eigenvalue of the learned non-selfadjoint transition operator.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Parameterize a relative-position or lag-decay function as a finite positive mixture of exponentials instead of learning arbitrary attention bias values. The resulting kernel is completely monotone on positive distances, so it is nonnegative, decreasing, and has alternating derivative signs; the mixture provides several learned memory scales without allowing oscillatory or unstable long-range biases.
Useful6/10
Difficulty4/10
Novelty7/10
Unverified
2026
Augment a recurrent or state-space layer with a finite-order causal Volterra compensator that models and cancels dominant nonlinear feedback around a stable linear transition. Use quadratic terms by default and add cubic terms only when the model must operate farther from equilibrium, making truncation order an explicit compute and robustness control.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Wrap a learned residual policy or neural world-model controller around a stabilizing LQR feedback law, and permit sampling-based action refinement only when its estimated Monte Carlo and temperature errors fit inside a Lyapunov perturbation budget. Increase the rollout sample count, reduce temperature, or fall back to the baseline LQR action when the budget is violated. The controller should therefore trade computation for a measurable reduction in unstable or unsafe rollouts.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace pointwise spectral normalization of an RNN transition with a stability constraint on the entire family of input-conditioned matrices. Use a learned positive-definite metric P so every transition contracts in the same state geometry, approximating the paper's uniform exponential stability and input-forgetting guarantee.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Construct a latent layer whose node states are small positive-definite matrices and whose local updates follow a weighted cluster exchange relation rather than an unconstrained affine map. The update is reversible when the old state is retained, while noncommuting matrix products preserve relational structure that scalar cluster variables cannot represent.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Replace a time-dependent neural velocity field with a neural initial phase whose evolution is determined by the Madelung equations. Particles are sampled once from a reference density and then moved deterministically along the characteristic velocity field, while the quantum potential supplies a density-dependent smoothing and curvature correction.
Useful6/10
Difficulty7/10
Novelty6/10
Unverified
2026
Store a convex object as a direction-indexed vertex tuple and implement composition of objects through componentwise Minkowski addition and nonnegative scaling. This creates a structured residual or compositional layer where convexification is nonexpansive, making perturbation amplification controllable and avoiding repeated generic geometric optimization.
Useful6/10
Difficulty4/10
Novelty8/10