Unverified
2026
When a chosen sparse support is geometrically incompatible with exact orthogonality, temporarily optimize on a nearby off-diagonally perturbed Stiefel constraint rather than forcing a singular Newton system. Anneal the perturbation to zero after the active support has stabilized, using the paper's O(||Delta||_F) KKT guarantee to control the residual of the original orthogonality-constrained problem.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Split a recurrent or state-space model into a persistent slow state and a fast internal state. Every r recurrent steps, preserve the slow state but reset or contract the fast state toward a learned reference, reproducing selective restart rather than a destructive global reset. The expected benefit is suppression of long-range oscillatory and error correlations while retaining trajectory-level information.
Useful6/10
Difficulty4/10
Novelty7/10
Unverified
2026
Construct a Lanczos chain for the neural-network vector field or hidden-state evolution, separately within bins of approximately constant loss, energy, or activation norm. Use the resulting Krylov complexity and Lanczos-coefficient growth as an early-warning signal for unstable training or long-horizon hidden-state amplification, then reduce the learning rate or recurrent integration step only in the unstable shells.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Insert a reference governor between a neural model's raw latent command and a linear state-space update, so that hidden states and outputs remain inside a prescribed union of polytopes. At every step, choose the largest interpolation toward the desired command whose predicted trajectory remains in the offline safe set. This can prevent hidden-state explosions and invalid latent trajectories without globally shrinking the model's weights.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Use the feedbacked control-to-state norm as a conditioning diagnostic to adapt the optimizer step applied to recurrent residual outputs. When the estimated horizon amplification is large, reduce or precondition the residual-control update; when feedback makes it small, permit larger updates.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Use the paper's explicitly solved SU(2)-based extremal flow as a structured recurrent transition instead of learning an unconstrained dense recurrent matrix. The transition has only two scalar parameters, a radius/frequency r and phase phi, while its rotating coefficient pattern continuously mixes four real state coordinates and can be integrated with a norm-preserving Cayley transform.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Represent a rational-like feature transformation with an auxiliary state y constrained by polynomial equations G(x,y)=0, and update x and y jointly along the tangent space of that constraint manifold. This creates residual blocks in which nonlinear feature identities remain consistent over many layers or time steps, reducing auxiliary-variable drift and potentially stabilizing rational activations and implicit recurrent dynamics.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Represent a recurrent transition using finite Jacobi coefficients with strictly positive off-diagonal entries, and regularize exponential moments of the associated spectral measures. This transfers the Toda lattice's exact phase-space condition into a practical certificate for recurrent dynamics. The exact global-well-posedness theorem applies to the autonomous Toda flow, while the neural-network version is a falsifiable regularization hypothesis for learned recurrent perturbations.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Distill a large or accurate latent transition model into a smaller discrete-state recurrent model while penalizing both its one-step transition mismatch and its lack of contraction. The filtering perturbation bound predicts that reducing the Dobrushin coefficient prevents errors from accumulating over long sequences, while reducing the transition discrepancy lowers the irreducible steady-state error.
Useful6/10
Difficulty4/10
Novelty7/10
Unverified
2026
Use multilevel sensitivity of the global interaction margin to identify which neural block, connection, or parameter group is responsible for instability. This provides a targeted alternative to uniformly shrinking the learning rate or regularizing every layer.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Add a functional-calculus regularizer to the transition operator of an RNN, linear state-space model, or deep-equilibrium layer. The regularizer uses polynomial probes to detect non-normal transient amplification that ordinary eigenvalue-radius penalties can miss.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Construct a hybrid neural ODE from several smooth vector-field branches and select the active branch using a learned Hamiltonian-like score. Track a positive-definite matrix representing local tangent sensitivity and force its discrete evolution to be positive semidefinite, adapting the paper's monotone Jacobi-curve condition to neural dynamics.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace a polynomial graph filter or repeated matrix multiplications in a graph neural network with a small rational filter evaluated at several shifts. Treat the incoming feature matrix as a block of probes rather than processing scalar probe vectors independently, allowing one set of shifted solves to expose multiple spectral directions simultaneously. The expected gain is higher approximation quality at the same number of operator applications, especially when the target filter has sharp or…
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Turn a recurrent or state-space memory into a constrained hereditary state: the latent state remains in a learned convex domain, and only input motion that reaches the boundary changes the plastic component. This creates a nonexpansive, rate-independent memory that should suppress unstable state growth and make the representation depend on meaningful cumulative changes rather than arbitrary update frequency.
Useful6/10
Difficulty4/10
Novelty5/10
Unverified
2026
Replace a conventional leaky recurrent update with a population of stochastic membrane potentials that evolve only while subthreshold, emit an event at threshold, undergo a delayed reset, and receive feedback from a filtered population firing rate. Add a shared noise source alongside independent neuron noise to regularize the layer while preserving coordinated population-level dynamics.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Use a symplectic Hamiltonian update as a recurrent or state-space neural block, preserving a learned modified energy across many layers or time steps. This targets residual and recurrent architectures where ordinary Euler updates accumulate drift during long rollouts.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Replace a dense learnable Fourier multiplier with a low-parameter multiplier concentrated near the common zero set of two polynomial constraint symbols. A linear constraint together with a cubic constraint can produce straight or curved frequency loci, allowing the network to represent directional long-range structure while using far fewer spectral parameters than a full 3D frequency grid.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Replace a fixed Fourier or spectral resolution in a neural operator or sequence model with a data-adaptive spectral cutoff. Keep only modes whose estimated signal energy exceeds the noise-amplification and discretization floor implied by the available number of trajectories and samples per trajectory. This should reduce overfitting to high-frequency sensor noise and preserve accuracy when the same model is deployed at different sampling resolutions.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Use the M phase-aligned parameterizations produced by cyclic reformulation as an empirical ensemble of neural dynamics rather than selecting one phase or averaging only predictions. Their centroid supplies a nominal model, while their convex hull defines a low-dimensional uncertainty set used for robust rollout training and uncertainty-aware inference.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Add a slow latent two-state gate to a recurrent, state-space, or world-model network so that separate experts represent two qualitatively different dynamical regimes. Train the gate using the paper's two-state population and fluctuation mechanism rather than allowing an unconstrained softmax to average incompatible regimes. The model should allocate extra capacity near the gate's susceptibility peak, where regime uncertainty and forecast variance are predicted to be largest.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Build a recurrent block as a fixed or learned ordering of local vertex foldings, mirroring the paper's identification of staircase solution maps with Coxeter elements of a folding group. Each folding changes one polygon coordinate by a rational cross-ratio completion while leaving all other coordinates unchanged. The resulting structured recurrence is reversible and can support constant-memory backpropagation by recomputing folds in reverse order.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Represent a hidden state as complex-valued points on a two-dimensional lattice and replace unconstrained local updates by the exact harmonic-quadrilateral completion rule from discrete conformal geometry. Given three corners of a plaquette, compute the fourth corner by a Mobius-rational formula enforcing cross-ratio minus one, then use a learned readout or forcing term for task-specific predictions. The layer supplies a hard geometric inductive bias and a directly measurable local constraint…
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Replace the usual explicit residual update with a nonstandard general-linear block containing several internal feature stages. The effective step is a positive denominator function rather than the raw depth step, allowing the block to take large nominal steps while damping the update and preserving bounded activations. This is most promising for deep residual MLPs, neural ODE discretizations, and state-space sequence models where exploding hidden states limit usable depth.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Use the paper's scattering energy balance as a measurable regularizer for an existing recurrent or state-space model instead of replacing its architecture. Penalize positive violations of the per-step energy inequality and, for paired examples, penalize violations of incremental passivity so that the model learns not to amplify perturbations over long sequences.
Useful6/10
Difficulty3/10
Novelty6/10