ML: Rnn

Machine-learning ideas tagged Rnn in the ML taxonomy of the Math2NN corpus.

583 ideas found

Unverified 2026

Event-Driven Hybrid Neural State Space

Replace a uniformly time-stepped neural ODE or state-space layer with a finite set of neural dynamical modes and an event scheduler. The hidden state follows the smooth flow of the current mode until a learned guard function crosses zero, at which point the solver evaluates the state at the event, switches mode, and continues with the new dynamics; this avoids numerical smearing of hard routing, thresholding, and switching behavior.

Useful6/10
Difficulty6/10
Novelty6/10
Paper: Event-Driven Simulation of Power Electronics Rich Grid Models arXiv:2608.22226
Unverified 2026

Two-Scalar Robust Residual Adaptation

Add two scalar adaptive gains to a neural controller or learned dynamical model: one estimates the unknown norm of the ideal neural approximation weights, and the other estimates the combined approximation, friction, and disturbance envelope. Sigma modification prevents unbounded gain growth, while the robust residual correction uses only these scalar estimates, independent of the number of neural features.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Adaptive RBFNN Control of Uncertain Bilateral Teleoperation Systems with Delay-Dependent LMI Stability Conditions arXiv:2608.20182
Unverified 2026

Lie-Bracket Orthogonal Mixer

Replace a dense unconstrained channel-mixing matrix with a differentiable product of exponentials of a few skew-symmetric generators and their iterated commutators. The resulting layer is exactly orthogonal, preserves feature norms, and can express rotations in directions not explicitly stored as independent parameters. This is especially suitable for residual MLP blocks, recurrent state transitions, and networks processing rotation- or pose-valued features.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Nonlinear Controllability and the Propagation of Local Information: From the Kalman Family to Lie Brackets, Rotation Groups, and Reachable Subgroups arXiv:2608.20094
Unverified 2026

Bures-Shaped Latent State Space

Add a stable linear latent state-space block whose controllability Gramian is trained toward a chosen positive-definite target using squared Bures–Wasserstein distance. Direction-specific semidefinite constraints can suppress disturbance amplification in nuisance coordinates while preserving controllability in coordinates needed for prediction.

Useful6/10
Difficulty6/10
Novelty7/10
Paper: A Controllability Gramain Shaping with LMI Constraints under Bures--Wasserstein Distance arXiv:2608.19754
Unverified 2026

Reachability-Tube Monitor for Hidden States

Attach a low-dimensional reachable-set monitor to an RNN or state-space model and propagate the set of hidden states allowed by bounded inputs, parameter uncertainty, and process noise. Penalize or reset hidden states that leave the predicted tube, turning the paper's instantaneous set-membership fault test into a robust neural-state validity test.

Useful6/10
Difficulty6/10
Novelty7/10
Paper: Reachability-based Time-domain Distance Protection arXiv:2608.19678
Unverified 2026

Lienard Multi-Cycle Recurrent Cell

Replace the generic nonlinear drift in a two-dimensional continuous-time recurrent cell by a learnable piecewise-linear Lienard restoring force. Fold breakpoints and jump breakpoints become explicit architectural controls for creating multiple oscillatory attractors, allowing hidden states to encode phase, mode, or periodic memory. Weak input coupling can select or perturb attractors while preserving the autonomous cycle structure.

Useful6/10
Difficulty6/10
Novelty7/10
Paper: The number of limit cycles of piecewise linear Liénard systems arXiv:2608.19542
Unverified 2026

Normal Spectral Linear Layer

Replace an unconstrained dense transition or recurrent matrix with a normal matrix $A=U\operatorname{diag}(\lambda)U^*$, where $U$ is unitary and $\lambda$ contains learnable eigenvalues. The layer can be initialized by fitting a normal matrix to input-output pairs through the paper's objective, then trained with Riemannian updates that keep $U$ unitary and preserve the normal-operator structure.

Useful6/10
Difficulty6/10
Novelty6/10
Paper: The Normal Procrustes Problem: A Riemannian Optimization Approach arXiv:2608.19513
Unverified 2026

Reciprocal-Gain Loxodromic Memory

Use paired recurrent channels with exactly reciprocal gains while applying a common phase rotation. One channel carries a controlled expanding mode and the other a matching contracting mode, creating a tunable hyperbolic memory spectrum without the optimization fragility of an unconstrained recurrent matrix.

Useful6/10
Difficulty5/10
Novelty5/10
Paper: Outer Contact Billiards arXiv:2608.19393
Unverified 2026

Integrable Elliptic Memory Cell

Replace an unconstrained recurrent transition with block-diagonal planar rotations whose angles are learned or conditioned on a slowly varying context variable. The resulting hidden-state norm and each two-dimensional block energy are exactly invariant in the ideal recurrence, preventing exploding or vanishing recurrent dynamics while retaining phase information over long horizons.

Useful6/10
Difficulty4/10
Novelty4/10
Paper: Outer Contact Billiards arXiv:2608.19393
Unverified 2026

BT-Critical Long-Memory Initialization

Construct a recurrent or state-space layer whose equilibrium Jacobian is placed near a nondegenerate Bogdanov–Takens point, then use a small unfolding parameter to move between damped, oscillatory, and slowly relaxing regimes. Unlike eigenvalue-only initialization near one, this controls both the double-zero center structure and the quadratic nonlinear coefficients that determine the local phase portrait.

Useful6/10
Difficulty6/10
Novelty8/10
Paper: The Bogdanov--Takens normal-form coefficients in $\mathbb{R}^n$ as directional derivatives of the characteristic invariants arXiv:2608.19018
Unverified 2026

Pascal-Hessian Observer State Model

Constrain a low-dimensional neural state-space model so that its vector-field Hessian approximately satisfies the paper's Pascal-Hessian condition. Combine the resulting latent dynamics with an observer correction driven by the prediction residual, giving a model whose hidden-state estimation error can be assigned a desired linear decay rate.

Useful6/10
Difficulty7/10
Novelty8/10
Paper: Simple Verification and Implementation of Observer Error Dynamics Linearization: A Pascal's Triangle--Hessian Matrix Criterion arXiv:2608.18804
Unverified 2026

Koenigs-Linearized Disk RNN

Constrain a recurrent latent state to the unit disk and learn an auxiliary Koenigs coordinate in which the recurrent transition is a scalar dilation. The nonlinear transition is trained to satisfy the conjugacy equation, so repeated application has a prescribed asymptotic rate instead of accumulating uncontrolled Jacobian errors.

Useful6/10
Difficulty7/10
Novelty8/10
Paper: Characterizations of extremal hyperbolic rates via Herglotz measures and Koenigs linearization arXiv:2608.18781
Unverified 2026

Critical-Set Cone Monitor

Add a Jacobian cone-field regularizer to recurrent dynamics so that tangent directions expand and remain aligned with an unstable cone outside a designated critical neighborhood. The network is not forced to be uniformly expanding: the regularizer is disabled near the critical set, allowing controlled bifurcation-like behavior while exposing where long-horizon sensitivity changes.

Useful6/10
Difficulty7/10
Novelty8/10
Paper: Maximal attractors for perturbations of unimodal maps near a homoclinic tangency arXiv:2608.18761
Unverified 2026

Adaptive Harmonic Gradient Damping

Treat the component of minibatch-gradient noise that is coherent across iterations as an unknown periodic disturbance, estimate its phase and frequency with a latent oscillator, and subtract an anti-phase update from the optimizer step. Unlike fixed momentum or a fixed low-pass filter, the oscillator estimates the disturbance frequency online and therefore does not require prior knowledge of the data period, sequence period, or model-specific time scale.

Useful6/10
Difficulty6/10
Novelty7/10
Paper: Payload Swing Estimation and Damping Without Payload Parameters for Multirotor UAVs arXiv:2608.18625
Unverified 2026

Rank-One Small-Gain Recurrent Controller

When a recurrent or graph coupling matrix is approximately rank one, replace expensive full spectral monitoring with a scalar small-gain controller. Adapt a residual mixing coefficient so that the dominant coupled mode remains below a prescribed contraction threshold.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Robust Instability Radius for Networked Dynamical Systems: Upper and Lower Bounds arXiv:2608.18561
Unverified 2026

Latent Itinerancy Graph Regularizer

Apply a set-oriented graph analysis to the latent state dynamics of an RNN, SSM, or world model. Partition latent trajectories into compact cells, estimate the multivalued transition graph and its Markov matrix, then regularize the model so that recurrent latent modes form coherent strongly connected components with controlled transition entropy rather than spurious unstable wandering. This preserves meaningful metastable modes while preventing long-horizon rollout statistics from drifting away…

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Set-Oriented Approach to the Analysis of Chaotic Itinerancy arXiv:2608.17905
Unverified 2026

Probability-Preserving Zonotopic Neural Uncertainty

Attach a finite mixture of zonotopes to each uncertain neural input or hidden state, and propagate every mixture component through affine layers and conservative nonlinear relaxations. When the number of components grows, merge components only with an enclosing zonotope and sum their probability masses, preserving a formal lower bound on the probability that the true activation lies in the represented set.

Useful6/10
Difficulty6/10
Novelty7/10
Paper: The Zonotopic Mixture Filter arXiv:2608.17897
Unverified 2026

Finite-Support Sparse Correction Horizon

Represent an iterative neural computation as a controlled dynamical system and learn sparse residual corrections that are active only for a finite prefix of iterations. Estimate local stable and anti-stable subspaces of the hidden-state Jacobian, increase the correction horizon only while the anti-stable component exceeds a tolerance, and force later controls to zero. This produces adaptive-depth inference with a quantitative stopping criterion.

Useful6/10
Difficulty6/10
Novelty7/10
Paper: Infinite-Horizon Sparse Optimal Control: Solution through a Finite-Horizon Subproblem and Its Receding-Horizon Implementation arXiv:2608.17464
Unverified 2026

ISS Backstepping Latent Regulator

Replace unconstrained latent or neural-ODE dynamics with a strict-feedback cascade whose virtual controls are generated recursively by nonadaptive backstepping. Add a fixed internal-model oscillator when the desired output contains known-frequency periodic components, so the network tracks persistent targets without learning an unstable long-memory representation. The controller is designed to tolerate bounded neural-model mismatch and disturbances through an input-to-state stability margin.

Useful6/10
Difficulty7/10
Novelty7/10
Paper: Nonadaptive Learning in Robust Nonlinear Output Regulation arXiv:2608.17262
Unverified 2026

Lowest-weight su(1,1) state-space layer

Replace a learned dense recurrent transition with a truncated lowest-weight \(\mathrm{su}(1,1)\) ladder acting on hidden coordinates indexed by \(n=0,\ldots,N-1\). The ladder coefficients create a nonuniform, analytically specified coupling that grows with state index, while a negative \(J_0\) term supplies controllable dissipation and the skew combination \(J_+-J_-\) supplies conservative mixing.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Romanovski polynomials, Gegenbauer connections, and $\mathrm{su}(1,1)$ ladder structures arXiv:2608.17221
Unverified 2026

Spatial Phase-Pattern Entropy Monitor and Regularizer

Attach two oscillator channels to each recurrent, state-space, or graph hidden unit and convert them into a phase field over nodes or spatial positions. Encode every overlapping triple of neighboring phases as one of the 13 weak ordinal patterns, including seven near-tie patterns, then use the resulting normalized entropy and pattern frequencies to detect hidden-state collapse, coherent clustering, or transient regime changes. During training, either use the entropy only as a controller for…

Useful6/10
Difficulty5/10
Novelty8/10
Paper: Phase-based spatial ordinal patterns for characterizing oscillatory dynamics arXiv:2608.17196
Unverified 2026

Entropy-to-Contraction Attractor Regularization

Construct a contractive multi-branch recurrent or generative network whose branches define an iterated-function system, and regularize it so that branch entropy is high relative to average contraction while compositions remain exponentially separated. The target is a measurable attractor-dimension law rather than only a benchmark improvement: the invariant measure dimension should approach min(d, H divided by chi), where d is state dimension.

Useful6/10
Difficulty6/10
Novelty7/10
Paper: Dimension of self-conformal measures associated to an exponentially separated holomorphic IFS arXiv:2608.17137
Unverified 2026

Kac-Ward Criticality Controller

Replace an unconstrained message-passing or recurrent propagation matrix by a directed-edge operator with non-backtracking connectivity and orientation-dependent turning phases, inspired by the Kac–Ward construction. During training, monitor and control the zero-momentum spectral gap of \(\mathcal A(0)=I-K(0)\), keeping the model near but on the stable side of the critical surface to obtain long memory without uncontrolled amplification.

Useful6/10
Difficulty6/10
Novelty7/10
Paper: Critical couplings of two dimensional Ising model on various lattices arXiv:2608.16949
Unverified 2026

Dimension-calibrated contractive branch attractor

Construct a recurrent or generative network from finitely many contractive branches whose hidden-state attractor has a prescribed similarity dimension. The branch contraction ratios determine the target complexity through the equation sum_i r_i^s = 1, while a separation penalty approximates the open set condition and prevents branch collapse or excessive overlap.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: The Moran--Hutchinson formula in semimetric spaces arXiv:2608.16817