ML: Rnn

Machine-learning ideas tagged Rnn in the ML taxonomy of the Math2NN corpus.

601 ideas found

Unverified 2026

Supermixing Latent Recurrence

Replace or augment the transition map of a recurrent state-space model with bounded analytic maps of a latent complex coordinate, using several finite Blaschke generators that share a fixed point. Enforcing a superattracting fixed point of local degree p creates a tunable hierarchy of memory erasure: the theory predicts double-exponential decorrelation with exponent log p, while a merely attracting fixed point gives ordinary exponential decay.

Useful5/10
Difficulty7/10
Novelty9/10
Paper: Mixing for Free Semigroup Actions of Blaschke Products on the Circle arXiv:2608.13876
Unverified 2026

Elephant Adaptive Threshold

Replace the usual fixed threshold or exponentially decaying adaptive threshold in a recurrent spiking layer with a signed reinforcement accumulator. Each spike updates a per-neuron state S by a signed increment, and the next spike requires membrane potential to overcome alpha times the positive part of S. This creates history-dependent negative feedback under sustained firing while retaining the ability of negative reinforcement to restore excitability.

Useful5/10
Difficulty4/10
Novelty4/10
Paper: Spiking Neural Networks with Elephant Reinforcement arXiv:2608.12839
Unverified 2026

Discrepancy-bounded signed fast memory

Replace an unrestricted additive recurrent or fast-weight memory with a sign-selectable update: for each incoming update vector, choose between adding and subtracting it so that a smooth compact potential of the memory state is minimized. This is appropriate when the memory representation has sign symmetry, such as signed random features or a learned linear sketch; it is not a drop-in replacement for ordinary gradient updates where the sign carries semantic information.

Useful5/10
Difficulty5/10
Novelty9/10
Paper: Online balancing of vectors with small coordinates arXiv:2608.12490
Unverified 2026

Spectral Phase-Lifted Features

Augment a hidden representation with positively homogeneous interaction features built from approximate eigenmodes of a linear layer. Fractional products of mode magnitudes and phases provide nonlinear channels whose transformation laws are inherited from the spectrum of the underlying operator, potentially representing oscillatory or multiplicative dynamics more compactly than a generic MLP.

Useful5/10
Difficulty7/10
Novelty8/10
Paper: The spectrum of operator extensions to free Banach Lattices arXiv:2608.11437
Unverified 2026

Authority-Limited Removal Gating

Construct a branching residual network whose active computational paths reproduce according to a fixed offspring/connectivity law, while a controller can only remove paths using an age- or depth-dependent hazard \(u(a)\). Use the resulting bound as a diagnostic and gating schedule: removal can suppress unstable activity and reduce compute, but it should not be expected to cross the reproduction-driven propagation barrier unless the network's expansion operator is also changed.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Removal-Only Actuation in Age-Structured Branching Populations: Fundamental Limits of Equilibrium Placement arXiv:2608.10641
Unverified 2026

Parity-Conserving Reaction-Diffusion Memory

Replace unconstrained recurrent-state decay with a one-dimensional latent defect field whose states evolve by local diffusion and pair reactions. Defects can move over long distances and persist, while creation and removal occur only in pairs, giving the memory a structured cancellation mechanism that is potentially better suited to delayed-event and parity-like sequence dependencies than a standard GRU or diagonal SSM.

Useful5/10
Difficulty5/10
Novelty8/10
Paper: Kinetics of sliding-window quantum error correction arXiv:2608.10081
Unverified 2026

Isochronous Emden recurrent cell

Replace the linear state transition in a recurrent layer with a bank of odd-power modified Emden oscillators. The nonlinear terms provide state-dependent interactions while the paper's odd-q result preserves period T=2π/ω independently of amplitude, giving the model a stable internal phase clock for long sequences. External inputs should modulate the oscillator through a bounded forcing or readout gate rather than directly destroying the autonomous isochronous dynamics.

Useful5/10
Difficulty6/10
Novelty6/10
Paper: Isochronous and underdamped waveforms of modified Emden oscillators arXiv:2608.09008
Unverified 2026

Prescribed-Order Equilibrium Vector Field

Constrain a neural vector field to vanish to order at least k at a designated anchor state c. The network predicts smooth coefficient functions, while a fixed degree-k monomial gate supplies the required vanishing behavior. This exactly enforces the equilibrium and suppresses all local drift terms below order k, potentially improving stability and extrapolation near known rest states.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Finite-Rank Lie Algebroids for Singular Foliations of Prescribed Vanishing Order arXiv:2608.07351
Unverified 2026

Critical weak-spectrum penalty for area features

Apply a weak-trace spectral constraint to the covariance of antisymmetric second-order features, encouraging a 1/i eigenvalue envelope rather than forcing a finite trace norm. This targets the paper's sharp logarithmic Ky Fan behavior and may preserve useful long-tail interaction directions that nuclear-norm regularization would remove.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Infinite-Dimensional Levy Area: Probability-Selected Critical Geometry and Sharp Spectral Selection arXiv:2608.08756
Unverified 2026

Seven-Factor Stochastic Transition Layer

Parameterize a learned 3-state transition operator as a product of at most seven elementary row-stochastic matrices rather than learning its nine entries independently. Each factor performs one convex pull-in of row i toward row j, so every intermediate and final matrix remains row-stochastic and the layer has a sparse, bounded-depth interpretation.

Useful5/10
Difficulty4/10
Novelty7/10
Paper: Bang--bang representation of $3\times 3$ embeddable stochastic matrices arXiv:2608.08242
Unverified 2026

Rotation-Invariant Turning-Angle Matching

Add a trajectory-level loss that matches the empirical distribution of consecutive velocity turning angles between observed and generated sequences. Because turning angles are unchanged by a common rotation of all coordinates, the model is forced to reproduce hidden anisotropic and temporally correlated motion without being given a fixed laboratory-frame orientation.

Useful5/10
Difficulty4/10
Novelty7/10
Paper: Turning angle analysis reveals hidden anisotropies in the anomalous diffusion of molecules in live cells arXiv:2608.07975
Unverified 2026

Lyapunov-Continuation Initialization for Noisy State-Space Layers

Initialize and train a linear recurrent or state-space transition using the stochastic Lyapunov operator rather than only constraining the drift matrix to be Hurwitz. Start from a controller that stabilizes the drift-only dynamics, then continuously increase the multiplicative-noise coefficient and update the controller while enforcing a positive-definite Lyapunov certificate. The resulting module should avoid exploding hidden states when process noise depends on the hidden state or input.

Useful5/10
Difficulty5/10
Novelty6/10
Paper: Stabilizer Design for Policy Iteration in Stochastic Linear Quadratic Control: A Spectrum-Assignment Approach arXiv:2608.05953
Unverified 2026

Orlicz-Controlled Local Temporal Stability

Regularize a neural predictor so that its temporal partial averages remain stable when evaluated over shrinking neighborhoods of nearby inputs. The paper's mechanism suggests controlling a temporal maximal envelope in an Orlicz space, rather than controlling only pointwise variance or an L2 norm; the expected threshold is logarithmic, with L log L for ordinary consecutive averages and L log^(q+1) L for q-logarithmically normalized averages.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Sharp Orlicz Endpoints for Spatial-Temporal Ergodic Averaging arXiv:2608.03767
Unverified 2026

Entire Bilinear-Orthogonal Neural Flow

Replace an unconstrained recurrent or state-space transition with a complex-orthogonal flow generated by a skew-transpose matrix. The transition preserves a bilinear quadratic quantity exactly, preventing repeated application across long sequences from causing norm explosion or decay in the linear dynamics.

Useful5/10
Difficulty5/10
Novelty5/10
Paper: The pseudo-quantum representation of finite reversible Markov chains arXiv:2608.01253
Unverified 2026

Finite-State Extinction Monitor and Threshold Scheduler

Treat a quantized recurrent network as a finite deterministic state-transition system and distinguish absorption from latent periodic behavior during inference or training. Use the observed extinction threshold to adapt the activation threshold or recurrent gain, stopping once all tested trajectories reach the zero state and increasing the threshold when trajectories enter nontrivial cycles.

Useful5/10
Difficulty4/10
Novelty8/10
Paper: Extinction thresholds in a graph-based model of HIV infection dynamics arXiv:2608.00340
Unverified 2026

Finite-Population Binomial Rate Layer

Replace a deterministic population activation or router fraction by a finite-population random rate whose noise is derived from an explicit binomial transition law. The layer preserves the desired mean activation while injecting variance that decreases with population size, creating a controllable stochastic bottleneck rather than uncalibrated Gaussian noise.

Useful5/10
Difficulty3/10
Novelty5/10
Paper: Mechanistic bridges from receptors to whole-brain dynamics: mean-field reductions, validity domains, and computational trade-offs arXiv:2608.00306
Unverified 2026

Reflected Event-Driven Residual Dynamics

Replace a uniformly discretized recurrent or continuous-depth model with hybrid hidden-state dynamics: integrate a learned drift between event times, then apply a one-sided reflection update at each irregular observation or constraint event. The reflection prevents the hidden state from violating a lower obstacle, while the explicit jump decomposition avoids smearing abrupt information changes across many small residual steps.

Useful5/10
Difficulty4/10
Novelty5/10
Paper: Generalized reflected BSDEs with irregular obstacles driven by RCLL increasing processes on general filtered space arXiv:2607.29548
Unverified 2026

Green-Trace Cycle Regularizer

Use the resolvent trace as a differentiable statistic that controls how strongly a learned routing or recurrent transition matrix returns to short cycles. Penalizing this quantity suppresses accidental short feedback loops, while matching a target trace can impose a desired memory profile in recurrent, graph, or mixture-of-experts architectures.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Arithmetic Landscape Functions of a Discrete Cat Map arXiv:2607.24857
Unverified 2026

Sequence-Distortion Hidden-State Regularizer

Regularize the hidden-state trajectory of a sequence model so that the distance between states at positions i and j follows a controlled power-law profile in |i-j|. This explicitly prevents representation collapse over long contexts while avoiding the requirement that all distant states be maximally separated. Use alpha as a tunable geometry parameter and compare alpha against the effective hidden dimension using the paper's Euclidean realizability threshold.

Useful5/10
Difficulty3/10
Novelty6/10
Paper: Sequence distortion for metric spaces arXiv:2607.23713
Unverified 2026

Autonomous-Limit Quotient for Time-Varying RNNs

Treat each recurrent update or inference block as a time-dependent map F_n and regularize it toward a limiting autonomous map F whose long-horizon dynamics are easier to analyze. In addition to penalizing one-step map differences, impose a quotient-consistency loss so that pairs of hidden states that are asymptotically indistinguishable under F remain indistinguishable under every time-dependent generator F_n.

Useful5/10
Difficulty6/10
Novelty8/10
Paper: Proximal Relations and Maximal Equicontinuous Factors for Non-autonomous Dynamical Systems arXiv:2607.22849
Unverified 2026

Charged Diffusive-Precession State Space

Replace part of a sequence or spatiotemporal model's unconstrained recurrence with a bank of stable second-order filters whose poles are a frequency-shifted precession pole and a diffusion pole. The chemical-potential parameter produces oscillatory memory, while the diffusion parameter produces scale-dependent decay; a learned residual branch preserves expressivity when the prior is imperfect.

Useful5/10
Difficulty5/10
Novelty5/10
Paper: Flavour current correlators and the non-Abelian hydrodynamic approximation: the charged sector arXiv:2607.20991
Unverified 2026

Constant-gap brickwork unitary initialization

Initialize a unitary feature-mixing layer with a shallow brickwork circuit of independent random SU(4) gates instead of sampling or factorizing a dense Haar-random unitary. Stack enough layers to obtain a target contraction of non-Haar components, using the paper's constant spectral-gap principle to make the required depth essentially independent of the number of qubits. The resulting layer is local, parameter-efficient, exactly norm-preserving, and should provide Haar-like scrambling at…

Useful5/10
Difficulty5/10
Novelty6/10
Paper: Random unitary circuits with constant spectral gap arXiv:2607.20919
Unverified 2026

Polynomial Spectral Mode Controller

Replace an eigendecomposition-based spectral controller in a small recurrent or state-space transition layer with explicit polynomial projectors. Each hidden state is split into invariant modes, and each mode receives a separately constrained recurrent multiplier, enabling direct suppression of unstable modes or selective retention of long-memory modes using only matrix-polynomial evaluations.

Useful5/10
Difficulty6/10
Novelty6/10
Paper: A Direct Polynomial Approach to Spectral Decomposition arXiv:2607.20218
Unverified 2026

Shadowing-Constrained Latent Rollouts

Replace a deterministic latent transition with a set-valued relation consisting of all next states within a learned tolerance of the predicted transition, and train the model so noisy or approximate latent rollouts are shadowed by valid exact trajectories. Use forward and inverse-limit consistency losses to make the same robustness property visible in finite sequence windows.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Shadowing property and transitivity of a set-valued map and its inverse limit arXiv:2607.17325