ML: Rnn

Machine-learning ideas tagged Rnn in the ML taxonomy of the Math2NN corpus.

605 ideas found

Unverified 2026

AT-stable stochastic binary layer

Add a mean-field stochastic binary recurrent layer with an explicit susceptibility controller. The layer estimates the response statistic \(\chi=\beta^2N^{-1}\sum_i\operatorname{sech}^4(u_i)\) and either penalizes or clips it below \(1-\delta\), preventing the high-gain regime in which replicas with identical weights develop strongly divergent states. The expected benefit is more stable long-horizon recurrence and lower variance across stochastic forward passes.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: A quantitative replica-symmetric bound of Sherrington--Kirkpatrick model in the entire de Almeida--Thouless region arXiv:2608.23413
Unverified 2026

Basin-Entropy Threshold Tuning

Use the hysteresis threshold as a regularizer for attractor diversity. Estimate how many initial states converge to each fixed point and select thresholds that maximize basin entropy or penalize domination by one attractor, reducing attractor collapse in discrete recurrent classifiers and memory modules.

Useful5/10
Difficulty4/10
Novelty8/10
Paper: Basins of Attraction to Multiple Fixed Points in Discrete-time Hysteresis Neural Networks arXiv:2608.23225
Unverified 2026

Projective stationary-energy initialization

Split a recurrent state into two blocks and initialize their variances and cross-correlation according to the stationary projective energy distribution induced by the transition. This places the initial hidden state near the typical invariant direction of the dynamics instead of forcing a long transient from zero or isotropic noise.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Quantitative Furstenberg Theory for Large Random Matrices arXiv:2608.22543
Unverified 2026

Complex Phase-Corrected State Integrator

Use the complex-conjugate palindromic coefficient that cancels the leading temporal phase defect of oscillatory modes. Implement complex arithmetic directly or use an exactly equivalent doubled-real state, then project the final state to its real component for real-valued prediction tasks.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Sharp CFL stability and temporal-dispersion optimization of symmetric splitting schemes for time-domain Maxwell equations arXiv:2608.22315
Unverified 2026

Coherent-Fluctuating Amplitude Units

Represent selected hidden features as z = sqrt(N) exp(i theta), with a persistent phase and an explicitly stochastic amplitude. Regularize the ratio between coherent power |E[z]|^2 and total power E[|z|^2] toward the condensate prediction pi/4, while optionally matching higher amplitude moments.

Useful4/10
Difficulty5/10
Novelty8/10
Paper: Coherent Bose-Einstein condensation with fluctuating density arXiv:2607.12926