✗ Mechanism failed
2026
Replace or augment a deterministic recurrent hidden state with a stochastic Markov transition, then explicitly measure its entropy production and output memory time. Penalize operating points where the target changes faster than the hidden state can track at the available dissipation, while allowing the model to satisfy the bound either by increasing transition activity or by developing a longer-lived memory mode.
Useful8/10
Difficulty6/10
Novelty8/10
✗ Failed on benchmark
2026
Replace correlation-based memory pruning in an RNN or state-space model by measuring how hidden-state history changes the response to individual past input events. Train a compressed memory coordinate only if it preserves the event-consequence kernel for the target observable, such as future loss, prediction, or control return. A memory representation is accepted when the conditional variance of this kernel within compressed-state groups is small, even if dwell-time or autocorrelation…
Useful8/10
Difficulty6/10
Novelty8/10
✗ Failed on benchmark
2026
Construct a continuous-time SSM or neural ODE whose hidden-state dynamics use rapidly varying periodic parameters while enforcing contraction of the instantaneous Jacobian. In the high-frequency regime, replace the expensive oscillatory dynamics with an averaged SSM during long-horizon rollout; the averaging principle predicts finite-horizon trajectory convergence, while contraction predicts stable long-time behavior.
Useful8/10
Difficulty6/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Replace a deterministic recurrent transition by an iid-random family of transitions and explicitly control the spectrum of the corresponding annealed Koopman operator. Nontrivial eigenvalues inside the unit disk give a measurable exponential memory-decay envelope, while complex eigenvalues provide stable oscillatory memory modes useful for long-horizon sequence prediction.
Useful8/10
Difficulty6/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Replace full-dimensional node or weight perturbation with perturbations in an input-conditioned d-dimensional tangent subspace, where d is the input or feature dimension and is much smaller than the reservoir width or parameter count. Estimate the update using only scalar self-supervised losses from positive and negative perturbations, then map the low-dimensional update back to the trainable parameters.
Useful8/10
Difficulty5/10
Novelty7/10
✗ Mechanism failed
2026
Replace a memoryless clipped recurrent output with a clipped observable plus a latent retained overshoot. The network exposes only a bounded output, but stores a fraction of the amount that would have exceeded the bound and feeds it into the next hidden-state update, allowing the model to represent persistent post-saturation effects without making the visible output unstable.
Useful7/10
Difficulty5/10
Novelty7/10
✗ Mechanism failed
2026
Replace or augment a recurrent hidden coordinate with a nonnegative bistable autocatalytic state driven by an external control signal. The cell retains information through metastable low and high states, while a periodic or slowly varying control produces a controlled phase lag and hysteresis useful for temporal regime detection. Explicit noise can be injected to test whether it enhances switching near the predicted intermediate-frequency regime.
Useful7/10
Difficulty6/10
Novelty7/10
✓✓ Beats tuned baseline
2026
Replace dense pairwise interactions between all forecast horizons with nested time-shell summaries. For sorted horizons, the readout at shell j receives a cumulative embedding of all coefficients or queries assigned to later horizons, reproducing the paper's dependence on products such as \(\Pi_j=\prod_{l>j}e^{\alpha_l}=e^{\sum_{l>j}\alpha_l}\). This gives an \(O(Kd)\) multi-horizon interaction instead of an \(O(K^2d)\) temporal attention block and should work best for weak-memory…
Useful7/10
Difficulty5/10
Novelty8/10
✗ Failed on benchmark
2026
Replace quadratic self-attention over a sequence with a bank of K auxiliary exponentially decaying states whose rates are fitted directly from the empirical autocorrelation of the sequence features. Each mode captures a distinct time scale, so the module can represent short- and long-range dependencies with O(TK) computation and O(K) recurrent memory rather than storing all previous tokens. Constrain decay rates to be positive and use the paper's extended Markovian block structure to obtain a…
Useful7/10
Difficulty5/10
Novelty4/10
Unverified
2026
Replace unconstrained low-rank compression of a neural state with an augmented basis that always contains vectors representing known conserved quantities or diagnostically important linear statistics. After each learned transition, project the state back onto the affine constraint set with an exact minimum-norm correction, preventing rank truncation and model error from accumulating in those statistics.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace a single recurrent state with two coupled one-dimensional latent chains whose relative alignment is periodically shifted during inference. Ferromagnetic coupling preserves locally coherent patterns, while controlled sliding produces a nonequilibrium friction effect that can make global magnetization substantially longer-lived than in a static noisy chain. The shift velocity acts as a measurable memory-control parameter rather than an unconstrained architectural hyperparameter.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Split a recurrent or state-space model into a persistent slow state and a fast internal state. Every r recurrent steps, preserve the slow state but reset or contract the fast state toward a learned reference, reproducing selective restart rather than a destructive global reset. The expected benefit is suppression of long-range oscillatory and error correlations while retaining trajectory-level information.
Useful6/10
Difficulty4/10
Novelty7/10
Unverified
2026
Construct a reversible neural evolution from alternating learned drift and kick maps, then periodically apply the learned inverse sequence and penalize failure to reconstruct the original hidden state. The echo loss turns the paper's time-reversal protocol into a directly measurable stability certificate for long-depth neural dynamics and can identify whether errors are diffuse numerical noise or localized catastrophic faults.
Useful5/10
Difficulty5/10
Novelty3/10
Unverified
2026
Replace unconstrained recurrent-state decay with a one-dimensional latent defect field whose states evolve by local diffusion and pair reactions. Defects can move over long distances and persist, while creation and removal occur only in pairs, giving the memory a structured cancellation mechanism that is potentially better suited to delayed-event and parity-like sequence dependencies than a standard GRU or diagonal SSM.
Useful5/10
Difficulty5/10
Novelty8/10