Memory ideas

External memories, state compression, retrieval-style read/write policies and calibrated stopping rules.

2 ideas found

Category: Memory ML: Ssm Math: Statistics Clear all

✗ Failed on benchmark 2026

Response-Sufficient Neural Memory

Replace correlation-based memory pruning in an RNN or state-space model by measuring how hidden-state history changes the response to individual past input events. Train a compressed memory coordinate only if it preserves the event-consequence kernel for the target observable, such as future loss, prediction, or control return. A memory representation is accepted when the conditional variance of this kernel within compressed-state groups is small, even if dwell-time or autocorrelation…

Useful8/10

Difficulty6/10

Novelty8/10

Memory Memory Accuracy Stability

Paper: The Memory Hidden in Response Fluctuations: Trajectory-Level Fluctuation-Response Theory and Inequalities for Non-Markovian Jump Dynamics arXiv:2608.20328

✗ Mechanism failed 2026

Regret-Balanced Adaptive Context

Choose the retained context length by balancing the statistical complexity of adding lag j against the squared prediction bias from discarding it. Unlike a fixed context window, the rule uses both the remaining-horizon spectrum and the estimated tail energy, allowing a model to expand or shrink its memory online.

Useful6/10

Difficulty5/10

Novelty7/10

Memory Memory Speedup Accuracy

Paper: Sharp Minimax Regret for Infinite-Memory Logistic Prediction arXiv:2608.26515