Closed-Loop Generative Selection: Convergence, Memory, and Noisy Oracles

arXiv:2607.22211 2026 Training 2 ideas extracted · analyzed Aug 30, 2026

What the math gives to ML

The paper provides an operational theory for iterative generator–oracle–retraining loops by augmenting the state with the recent training window, making memory-dependent escape probabilities explicit. The most transferable assets are the level-wise decomposition of expected oracle cost, the non-monotone effect of replay-memory depth, and robust repeated-evaluation rules for noisy or heavy-tailed fitness signals. In neural systems, these ideas suggest replacing fixed replay windows and fixed evaluation batches with level-aware memory control and confidence-based sequential evaluation. The resulting experiments can directly measure oracle calls, wall-clock time, convergence per expensive evaluation, and robustness under synthetic reward noise.

Ideas from this paper

Failed on benchmark 2026

Confidence-Sequential Noisy Selection

When candidate rewards are noisy, do not score every candidate once and immediately retrain on the apparent elites. Sequentially resample only candidates near the selection boundary and certify their ordering with a mean, median-of-means, trimmed mean, or sign test selected according to the observed tail behavior.

Useful8/10
Difficulty4/10
Novelty5/10
Paper: Closed-Loop Generative Selection: Convergence, Memory, and Noisy Oracles arXiv:2607.22211
Failed on benchmark 2026

Level-Adaptive Replay Memory

Use the recent history of generator outputs as a controllable training window instead of fixing the replay-memory depth globally. Estimate how quickly each fitness level improves as more same-level examples enter the window, and increase memory only when the measured escape probability improves enough to justify the extra stale data.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: Closed-Loop Generative Selection: Convergence, Memory, and Noisy Oracles arXiv:2607.22211