Closed-Loop Generative Selection: Convergence, Memory, and Noisy Oracles
arXiv:2607.22211
2026
Training
2 ideas extracted · analyzed Aug 30, 2026
What the math gives to ML
The paper provides an operational theory for iterative generator–oracle–retraining loops by augmenting the state with the recent training window, making memory-dependent escape probabilities explicit. The most transferable assets are the level-wise decomposition of expected oracle cost, the non-monotone effect of replay-memory depth, and robust repeated-evaluation rules for noisy or heavy-tailed fitness signals. In neural systems, these ideas suggest replacing fixed replay windows and fixed evaluation batches with level-aware memory control and confidence-based sequential evaluation. The resulting experiments can directly measure oracle calls, wall-clock time, convergence per expensive evaluation, and robustness under synthetic reward noise.
Ideas from this paper
✗ Failed on benchmark
2026
When candidate rewards are noisy, do not score every candidate once and immediately retrain on the apparent elites. Sequentially resample only candidates near the selection boundary and certify their ordering with a mean, median-of-means, trimmed mean, or sign test selected according to the observed tail behavior.
Useful8/10
Difficulty4/10
Novelty5/10
✗ Failed on benchmark
2026
Use the recent history of generator outputs as a controllable training window instead of fixing the replay-memory depth globally. Estimate how quickly each fitness level improves as more same-level examples enter the window, and increase memory only when the measured escape probability improves enough to justify the extra stale data.
Useful7/10
Difficulty5/10
Novelty6/10