Flow-Efficiency Drift Scheduler
Implementation & benchmark of arXiv:2609.03193 — Generative Nested Sampling of Atomistic Thermodynamic Landscapes
Source paper: Generative Nested Sampling of Atomistic Thermodynamic Landscapes arXiv:2609.03193 ⓘ · analyzed Sep 4, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Turn constrained-flow generation efficiency into an online diagnostic and controller for neural sampling. When the target ensemble changes faster than the flow can track or becomes internally complex, automatically shorten the training window, increase flow updates, or fall back to local MCMC instead of silently accepting biased or highly correlated samples.
Formulas
Mathematical statement
Let $q_i(x)=q_\theta(x\mid\lambda_i)$ be the current proposal and $\pi_i$ the constrained target. The normalized importance-weight effective sample size is $\eta_i=\mathrm{ESS}_i/M$, where $M$ is the number of proposals. A target-drift proxy is the symmetric KL divergence between consecutive flow distributions, estimated from samples as $D_i^{\mathrm{sym}}=[D_{\mathrm{KL}}(q_i\|q_{i-1})+D_{\mathrm{KL}}(q_{i-1}\|q_i)]/2$. Low $\eta_i$ with low drift indicates poor internal mode coverage, while high drift indicates stale training data. The controller adapts FIFO window length $K_i$, gradient-update count $R_i$, and optional local-MCMC correction using thresholds $\eta_{\min}$ and $D_{\max}$.
Implementation notes
1. Integration point: place this controller around the conditional-flow sampler used for diffusion sampling, neural energy models, Bayesian neural networks, or world-model trajectory distributions. Store each proposal's flow log density, prior log density, constraint result, and score. 2. Pseudocode: after every nested level, compute normalized ESS from importance weights; evaluate both $q_i(x)$ and $q_{i-1}(x)$ on a small proposal buffer to estimate symmetric KL drift; if $D_i^{\mathrm{sym}}>D_{\max}$, discard old examples, halve the FIFO window $K$, and perform additional flow updates; if $\eta_i<\eta_{\min}$ while drift is small, increase $R_i$ and apply 5 to 20 local HMC or Langevin correction steps; if efficiency remains high for several levels, enlarge $K$ and reduce updates. Flag a level when ESS is below 1% of proposals. 3. The paper supplies the mechanism that efficiency varies non-monotonically along annealing and becomes poor in internally complex liquid-like ensembles. Thresholds, window limits, and fallback lengths must be estimated in a pilot run. 4. First experiment: use a 16-dimensional mixture of eight Gaussians with controllable separation and threshold drift. Compare fixed-window flow sampling with the adaptive controller. Prediction: under rapidly changing targets, adaptation keeps $\eta_i\ge0.1$ by shortening $K$, whereas fixed-window training falls below $0.02$. In a dense multimodal interval, efficiency should show a reproducible local minimum; the controller should increase compute there while preserving evidence accuracy. Verify that log-evidence error remains stable when the fixed-window baseline suffers ESS collapse.
Verification
This idea has not been verified yet.
Verification happens in two stages: Stage 1 — a mechanism check on a toy system confirms the claimed mathematical phenomenon reproduces; Stage 2 — a benchmark implements the idea on a real (small) neural network task and compares it against a tuned baseline over 8 paired seeds with a permutation test.
Artifacts
Artifacts unavailable.