Nonlinear Noise-Tightening Drift
Implementation & benchmark of arXiv:2607.14291 — Wasserstein Stability of Contracting Flows: Effective Rates, Euler Self-Correction, and Noise Tightening
Source paper: Wasserstein Stability of Contracting Flows: Effective Rates, Euler Self-Correction, and Noise Tightening arXiv:2607.14291 ⓘ · analyzed Aug 30, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Replace a linear restoring drift in score-based sampling, latent dynamics, or stochastic regularization with a state-dependent nonlinear restoring term that is at least as contractive globally and more contractive away from the origin. This should reduce stationary variance without changing the worst-case local contraction certificate.
Formulas
Mathematical statement
For the stochastic system \(dX_t=v(X_t)dt+\sqrt{2D}\,dB_t\), let \(D\) be the noise intensity and \(B_t\) Brownian motion. A linear drift \(v(x)=-\lambda x\) has stationary variance \(D/\lambda\) in one dimension. The nonlinear drift \(v(x)=-\lambda x-\beta x^3\), with \(\beta>0\), has pairwise contraction rate \(r(x,y)=\lambda+\beta(x^2+xy+y^2)\geq\lambda\). Although both systems share the same worst-case contraction rate \(\lambda\), the nonlinear system has a stationary distribution proportional to \(\exp[-(\lambda x^2/2+\beta x^4/4)/D]\), whose variance is strictly below \(D/\lambda\) for \(\beta>0\). The transferable mechanism is extra state-dependent restoring force, not merely a larger global Lipschitz penalty.
Implementation notes
Use this as a drift parameterization for a stochastic latent model, diffusion sampler, or contractive recurrent state update. Let a neural field output \(u_\theta(x,t)\), then define the drift as \(v_\theta(x,t)=u_\theta(x,t)-\lambda x-\beta x\odot\|x\|^2\) for vector states, or use a bounded radial version \(-\beta x\|x\|^2/(1+\|x\|^2/R^2)\) if exploding forces are a concern. Keep \(\lambda\) fixed as the certified baseline rate and tune \(\beta\geq0\). During training, estimate pairwise rates on perturbed minibatch states and penalize violations of \(r_\theta(x,y)\geq\lambda\), while monitoring stationary covariance from long stochastic rollouts. Pseudocode: sample \(x,y\); evaluate \(v_\theta(x),v_\theta(y)\); compute \(r_\theta\); add \(c\max(0,\lambda-r_\theta)^2\) to the loss; sample Euler-Maruyama trajectories and estimate covariance after burn-in. The paper provides the exact scalar cubic mechanism and strict variance reduction under additive noise; the multidimensional neural extension requires empirical verification because the learned residual may destroy monotonicity. First experiment: compare linear and cubic-augmented drifts at matched \(\lambda\) and identical noise \(D\) on a 1D mixture-restoration task and a 2D latent diffusion. The quantitative prediction is stationary variance below \(D/\lambda\), with the gap increasing monotonically with \(\beta\) for small \(\beta\), while the measured pairwise contraction rate rises above \(\lambda\) for samples at large radius.
Verification
Stage 1 · Toy mechanism gate: Passed ✓
Stage 2 · Mechanism transferred to benchmark: Not reproduced ✗
Stage 2 · Practical benchmark result: Significantly worse ✗
Methodology: 8 paired seeds, permutation test (p<0.05) against a learning-rate-tuned baseline. How verification works
Stage 1 — Mechanism check agent confidence 9/10
Built a readable scalar cubic restoring-drift module and a reproducible verification experiment. All three mechanism predictions manifested: sampled pairwise rates stayed at or above lambda (minimum 1.000001 versus predicted 1), the small-beta relative variance slope was -1.471 versus predicted -1.5 (1.96% error), and exact stationary variance decreased strictly across beta=0 to 1. The matched Euler-Maruyama rollout also reduced variance from 0.5045 to 0.3465, a 31.3% reduction, consistent with the exact 30.97% gap at beta=0.5.
- Agent confidence
- 9/10
- Baseline
- Linear drift, lambda=1, D=0.5: exact stationary variance 0.5000; Euler-Maruyama variance 0.50453 +/- 0.00046.
- Idea
- Cubic drift with beta=0.5: exact stationary variance 0.34513; Euler-Maruyama variance 0.34651 +/- 0.00025; pairwise rate >=1 with rate 2.5 at x=y=1.
Limitations: Only the one-dimensional analytic mechanism was tested; no learned neural residual, multidimensional latent diffusion, bounded radial variant, training task, FLOP/speed comparison, or generalization measurement was evaluated. The simulation uses Euler-Maruyama and finite burn-in, while exact variances come from stationary-density quadrature.
How to run: python3 run_experiment.py
Stage 2 — Benchmark vs. tuned baseline (arXiv:2607.14291)
Significantly WORSE than the tuned baseline (n/a, p=0.0081, wins 0 / 8 paired seeds).
- Benchmark
- Dynamics forecasting
- Model
- rnn_small
- Paired seeds
- 8
- Baseline mean
- 0
- Idea mean
- 0
- Effect (Δ)
- 0 (n/a; negative = idea better)
- Wins
- 0 / 8 paired seeds
- p-value
- 0.0081 (permutation test, 20 000 shuffles)
- Smallest detectable effect
- n/a
- Mechanism
- Not confirmed ✗
- Practical effect
- Hurts
- Baseline tuning
- swept over 3 configs
Used 1200 training examples, 400 test examples, and 12 epochs for runtime. Only the built-in controlled-pendulum dynamics track was tested; no multidimensional stochastic stationary-covariance benchmark was run.
How to run: python3 stage2_bench.py
Verdict computed by deterministic test code from paired-seed statistics — not by the language model.
Stage 2 — Benchmark latest Failed ✗
Agent confidence: 10/10
The cubic restoring drift was implemented end-to-end in a GRU predictor on the structurally matched controlled-pendulum dynamics track. The best idea was significantly worse than the swept baseline, and its trained-model contraction signature did not confirm the predicted lower bound.
- Baseline
- lr=0.003; mean test MSE 7.923793088338016e-08 over 8 seeds.
- Idea
- beta=0.05, lr=0.01; mean test MSE 1.2224308409969353e-07 over 8 seeds; paired delta +4.3005153216313374e-08; p=0.0081; 0/8 wins.
- Mechanism signature
- Predicted lower bound 0.981; observed mean effective restoring rate 0.03263185149990022; fraction above bound 0.0; confirmed=false.
Benchmark result
Significantly WORSE than the tuned baseline (n/a, p=0.0081, wins 0 / 8 paired seeds).
- Benchmark
- Dynamics forecasting
- Model
- rnn_small
- Paired seeds
- 8
- Baseline mean
- 0
- Idea mean
- 0
- Effect (Δ)
- 0 (n/a; negative = idea better)
- Wins
- 0 / 8 paired seeds
- p-value
- 0.0081 (permutation test, 20 000 shuffles)
- Smallest detectable effect
- n/a
- Mechanism
- Not confirmed ✗
- Practical effect
- Hurts
- Baseline tuning
- swept over 3 configs
Used 1200 training examples, 400 test examples, and 12 epochs for runtime. Only the built-in controlled-pendulum dynamics track was tested; no multidimensional stochastic stationary-covariance benchmark was run.
How to run: python3 stage2_bench.py
Artifacts
- bench_report.json 6.0 KB View Raw
- nonlinear_drift.py 0.8 KB View Raw
- report.md 1.5 KB View
- report_bench_2026-08-31T095529.md 2.4 KB View
- results.json 1.6 KB View Raw
- run_experiment.py 3.3 KB View Raw
- stage2_bench.py 3.9 KB View Raw