✗ Failed on benchmark 2026

Nonlinear Noise-Tightening Drift

Implementation & benchmark of arXiv:2607.14291 — Wasserstein Stability of Contracting Flows: Effective Rates, Euler Self-Correction, and Noise Tightening

Usefulness7/10
Difficulty5/10
Novelty7/10

Source paper: Wasserstein Stability of Contracting Flows: Effective Rates, Euler Self-Correction, and Noise Tightening arXiv:2607.14291 ⓘ · analyzed Aug 30, 2026

AI-generated research hypothesis, automatically tested. Not peer-reviewed.

Idea description

Replace a linear restoring drift in score-based sampling, latent dynamics, or stochastic regularization with a state-dependent nonlinear restoring term that is at least as contractive globally and more contractive away from the origin. This should reduce stationary variance without changing the worst-case local contraction certificate.

Formulas

$$dX_t=v(X_t)\,dt+\sqrt{2D}\,dB_t,$$
$$v_{\mathrm{lin}}(x)=-\lambda x\ \Longrightarrow\ \operatorname{Var}_{\mathrm{stat}}(X)=\frac{D}{\lambda},$$
$$v_{\mathrm{nl}}(x)=-\lambda x-\beta x^3\ \Longrightarrow\ r(x,y)=\lambda+\beta(x^2+xy+y^2)\geq\lambda,$$
$$p_{\mathrm{stat}}(x)=Z^{-1}\exp\left[-\frac{\lambda x^2/2+\beta x^4/4}{D}\right],\qquad \operatorname{Var}_{\mathrm{stat}}(X)<\frac{D}{\lambda}\quad(\beta>0).$$

Mathematical statement

For the stochastic system \(dX_t=v(X_t)dt+\sqrt{2D}\,dB_t\), let \(D\) be the noise intensity and \(B_t\) Brownian motion. A linear drift \(v(x)=-\lambda x\) has stationary variance \(D/\lambda\) in one dimension. The nonlinear drift \(v(x)=-\lambda x-\beta x^3\), with \(\beta>0\), has pairwise contraction rate \(r(x,y)=\lambda+\beta(x^2+xy+y^2)\geq\lambda\). Although both systems share the same worst-case contraction rate \(\lambda\), the nonlinear system has a stationary distribution proportional to \(\exp[-(\lambda x^2/2+\beta x^4/4)/D]\), whose variance is strictly below \(D/\lambda\) for \(\beta>0\). The transferable mechanism is extra state-dependent restoring force, not merely a larger global Lipschitz penalty.

Implementation notes

Use this as a drift parameterization for a stochastic latent model, diffusion sampler, or contractive recurrent state update. Let a neural field output \(u_\theta(x,t)\), then define the drift as \(v_\theta(x,t)=u_\theta(x,t)-\lambda x-\beta x\odot\|x\|^2\) for vector states, or use a bounded radial version \(-\beta x\|x\|^2/(1+\|x\|^2/R^2)\) if exploding forces are a concern. Keep \(\lambda\) fixed as the certified baseline rate and tune \(\beta\geq0\). During training, estimate pairwise rates on perturbed minibatch states and penalize violations of \(r_\theta(x,y)\geq\lambda\), while monitoring stationary covariance from long stochastic rollouts. Pseudocode: sample \(x,y\); evaluate \(v_\theta(x),v_\theta(y)\); compute \(r_\theta\); add \(c\max(0,\lambda-r_\theta)^2\) to the loss; sample Euler-Maruyama trajectories and estimate covariance after burn-in. The paper provides the exact scalar cubic mechanism and strict variance reduction under additive noise; the multidimensional neural extension requires empirical verification because the learned residual may destroy monotonicity. First experiment: compare linear and cubic-augmented drifts at matched \(\lambda\) and identical noise \(D\) on a 1D mixture-restoration task and a 2D latent diffusion. The quantitative prediction is stationary variance below \(D/\lambda\), with the gap increasing monotonically with \(\beta\) for small \(\beta\), while the measured pairwise contraction rate rises above \(\lambda\) for samples at large radius.

Verification

Failed on benchmark

Stage 1 · Toy mechanism gate: Passed ✓

Stage 2 · Mechanism transferred to benchmark: Not reproduced ✗

Stage 2 · Practical benchmark result: Significantly worse ✗

Methodology: 8 paired seeds, permutation test (p<0.05) against a learning-rate-tuned baseline. How verification works

Stage 1 — Mechanism check agent confidence 9/10

Built a readable scalar cubic restoring-drift module and a reproducible verification experiment. All three mechanism predictions manifested: sampled pairwise rates stayed at or above lambda (minimum 1.000001 versus predicted 1), the small-beta relative variance slope was -1.471 versus predicted -1.5 (1.96% error), and exact stationary variance decreased strictly across beta=0 to 1. The matched Euler-Maruyama rollout also reduced variance from 0.5045 to 0.3465, a 31.3% reduction, consistent with the exact 30.97% gap at beta=0.5.

Agent confidence
9/10
Baseline
Linear drift, lambda=1, D=0.5: exact stationary variance 0.5000; Euler-Maruyama variance 0.50453 +/- 0.00046.
Idea
Cubic drift with beta=0.5: exact stationary variance 0.34513; Euler-Maruyama variance 0.34651 +/- 0.00025; pairwise rate >=1 with rate 2.5 at x=y=1.

Limitations: Only the one-dimensional analytic mechanism was tested; no learned neural residual, multidimensional latent diffusion, bounded radial variant, training task, FLOP/speed comparison, or generalization measurement was evaluated. The simulation uses Euler-Maruyama and finite burn-in, while exact variances come from stationary-density quadrature.

How to run: python3 run_experiment.py

Stage 2 — Benchmark vs. tuned baseline (arXiv:2607.14291)

Significantly WORSE than the tuned baseline (n/a, p=0.0081, wins 0 / 8 paired seeds).

Benchmark
Dynamics forecasting
Model
rnn_small
Paired seeds
8
Baseline mean
0
Idea mean
0
Effect (Δ)
0 (n/a; negative = idea better)
Wins
0 / 8 paired seeds
p-value
0.0081 (permutation test, 20 000 shuffles)
Smallest detectable effect
n/a
Mechanism
Not confirmed ✗
Practical effect
Hurts
Baseline tuning
swept over 3 configs
Limitations:

Used 1200 training examples, 400 test examples, and 12 epochs for runtime. Only the built-in controlled-pendulum dynamics track was tested; no multidimensional stochastic stationary-covariance benchmark was run.

How to run: python3 stage2_bench.py

Verdict computed by deterministic test code from paired-seed statistics — not by the language model.

Stage 2 — Benchmark latest Failed ✗

Agent confidence: 10/10

The cubic restoring drift was implemented end-to-end in a GRU predictor on the structurally matched controlled-pendulum dynamics track. The best idea was significantly worse than the swept baseline, and its trained-model contraction signature did not confirm the predicted lower bound.

Baseline
lr=0.003; mean test MSE 7.923793088338016e-08 over 8 seeds.
Idea
beta=0.05, lr=0.01; mean test MSE 1.2224308409969353e-07 over 8 seeds; paired delta +4.3005153216313374e-08; p=0.0081; 0/8 wins.
Mechanism signature
Predicted lower bound 0.981; observed mean effective restoring rate 0.03263185149990022; fraction above bound 0.0; confirmed=false.

Benchmark result

Significantly WORSE than the tuned baseline (n/a, p=0.0081, wins 0 / 8 paired seeds).

Benchmark
Dynamics forecasting
Model
rnn_small
Paired seeds
8
Baseline mean
0
Idea mean
0
Effect (Δ)
0 (n/a; negative = idea better)
Wins
0 / 8 paired seeds
p-value
0.0081 (permutation test, 20 000 shuffles)
Smallest detectable effect
n/a
Mechanism
Not confirmed ✗
Practical effect
Hurts
Baseline tuning
swept over 3 configs
Limitations:

Used 1200 training examples, 400 test examples, and 12 epochs for runtime. Only the built-in controlled-pendulum dynamics track was tested; no multidimensional stochastic stationary-covariance benchmark was run.

How to run: python3 stage2_bench.py

Artifacts

Implementation overview ⬇ Download all as ZIP 7 files · code, reports and structured results