✗ Failed on benchmark 2026

Girsanov Drift-Energy Budget

Implementation & benchmark of arXiv:2607.13391 — The nonequilibrium statistical mechanics of Markov interacting particles

Usefulness7/10
Difficulty5/10
Novelty5/10

Source paper: The nonequilibrium statistical mechanics of Markov interacting particles arXiv:2607.13391 ⓘ · analyzed Aug 30, 2026

AI-generated research hypothesis, automatically tested. Not peer-reviewed.

Idea description

Regularize a neural continuous-time drift by the quadratic control energy required to move it away from a reference drift. Girsanov’s identity makes this an interpretable path-distribution constraint: expected normalized drift energy equals the relative entropy between controlled and reference trajectory laws.

Formulas

$$dZ_t=b_0(Z_t,t)\,dt+\sigma(Z_t,t)\,dW_t,\qquad dZ_t=b_\theta(Z_t,t)\,dt+\sigma(Z_t,t)\,dW_t$$
$$u_\theta(z,t)=\sigma(z,t)^{-1}\bigl(b_\theta(z,t)-b_0(z,t)\bigr)$$
$$\log\frac{dP_\theta}{dP_0}=\int_0^T u_\theta(Z_t,t)^\top dW_t-\frac{1}{2}\int_0^T\|u_\theta(Z_t,t)\|^2dt$$
$$D_{KL}(P_\theta\Vert P_0)=\frac{1}{2}\mathbb{E}_{P_\theta}\int_0^T\left\|\sigma(Z_t,t)^{-1}(b_\theta-b_0)(Z_t,t)\right\|^2dt$$

Mathematical statement

Consider a reference Ito process dZ_t = b_0(Z_t,t) dt + sigma(Z_t,t) dW_t and a neural controlled process dZ_t = b_theta(Z_t,t) dt + sigma(Z_t,t) dW_t, with an invertible diffusion matrix sigma. Define the normalized drift control u_theta(z,t) = sigma(z,t)^(-1)(b_theta(z,t) - b_0(z,t)). Under standard integrability conditions, Girsanov’s theorem gives a path log-density ratio containing a stochastic integral minus one half of the quadratic energy. Taking expectation removes the martingale and yields D_KL(P_theta || P_0) = one half times E under P_theta of the integral from 0 to T of ||u_theta(Z_t,t)||^2 dt. Therefore an energy budget E <= 2 epsilon predicts path KL no larger than epsilon, up to discretization and measure-change assumptions.

Implementation notes

Apply this to a neural ODE, neural SDE, continuous-depth residual network, or diffusion sampler. Choose b_0 as a pretrained stable drift, a low-capacity baseline, or the drift from the previous training checkpoint, while initially keeping sigma fixed. On each simulated trajectory and time-grid point t_k, evaluate delta = b_theta(z_k,t_k) - b_0(z_k,t_k), solve sigma(z_k,t_k) u_k = delta without explicitly forming an inverse, and accumulate energy = 0.5 times the sum over k of dt times squared norm of u_k. Optimize task_loss + lambda times energy. For a hard budget E_max, use a dual update: loss = task_loss + alpha times (mean_energy - E_max), followed by alpha = max(0, alpha + rho times (mean_energy - E_max)). The paper supplies the Girsanov likelihood ratio and KL-energy identity; trajectory averaging, likelihood-ratio estimation, and numerical integration are empirical. First test a two-dimensional neural SDE on a damped bistable system. Compare unconstrained drift learning, ordinary L2 drift regularization, and Girsanov-energy regularization while sweeping E_max. The predicted signature is estimated path KL approximately equal to estimated energy, with agreement within about 20 percent as the time step is refined. Increasing lambda should reduce both energy and path divergence monotonically. If b_0 is stable, long-horizon trajectory error should increase when the allowed energy budget becomes large enough for b_theta to leave the reference basin.

Verification

Failed on benchmark

Stage 1 · Toy mechanism gate: Passed ✓

Stage 2 · Mechanism transferred to benchmark: Not reproduced ✗

Stage 2 · Practical benchmark result: No measurable effect

Methodology: 8 paired seeds, permutation test (p<0.05) against a learning-rate-tuned baseline. How verification works

Stage 1 — Mechanism check agent confidence 8/10

Built and ran a reproducible Girsanov drift-energy MVP for a 1D Ornstein–Uhlenbeck reference SDE with constant controlled drift. Empirical Euler path KL matched the predicted half control energy within 1.01% across tested timesteps; energy divided by c² was constant, and increasing lambda monotonically reduced energy with the analytic optimizer matched to 6e-8. The mechanism is confirmed in this linear-Gaussian toy, but broad neural-SDE superiority was not established.

Agent confidence
8/10
Baseline
Task-only: c_hat=0.9661, task MSE=0.00115, energy=1.0937. Ordinary L2: c_hat=0.7729, task MSE=0.0516, energy=0.7000.
Idea
Girsanov energy: c_hat=0.7472, task MSE=0.0639, energy/path KL=0.6542. Empirical KL/energy ratios were 0.9931, 0.9926, 0.9900, and 1.0023; maximum relative error was 1.00%.

Limitations: Only a 1D constant-control OU process was tested; no neural drift, nonlinear bistable SDE, hard dual energy budget, multidimensional diffusion solve, long-horizon stability, GPU use, or wall-clock/FLOP comparison was evaluated.

How to run: python3 girsanov_experiment.py

Stage 2 — Benchmark vs. tuned baseline (arXiv:2607.13391)

No significant difference vs. the tuned baseline (−-0.0%, p=1, wins 0 / 8 paired seeds).

Benchmark
Dynamics forecasting
Model
rnn_small
Paired seeds
8
Baseline mean
0
Idea mean
0
Effect (Δ)
0 (−-0.0%; negative = idea better)
Wins
0 / 8 paired seeds
p-value
1 (permutation test, 20 000 shuffles)
Smallest detectable effect
±0.0%
Mechanism
Not confirmed ✗
Practical effect
No effect
Baseline tuning
swept over 9 configs
Limitations:

Only the registered actuated-pendulum dynamics track was tested. The benchmark is supervised next-state prediction rather than a true continuous-time SDE, so long-horizon rollout KL, exact path likelihood ratios, hard dual energy budgets, and multidimensional diffusion solves were not evaluated.

How to run: python3 bench_girsanov.py

Verdict computed by deterministic test code from paired-seed statistics — not by the language model.

Stage 2 — Benchmark latest Failed ✗

Agent confidence: 9/10

Implemented and ran the Girsanov drift-energy intervention on the registered dynamics track with the shared rnn_small architecture, equal budgets, a 9-point parity sweep, and 8 paired seeds. The tuned baseline and best idea both obtained mean test MSE 4.143828959968232e-05; paired delta was 0 and permutation p-value was 1.0. The mechanism signature was not confirmed because measured normalized drift energy was identical, so there is no observed benchmark win.

Baseline
best_cfg lr=0.006, lam=0.0; mean MSE=4.143828959968232e-05
Comparison
delta_mean=0.0, p_value=1.0, verdict=no measurable effect
Idea
best_cfg lr=0.006, lam=0.0; mean MSE=4.143828959968232e-05; mean normalized energy=0.0007432461061398499

Benchmark result

No significant difference vs. the tuned baseline (−-0.0%, p=1, wins 0 / 8 paired seeds).

Benchmark
Dynamics forecasting
Model
rnn_small
Paired seeds
8
Baseline mean
0
Idea mean
0
Effect (Δ)
0 (−-0.0%; negative = idea better)
Wins
0 / 8 paired seeds
p-value
1 (permutation test, 20 000 shuffles)
Smallest detectable effect
±0.0%
Mechanism
Not confirmed ✗
Practical effect
No effect
Baseline tuning
swept over 9 configs
Limitations:

Only the registered actuated-pendulum dynamics track was tested. The benchmark is supervised next-state prediction rather than a true continuous-time SDE, so long-horizon rollout KL, exact path likelihood ratios, hard dual energy budgets, and multidimensional diffusion solves were not evaluated.

How to run: python3 bench_girsanov.py

Artifacts

Implementation overview ⬇ Download all as ZIP 6 files · code, reports and structured results