△ Mechanism confirmed, baseline not beaten 2026

Zero-Crossing Reset Integral Optimizer

Implementation & benchmark of arXiv:2607.15572 — A PI+R Control Scheme Based on Multi-agent Systems for Economic Dispatch in Isolated BESSs

Usefulness7/10
Difficulty5/10
Novelty7/10

Source paper: A PI+R Control Scheme Based on Multi-agent Systems for Economic Dispatch in Isolated BESSs arXiv:2607.15572 ⓘ · analyzed Aug 30, 2026

AI-generated research hypothesis, automatically tested. Not peer-reviewed.

Idea description

Replace ordinary momentum-like accumulation with a PI controller whose integral state is reset when the proportional error changes sign, indicating that the trajectory has crossed its local target. Apply the mechanism to each parameter block or to a scalar block residual, and impose a dwell time so that minibatch noise cannot trigger arbitrarily frequent resets.

Formulas

$$u(t)=-k_P e(t)-k_I z(t),\qquad \dot z(t)=e(t),\qquad z^+=0\ \text{when }e(t)\ \text{crosses zero},\qquad t_{j+1}-t_j\geq\tau_d.$$
$$\ddot\theta+k_P\lambda\dot\theta+k_I\lambda\theta=0,\qquad s^2+k_P\lambda s+k_I\lambda=0,\quad \lambda\in\operatorname{eig}(H).$$
$$z_{k+1}=z_k+g_k,\qquad \theta_{k+1}=\theta_k-\eta\left(k_Pg_k+k_Iz_{k+1}\right),\qquad z_{k+1}\leftarrow0\ \text{if }g_{k-1}g_k\leq0\ \text{and }k-k_{\rm reset}\geq d.$$
$$k_P^2\lambda=4k_I\quad \text{is the critical-damping boundary for the linearized mode.}$$

Mathematical statement

For a scalar tracking error e(t), the continuous-flow controller uses proportional action u_P(t) = -k_P e(t), integral state derivative dz(t)/dt = e(t), and total action u(t) = u_P(t) - k_I z(t), where k_P and k_I are positive gains and z(t) is accumulated mismatch. At a jump, z is set to zero when e(t) crosses zero, while parameters remain continuous. A dwell-time condition requires consecutive reset times to differ by at least tau_d. For a local quadratic neural-network objective f(theta) = one-half theta-transpose H theta, with Hessian eigenvalue lambda, the no-reset linearized mode obeys theta-double-dot + k_P lambda theta-dot + k_I lambda theta = 0. Its characteristic roots are s = (-k_P lambda plus or minus square-root(k_P-squared lambda-squared minus 4 k_I lambda)) divided by 2. The reset removes accumulated integral memory after a sign crossing and should reduce post-crossing overshoot. In discrete training, z_(k+1) = z_k + g_k and theta_(k+1) = theta_k - eta times (k_P g_k + k_I z_(k+1)), followed by z_(k+1) = 0 when g_(k-1) and g_k have opposite signs and the dwell counter is satisfied.

Implementation notes

1. Integration point: add one integral buffer per parameter tensor or, for a cheaper first test, one scalar buffer per layer. Let G_k be the minibatch gradient. The simplest version uses g_k = G_k directly and stores a tensor z_k with the same shape. To make the zero-crossing rule less sensitive to individual coordinates, use a block residual g_k = inner_product(G_k, U_(k-1)) divided by the norm of U_(k-1) plus epsilon, where U_(k-1) is the previous update direction. 2. Pseudocode: compute G; form the residual g; update z = z + g; if the elementwise or blockwise product g times g_old is nonpositive and the reset counter is at least d, set z = 0 and record the reset; form U = k_P times g plus k_I times z; update theta = theta - eta times U; store g_old = g and increment the dwell counter. Clip the integral buffer only as a secondary safety measure, not in the first ablation. 3. Taken from the paper: PI accumulation, reset at a proportional-error zero crossing, and a minimum dwell time. Estimated empirically: Hessian eigenvalue ranges, minibatch sign-flip probability, eta, k_P, k_I, and d. 4. First cheap experiment: train a two-layer MLP on MNIST and a small quadratic objective with known Hessian, comparing SGD, momentum, Adam, non-reset PI, and reset PI at equal update counts. Sweep the ratio k_P squared times lambda divided by 4 k_I. The predicted signature is a transition near ratio one: below the critical-damping boundary, the quadratic error should oscillate and generate repeated zero crossings; above it, the dominant mode should become non-oscillatory. Reset PI should reduce the post-crossing error peak and settling steps, whereas too-small d should create reset chatter and degrade convergence. On the known quadratic, the measured dominant decay rate should match the real part of the predicted characteristic root within about 20 percent before stochastic-gradient noise dominates.

Verification

Mechanism confirmed, baseline not beaten

Stage 1 · Toy mechanism gate: Passed ✓

Stage 2 · Mechanism transferred to benchmark: Confirmed ✓

Stage 2 · Practical benchmark result: Significantly worse ✗

Methodology: 8 paired seeds, permutation test (p<0.05) against a learning-rate-tuned baseline. How verification works

Stage 1 — Mechanism check agent confidence 8/10

Built a deterministic quadratic PI/reset-PI prototype with continuous-flow and discrete-time simulations. The critical-damping boundary R=kP²λ/(4kI)=1 was confirmed at every sweep point: R<1 produced complex roots and R≥1 real roots. Resetting the integral state reduced the post-crossing peak from 0.2984 to 3.0e-5, while increasing dwell from 0 to 500 steps reduced resets from 100 to 5; the mechanism manifested clearly, although this is not evidence of a general neural-network win.

Agent confidence
8/10
Baseline
On the scalar quadratic, SGD reached loss <1e-6 in 652 steps and final loss 7.50e-23; continuous PI without reset had final loss 8.78e-9.
Idea
Reset PI reached loss <1e-6 in 47 steps and final loss 9.35e-314; continuous post-crossing peak was 3.0e-5 versus 0.2984 without reset. Dwell sweep reset counts were 100, 100, 34, 20, 12, and 5 for dwell 0, 20, 50, 100, 200, and 500.

Limitations: Only deterministic scalar quadratic dynamics were tested; no MNIST/MLP, minibatch noise, tensor-wise block residuals, Adam or momentum comparisons, wall-clock/FLOP measurements, or GPU execution. The decay-rate fit was only numerically usable for the lowest underdamped sweep point because non-oscillatory trajectories do not provide local peaks.

How to run: python3 experiment.py

Stage 2 — Benchmark vs. tuned baseline (arXiv:2607.15572)

Significantly WORSE than the tuned baseline (+5421.5%, p=0.0081, wins 0 / 8 paired seeds).

Benchmark
Dynamics forecasting
Model
rnn_small
Paired seeds
8
Baseline mean
0.0007
Idea mean
0.0365
Effect (Δ)
0.0359 (+5421.5%; negative = idea better)
Wins
0 / 8 paired seeds
p-value
0.0081 (permutation test, 20 000 shuffles)
Smallest detectable effect
±2167.5%
Mechanism
Confirmed ✓
Practical effect
Hurts
Baseline tuning
swept over 3 configs
Limitations:

Only the registered built-in dynamics track was tested; no tabular, vision, or sequence tracks, no alternative kP/kI/dwell sweep beyond the fixed idea configuration, and no wall-clock or memory comparison were performed.

How to run: python3 bench_stage2.py

Verdict computed by deterministic test code from paired-seed statistics — not by the language model.

Stage 2 — Benchmark latest Failed ✗

Agent confidence: 10/10

Reset-PI was implemented as a tensor-wise optimizer intervention with sign-change resets and an 8-step dwell time, evaluated on the registered built-in dynamics track with the shared rnn_small architecture. Across 8 paired seeds, tuned Adam reached mean test MSE 0.0006619469895667862 while reset-PI reached 0.036549699725583196; delta_mean was +0.03588775273601641 with permutation p=0.0081, yielding verdict "idea worse (significant)". The trained-model mechanism signature was confirmed, but confirmation did not produce a benchmark win.

Baseline
Adam lr=0.006; full 8-seed mean MSE 0.0006619469895667862, std 0.00021167023064506447.
Delta mean
0.03588775273601641
Idea
Reset-PI kp=1.0, ki=0.15, dwell=8, lr=0.006; full 8-seed mean MSE 0.036549699725583196, std 0.01617539040826831.
Idea wins
0
Mechanism confirmed
true
P value
0.0081

Benchmark result

Significantly WORSE than the tuned baseline (+5421.5%, p=0.0081, wins 0 / 8 paired seeds).

Benchmark
Dynamics forecasting
Model
rnn_small
Paired seeds
8
Baseline mean
0.0007
Idea mean
0.0365
Effect (Δ)
0.0359 (+5421.5%; negative = idea better)
Wins
0 / 8 paired seeds
p-value
0.0081 (permutation test, 20 000 shuffles)
Smallest detectable effect
±2167.5%
Mechanism
Confirmed ✓
Practical effect
Hurts
Baseline tuning
swept over 3 configs
Limitations:

Only the registered built-in dynamics track was tested; no tabular, vision, or sequence tracks, no alternative kP/kI/dwell sweep beyond the fixed idea configuration, and no wall-clock or memory comparison were performed.

How to run: python3 bench_stage2.py

Artifacts

Implementation overview ⬇ Download all as ZIP 6 files · code, reports and structured results