Unverified 2026

Fisher-Zero Monitor for Stochastic Training

Implementation & benchmark of arXiv:2609.01197 — Dynamical phase transitions for single particles in the semiclassical and weak noise limits

Usefulness6/10
Difficulty6/10
Novelty8/10

Source paper: Dynamical phase transitions for single particles in the semiclassical and weak noise limits arXiv:2609.01197 · analyzed Sep 2, 2026

AI-generated research hypothesis, automatically tested. Not peer-reviewed.

Idea description

Run an ensemble of noisy optimization trajectories and regard trajectories that return to the same loss basin as competing dynamical phases. Estimate a complex return generating function from their path costs; a near-zero of this function signals cancellation between trajectory families and predicts an abrupt change in basin occupancy. Use the signal to reduce learning rate or optimizer noise near a transition, or increase noise when one phase dominates too early.

Formulas

$$Z_q(t)=\langle\psi_0|e^{-iHt/\hbar}|\psi_0\rangle.$$
$$Z_c(T;s)=\int_{x(0),x(T)\in B_0}\mathcal{D}x\;\exp\left[-\frac{\mathcal{A}[x]}{D}-s\mathcal{R}[x]\right].$$
$$Z_c(T;s)\approx C_1(s)e^{-\Phi_1(s)/D}+C_2(s)e^{-\Phi_2(s)/D},\qquad \operatorname{Re}\Phi_1(s)=\operatorname{Re}\Phi_2(s),\qquad Z_c(T;s)=0.$$
$$\widehat Z_c(T;s)=\frac{1}{K}\sum_{r=1}^{K}\exp\left[-\frac{\mathcal{A}_r}{D}-s\mathcal{R}_r\right],\qquad g(T;s)=-\frac{1}{K}\log|\widehat Z_c(T;s)|^2.$$

Mathematical statement

The quantum generating function is the return amplitude $Z_q(t)=\langle\psi_0|e^{-iHt/\hbar}|\psi_0\rangle$, where $H$ is the Hamiltonian, $t$ is time, and $\psi_0$ is the initial state. Its classical weak-noise analogue is a path integral $Z_c(T;s)=\int\mathcal{D}x\exp[-\mathcal{A}[x]/D-s\mathcal{R}[x]]$, where $T$ is the horizon, $D$ is noise strength, $\mathcal{A}[x]$ is the stochastic action, $s$ is a real or complex probe parameter, and $\mathcal{R}[x]$ is a return observable. In the weak-noise limit, competing trajectory families give $Z_c\approx C_1(s)e^{-\Phi_1(s)/D}+C_2(s)e^{-\Phi_2(s)/D}$, with transition boundary $\operatorname{Re}\Phi_1=\operatorname{Re}\Phi_2$ and Fisher zeros satisfying $Z_c=0$. For Langevin-like training, $\theta_{k+1}=\theta_k-\eta\nabla L(\theta_k)+\sqrt{2D\eta}\,\xi_k$, with learning rate $\eta$, loss $L$, and Gaussian noise $\xi_k$. A discrete action estimator is $\mathcal{A}_r=\sum_k\|\theta_{k+1}^{(r)}-\theta_k^{(r)}+\eta\nabla L(\theta_k^{(r)})\|^2/(4D\eta)$.

Implementation notes

Integrate this as a diagnostic wrapper around SGD, Adam, or Langevin training, not initially as a replacement optimizer. At a checkpoint, clone the current parameters into $K=32$ to $128$ replicas. Evolve each replica for $M$ additional steps with independent minibatch ordering and optional Gaussian perturbations, using $\theta_{k+1}=\theta_k-\eta g_k+\sqrt{2D\eta}\xi_k$. Define the initial basin $B_0$ by a parameter-distance threshold and a loss window. For replicas returning to $B_0$, record the trajectory action $\mathcal A_r$ and return observable $\mathcal R_r$, such as final squared distance from the basin center or final loss increase. Evaluate $\widehat Z_c(T;s)$ on a grid of complex probes $s=u+iv$ using log-sum-exp scaling and complex arithmetic. Estimate the smallest $|v|$, denoted $v_*$, at which the complex sum approaches zero, and monitor the return rate $g(T;u)$. The paper supplies the path-competition mechanism; noise scale, basin definition, action approximation, and saddle costs are estimated empirically. First test a two-dimensional double-well loss, then a small MNIST MLP, against unmodified SGD with equal compute. The prediction is that near a basin transition, $g(T;u)$ develops a sharp peak or kink, $v_*$ decreases as $D$ decreases, and two trajectory clusters have approximately equal action at the transition: $|\mathcal A_1-\mathcal A_2|/\max(\mathcal A_1,\mathcal A_2)<0.2$. Trigger a learning-rate reduction when $v_*<0.1$ or when the return-rate slope exceeds a baseline threshold. If no cluster exchange, kink, or predictive relation between $v_*$ and basin occupancy occurs, reject the mechanism.

Verification

This idea has not been verified yet.

Verification happens in two stages: Stage 1 — a mechanism check on a toy system confirms the claimed mathematical phenomenon reproduces; Stage 2 — a benchmark implements the idea on a real (small) neural network task and compares it against a tuned baseline over 8 paired seeds with a permutation test.

Artifacts

Artifacts unavailable.