Residual-aware adaptive training step
Implementation & benchmark of arXiv:2607.12759 — A Structure-Preserving Method of Fundamental Solutions for the Multi-Phase Mullins-Sekerka Flow
Source paper: A Structure-Preserving Method of Fundamental Solutions for the Multi-Phase Mullins-Sekerka Flow arXiv:2607.12759 ⓘ · analyzed Aug 30, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Use a CFL-like step-size controller for neural simulators or neural ODE rollouts, shrinking the integration step when the predicted state changes rapidly and relaxing it when dynamics are smooth. The controller uses the smallest spatial resolution and maximum predicted velocity, rather than a fixed global step chosen for the worst case.
Formulas
Mathematical statement
The paper uses the adaptive rule $$\Delta t=\min\left\{c_{\mathrm{CFL}}\frac{\min_{i,j}\ell_{i,j}}{\max_{\Gamma}|V|},\ \Delta t_{\max}\right\},$$ where $\ell_{i,j}$ is the smallest polygonal edge length, $V$ is the discrete interface normal speed, $c_{\mathrm{CFL}}>0$ is a safety constant, and $\Delta t_{\max}$ is an upper cap. The principle is a local stability restriction: the largest displacement during one step is bounded by a fixed fraction of the smallest resolved length. For a neural simulator with state velocity $f_ heta(x,t)$, replace $\max_\Gamma|V|$ by $s=\max_j\|f_ heta(x_j,t)\|_2$ and replace the minimum edge length by the grid or latent feature scale $h_{\min}$. The adapted controller is $$\Delta t_{\mathrm{NN}}=\operatorname{clip}\left(c_{\mathrm{CFL}}\frac{h_{\min}}{s+\delta},\Delta t_{\min},\Delta t_{\max}\right),$$ where $\delta>0$ prevents division by zero.
Implementation notes
(1) Integration point: apply during inference and training rollouts of a neural ODE, learned PDE solver, world model, or latent state-space model, immediately before each Euler or Runge-Kutta step. Evaluate the velocity tensor $v=f_\theta(x,t)$ and select the next step from its maximum norm. (2) Pseudocode: input state $x$, grid spacing $h_{\min}$, network $f_\theta$; evaluate $v=f_\theta(x,t)$; calculate $s=\max_j\|v_j\|_2$; set $dt=\min(dt_{\max},c_{CFL}h_{\min}/(s+\delta))$; clamp to $dt_{\min}$; advance with Euler, $x\leftarrow x+dt\,v$, or use the same $dt$ in all stages of an RK step; repeat until the target time. Initially detach $s$ and $dt$ from autograd to avoid unstable gradients through the controller. (3) The CFL form and safety factor come from the paper; $h_{\min}$, $dt_{\min}$, $dt_{\max}$, and $\delta$ are engineering choices. Log accepted step sizes and the nondimensional displacement ratio $r=dt\,s/h_{\min}$, which should remain below approximately $c_{CFL}$. (4) First experiment: compare fixed-step Euler and adaptive-step Euler on a small learned 2-D advection or reaction-diffusion model, using identical networks and target rollout time. Evaluate steps per rollout, wall-clock inference, trajectory error against a high-resolution reference, and instability frequency. A useful success criterion is at least 2x fewer steps on smooth trajectories at comparable error, with no additional blow-ups on high-velocity cases.
Verification
This idea has not been verified yet.
Verification happens in two stages: Stage 1 — a mechanism check on a toy system confirms the claimed mathematical phenomenon reproduces; Stage 2 — a benchmark implements the idea on a real (small) neural network task and compares it against a tuned baseline over 8 paired seeds with a permutation test.
Artifacts
Artifacts unavailable.