Provable Non-Acceleration of Standard Strang Splittings of Kinetic Langevin Dynamics
arXiv:2608.25279
2026
Optimization
1 ideas extracted · analyzed Aug 29, 2026
What the math gives to ML
The paper reduces several kinetic Langevin Strang splittings to an exact noisy heavy-ball position recursion and proves a sharp obstruction: fixed step size and friction cannot uniformly obtain accelerated square-root-condition-number mixing over smooth strongly convex potentials. The transferable asset is not the MCMC sampler itself, but the explicit connection between momentum recursions, slow linear modes, and attracting periodic orbits caused by fixed hyperparameter choices. This suggests an optimizer safeguard that monitors local two-step dynamics for oscillatory or periodic behavior and changes momentum or step size before the optimizer enters a long-lived cycle. The proposed intervention is falsifiable on ill-conditioned quadratic losses and smooth nonquadratic objectives, where it should reduce stagnation without sacrificing the fast regime.
Ideas from this paper
Unverified
2026
Use the paper's heavy-ball recursion as a runtime diagnostic for momentum optimizers. Detect when recent parameter differences form an approximately periodic orbit or when the estimated local two-step transition matrix has spectral radius near or above one, then reduce the learning rate and momentum temporarily. This targets the failure mode proved in the paper: fixed momentum parameters can produce attracting cycles even on smooth potentials with bounded curvature.
Useful6/10
Difficulty5/10
Novelty6/10