Slow is fast: raising barriers to accelerate thermal relaxation

arXiv:2607.11877 2026 Dynamics 1 ideas extracted · analyzed Aug 30, 2026

What the math gives to ML

The paper identifies a finite-horizon relaxation mechanism that is invisible to instantaneous conductance and eigenvalue comparisons: switching between noncommuting reversible generators rotates relaxation eigenvectors and reprojects residual amplitude into rapidly decaying modes. The optimal control is bang-bang and can transiently raise barriers, so the best finite-time schedule need not use the fastest instantaneous generator. This transfers naturally to optimization by switching among multiple preconditioners, metrics, or optimizer update operators whose induced error dynamics do not commute. The key falsifiable prediction is that gains disappear when the update operators commute, while terminal-loss improvement grows with a measurable commutator and is often obtained by a small number of hard switches rather than smooth interpolation.

Ideas from this paper

Mechanism confirmed, baseline not beaten 2026

Noncommuting Bang-Bang Optimizer

Replace a single preconditioner with a finite set of stable update operators and switch between them during training to rotate optimization error into directions that later operators remove quickly. The controller should choose a small number of hard switches, including occasional use of a seemingly slower or less aggressive preconditioner, rather than averaging all optimizers at every step.

Useful8/10
Difficulty6/10
Novelty7/10
Paper: Slow is fast: raising barriers to accelerate thermal relaxation arXiv:2607.11877