Slow is fast: raising barriers to accelerate thermal relaxation
arXiv:2607.11877
2026
Dynamics
1 ideas extracted · analyzed Aug 30, 2026
What the math gives to ML
The paper identifies a finite-horizon relaxation mechanism that is invisible to instantaneous conductance and eigenvalue comparisons: switching between noncommuting reversible generators rotates relaxation eigenvectors and reprojects residual amplitude into rapidly decaying modes. The optimal control is bang-bang and can transiently raise barriers, so the best finite-time schedule need not use the fastest instantaneous generator. This transfers naturally to optimization by switching among multiple preconditioners, metrics, or optimizer update operators whose induced error dynamics do not commute. The key falsifiable prediction is that gains disappear when the update operators commute, while terminal-loss improvement grows with a measurable commutator and is often obtained by a small number of hard switches rather than smooth interpolation.
Ideas from this paper
△ Mechanism confirmed, baseline not beaten
2026
Replace a single preconditioner with a finite set of stable update operators and switch between them during training to rotate optimization error into directions that later operators remove quickly. The controller should choose a small number of hard switches, including occasional use of a seemingly slower or less aggressive preconditioner, rather than averaging all optimizers at every step.
Useful8/10
Difficulty6/10
Novelty7/10