Restricted Dynamic Geometric Complexity: Path-Space Reduction and Möbius--Jacobi Response

arXiv:2607.07204 2026 Optimization 1 ideas extracted · analyzed Aug 30, 2026

What the math gives to ML

The paper turns preconditioning from a static endpoint-selection problem into a minimum-motion path problem on the manifold of positive-definite metrics. Its transferable asset is affine-invariant geometry: a metric schedule can be penalized by intrinsic path length or, at fixed horizon, by an equivalent kinetic action, while the endpoint is judged by the generalized Hessian condition ratio. This suggests a dynamic optimizer whose preconditioner changes only as much as necessary to reach a prescribed local curvature target, rather than abruptly switching between poorly conditioned metrics. The most practical first version uses diagonal or block-diagonal metrics, inexpensive curvature estimates, and a receding-horizon controller.

Ideas from this paper

Unverified 2026

Minimum-motion curvature-targeted preconditioner

Replace abrupt optimizer preconditioner changes with a metric trajectory that moves the smallest affine-invariant distance needed to reach a target generalized Hessian condition number. During training, optimize a short horizon of log-diagonal or block-SPD metrics using a terminal curvature penalty and an intrinsic kinetic regularizer, then execute only the first metric in a receding-horizon controller. The method should reduce oscillations caused by rapidly changing second-moment estimates…

Useful6/10
Difficulty6/10
Novelty6/10
Paper: Restricted Dynamic Geometric Complexity: Path-Space Reduction and Möbius--Jacobi Response arXiv:2607.07204