Dry-Friction Inertial Dynamics with Implicit Hessian-Driven Damping: Finite-Time Stabilization, Shadowing, and Proximal Discretization

arXiv:2608.22612 2026 Optimization 1 ideas extracted · analyzed Aug 29, 2026

What the math gives to ML

The paper combines viscous damping, nonsmooth dry friction, and a look-ahead gradient in an inertial optimization inclusion. Its most transferable construction is an optimizer whose velocity is updated through an exact proximal operator for a dry-friction penalty, while the gradient is evaluated at a shifted parameter point that approximates Hessian damping without explicitly forming a Hessian. For Euclidean friction, the proximal step is vector soft-thresholding and can set velocity exactly to zero when the force is sufficiently small, potentially reducing late-training oscillations. The implementation should be tested as a momentum optimizer against SGD with momentum, Nesterov momentum, and AdamW, measuring both convergence and the frequency of exactly stationary updates.

Ideas from this paper

Mechanism failed 2026

Proximal Dry-Friction Lookahead Momentum

Replace ordinary momentum with a semi-implicit velocity update containing viscous damping and a proximal dry-friction step, while evaluating the gradient at a look-ahead parameter point. The dry-friction proximal operator exactly zeros sufficiently small velocities, which may suppress late-training oscillations and create finite-time stationarity instead of merely asymptotic velocity decay.

Useful7/10
Difficulty4/10
Novelty7/10
Paper: Dry-Friction Inertial Dynamics with Implicit Hessian-Driven Damping: Finite-Time Stabilization, Shadowing, and Proximal Discretization arXiv:2608.22612