Dry-Friction Inertial Dynamics with Implicit Hessian-Driven Damping: Finite-Time Stabilization, Shadowing, and Proximal Discretization
arXiv:2608.22612
2026
Optimization
1 ideas extracted · analyzed Aug 29, 2026
What the math gives to ML
The paper combines viscous damping, nonsmooth dry friction, and a look-ahead gradient in an inertial optimization inclusion. Its most transferable construction is an optimizer whose velocity is updated through an exact proximal operator for a dry-friction penalty, while the gradient is evaluated at a shifted parameter point that approximates Hessian damping without explicitly forming a Hessian. For Euclidean friction, the proximal step is vector soft-thresholding and can set velocity exactly to zero when the force is sufficiently small, potentially reducing late-training oscillations. The implementation should be tested as a momentum optimizer against SGD with momentum, Nesterov momentum, and AdamW, measuring both convergence and the frequency of exactly stationary updates.
Ideas from this paper
✗ Mechanism failed
2026
Replace ordinary momentum with a semi-implicit velocity update containing viscous damping and a proximal dry-friction step, while evaluating the gradient at a look-ahead parameter point. The dry-friction proximal operator exactly zeros sufficiently small velocities, which may suppress late-training oscillations and create finite-time stationarity instead of merely asymptotic velocity decay.
Useful7/10
Difficulty4/10
Novelty7/10