{
 "artifacts": null,
 "category": "optimization",
 "description": "Replace the usual momentum state in an optimizer with a persistent Ornstein-Uhlenbeck-driven velocity subject to a dry-friction threshold. Correlated forcing can help traverse shallow noisy regions, while the friction term suppresses parameter motion when the effective force is small, potentially reducing update noise and improving late-stage stability.",
 "formulas_latex": [
  "$$\\lambda\\dddot{\\mathbf r}=\\mathbf F(\\mathbf r,\\dot{\\mathbf r},\\ddot{\\mathbf r}),\\qquad v(t)\\sim t^2,\\qquad \\delta r(t)\\sim t^3.$$",
  "$$\\dot{\\mathbf n}(t)=-\\frac{\\mathbf n(t)}{\\tau}+\\sqrt{\\frac{2}{\\tau}}\\,\\boldsymbol\\eta(t).$$",
  "$$m\\dot{\\mathbf v}(t)=-\\Delta_F\\hat{\\mathbf v}+f_A\\mathbf n(t)+\\sqrt{2K}\\,\\boldsymbol\\xi(t),\\qquad \\hat{\\mathbf v}=\\frac{\\mathbf v}{\\|\\mathbf v\\|}.$$",
  "$$n_{k+1}=\\left(1-\\frac{h}{\\tau}\\right)n_k+\\sqrt{\\frac{2h}{\\tau}}\\,\\zeta_k,\\quad v_{k+1}=v_k+\\frac{h}{m}\\left[-g_k-\\Delta_F\\frac{v_k}{\\|v_k\\|+\\epsilon}+f_A n_{k+1}\\right],\\quad \\theta_{k+1}=\\theta_k+h v_{k+1}.$$"
 ],
 "id": 2725,
 "implementation": "(1) Integrate this into the optimizer update after each minibatch gradient is computed and before parameters are changed. Maintain one velocity tensor \\(v\\) and one Ornstein-Uhlenbeck tensor \\(n\\) for every trainable parameter tensor \\(\\theta\\). Use a global or per-layer mass \\(m\\), persistence time \\(\\tau\\), active amplitude \\(f_A\\), friction threshold \\(\\Delta_F\\), and integration step \\(h\\). Initially omit the paper's optional white-noise term because minibatch sampling already supplies noise. (2) Pseudocode: `g = grad(loss, theta)`; `n = (1-h/tau)*n + sqrt(2*h/tau)*NormalLike(n)`; `direction = v/(sqrt(sum(v*v))+eps)`; `v = v + h/m*(-g - DeltaF*direction + fA*n)`; `theta = theta + h*v`. For a scalar-per-coordinate dead-zone variant, replace the friction term with the proximal rule `v = sign(v)*max(abs(v)-h*DeltaF/m, 0)`. Apply weight decay separately and decoupled, so friction is tested independently. (3) The OU recursion and friction update come directly from the paper; \\(m,\\tau,f_A,\\Delta_F\\) are tuned hyperparameters, while gradients and minibatch noise are measured empirically. Log gradient norm, velocity norm, update variance, and the fraction of coordinates whose velocity is effectively zero. (4) First run a 2D quadratic sanity test with known optimum, then train a 2-layer MLP on MNIST or CIFAR-10 against tuned SGD with momentum and AdamW at equal optimizer steps and matched learning-rate search budgets. Sweep \\(\\Delta_F\\) over \\(10^{-4},10^{-3},10^{-2}\\) times the median gradient norm and \\(\\tau\\) over 1, 10, and 100 steps. Success means lower validation loss or higher accuracy at equal steps, at least 10% lower late-stage update variance, fewer unnecessary parameter updates, and no increase in gradient-norm spikes.",
 "math_summary": "The paper's jerk equation is \\(\\lambda\\dddot{\\mathbf r}=\\mathbf F(\\mathbf r,\\dot{\\mathbf r},\\ddot{\\mathbf r})\\), where \\(\\mathbf r\\) is position, \\(\\lambda\\) is the jerk coefficient, and \\(\\mathbf F\\) is a generalized force; under constant force and rest initial conditions it gives \\(v(t)\\sim t^2\\) and displacement \\(\\delta r(t)\\sim t^3\\). Its implementable stochastic model uses an active Ornstein-Uhlenbeck process \\(\\dot{\\mathbf n}(t)=-\\mathbf n(t)/\\tau+\\sqrt{2/\\tau}\\,\\boldsymbol\\eta(t)\\), where \\(\\mathbf n\\) is a dimensionless correlated forcing state, \\(\\tau\u003e0\\) is its persistence time, and \\(\\boldsymbol\\eta\\) is delta-correlated Gaussian white noise. The velocity dynamics are \\(m\\dot{\\mathbf v}=-\\Delta_F\\hat{\\mathbf v}+\\mathbf f_A+\\sqrt{2K}\\boldsymbol\\xi\\), where \\(m\\) is inertial mass, \\(\\Delta_F\\ge0\\) is the dry-friction threshold, \\(\\hat{\\mathbf v}=\\mathbf v/\\|\\mathbf v\\|\\), \\(\\mathbf f_A=f_A\\mathbf n\\) is the active force with amplitude \\(f_A\\), and \\(K\\) controls additional white noise. For optimization, set position \\(\\mathbf r=\\theta\\), force \\(\\mathbf F=-g\\) with gradient \\(g=\\nabla_\\theta L\\), and use the smooth zero-safe friction direction \\(\\mathbf v/(\\|\\mathbf v\\|+\\epsilon)\\). The friction threshold creates a dead-zone in which small effective forces do not produce large parameter motion.",
 "math_tags": [
  "dynamical-systems",
  "stochastic-processes",
  "optimization"
 ],
 "ml_areas": [
  "optimizer",
  "training-dynamics",
  "regularization"
 ],
 "paper": {
  "arxiv_id": "2608.24689",
  "arxiv_url": "https://arxiv.org/abs/2608.24689",
  "summary_what_math_gives_to_ml": "The paper identifies a concrete dynamical mechanism for higher-order motion: a persistent Ornstein-Uhlenbeck active force combined with thresholded dry friction produces non-smooth, jerk-dominated transients rather than ordinary inertial acceleration. This structure can be transferred to optimization by giving parameters an inertial state, driving them with a correlated auxiliary force, and applying a friction threshold that suppresses small updates while allowing motion once the effective force exceeds a threshold. The most practical first test is an optimizer module, not a new network architecture: compare correlated active forcing and dry friction against SGD, AdamW, and momentum on small vision tasks, measuring loss descent, update sparsity, and stability.",
  "title": "Jerky Motion of Active Granular Particles",
  "year": "2026"
 },
 "ratings": {
  "difficulty": 4,
  "novelty": 6,
  "usefulness": 6
 },
 "solves": [
  "stability",
  "generalization",
  "speedup"
 ],
 "title": "Dry-Friction Active Optimizer",
 "url": "https://synthcore.org/idea/2725/dry-friction-active-optimizer",
 "verification": {
  "peer_reviewed": false,
  "status": "unverified",
  "status_label": "Unverified",
  "verdict_source": "deterministic test code (paired-seed permutation statistics)"
 }
}