A single loop method for quadratic minmax optimization
arXiv:2608.17830
2026
Optimization
1 ideas extracted · analyzed Sep 1, 2026
What the math gives to ML
The paper converts a coupled constrained convex-concave quadratic saddle problem into one primal-dual residual system and follows its perturbed KKT central path with a single infeasible interior-point loop. Its transferable asset is the simultaneous treatment of primal variables, equality multipliers, and inequality slacks, together with Newton attraction under a nonsingular Jacobian and locally Lipschitz derivatives. A practical neural-network adaptation is a primal-dual optimizer for constrained min-max training, such as robust training with a bounded adversary or resource-constrained mixture-of-experts routing. This is most plausible when the adversarial or routing variables are low-dimensional and projection or alternating gradient updates are unstable.
Ideas from this paper
Unverified
2026
Replace alternating descent/ascent with a single primal-dual Newton update for a constrained min-max neural-network objective. The optimizer maintains primal variables, equality multipliers, inequality slacks, and a barrier parameter, so the adversary remains feasible in the limit without hard projection and the coupled dependence of constraints on both players is represented in one linear system.
Useful6/10
Difficulty7/10
Novelty7/10