A primal--dual interior-point method for nonsymmetric conic optimization with conjugate-free scaling
arXiv:2608.09206
2026
Optimization
1 ideas extracted · analyzed Sep 1, 2026
What the math gives to ML
The transferable asset is not the conic formulation itself, but the use of a single-secant BFGS metric as a conjugate-free substitute for an unavailable curvature object, together with safeguards that keep the approximate metric uniformly comparable to the true barrier Hessian. This suggests a neural optimizer that builds a cheap blockwise curvature preconditioner from one recent parameter-gradient secant, while clipping its spectrum relative to an RMS/diagonal baseline. The paper's predictor-corrector and homogeneous self-dual machinery is less directly applicable, but the metric-comparability principle provides a concrete stability criterion for adaptive second-order updates.
Ideas from this paper
Unverified
2026
Replace the purely diagonal preconditioner in AdamW or SGD with a blockwise, single-secant BFGS inverse-curvature metric. Use spectral damping and clipping relative to the diagonal RMS metric so the learned metric cannot become arbitrarily ill-conditioned, mirroring the paper's uniform comparison between its conjugate-free scaling and the primal barrier Hessian.
Useful6/10
Difficulty6/10
Novelty5/10