Rational Jacobi Rotations and the Complexity of Approximating Mixed Integer Quadratic Programming

arXiv:2607.29386 2026 Optimization 1 ideas extracted · analyzed Aug 31, 2026

What the math gives to ML

The paper develops rational Jacobi rotations that approximately eliminate off-diagonal entries of a symmetric matrix while preserving exact orthogonality and the matrix inertia, avoiding the irrational coefficients produced by classical eigendecomposition. This suggests a quantization-friendly, Hessian-aware optimizer or preconditioner whose coordinate transforms can be represented exactly with rational numbers and applied as norm-preserving rotations. The most promising transfer is blockwise curvature diagonalization: use a few rational rotations to decouple strongly coupled parameter directions, then apply separate signed diagonal steps. A falsifiable benefit is improved optimization under low precision or restricted arithmetic, especially when curvature is highly anisotropic or indefinite.

Ideas from this paper

Unverified 2026

Rational Jacobi Curvature Preconditioner

Replace an ordinary dense or floating-point eigendecomposition of small Hessian or Fisher blocks with a sequence of rational Jacobi rotations. The rotations preserve Euclidean norms and can be stored using fixed-point coefficients, while approximately diagonalizing curvature so the optimizer can use separate coordinate-wise step sizes. This is especially relevant to low-precision training and blocks with mixed-sign curvature.

Useful6/10
Difficulty6/10
Novelty6/10
Paper: Rational Jacobi Rotations and the Complexity of Approximating Mixed Integer Quadratic Programming arXiv:2607.29386