Rational Jacobi Rotations and the Complexity of Approximating Mixed Integer Quadratic Programming
arXiv:2607.29386
2026
Optimization
1 ideas extracted · analyzed Aug 31, 2026
What the math gives to ML
The paper develops rational Jacobi rotations that approximately eliminate off-diagonal entries of a symmetric matrix while preserving exact orthogonality and the matrix inertia, avoiding the irrational coefficients produced by classical eigendecomposition. This suggests a quantization-friendly, Hessian-aware optimizer or preconditioner whose coordinate transforms can be represented exactly with rational numbers and applied as norm-preserving rotations. The most promising transfer is blockwise curvature diagonalization: use a few rational rotations to decouple strongly coupled parameter directions, then apply separate signed diagonal steps. A falsifiable benefit is improved optimization under low precision or restricted arithmetic, especially when curvature is highly anisotropic or indefinite.
Ideas from this paper
Unverified
2026
Replace an ordinary dense or floating-point eigendecomposition of small Hessian or Fisher blocks with a sequence of rational Jacobi rotations. The rotations preserve Euclidean norms and can be stored using fixed-point coefficients, while approximately diagonalizing curvature so the optimizer can use separate coordinate-wise step sizes. This is especially relevant to low-precision training and blocks with mixed-sign curvature.
Useful6/10
Difficulty6/10
Novelty6/10