Optimal near-optimality bounds for the Lanczos method for matrix functions
arXiv:2608.07160
2026
Architecture
1 ideas extracted · analyzed Aug 31, 2026
What the math gives to ML
The paper proves a sharp near-optimality guarantee for Lanczos approximations of matrix functions applied to vectors, measured in a matrix-power norm. The transferable asset is an explicit comparison between a short Krylov computation and the best possible approximation in the same Krylov subspace, with degradation controlled by the condition number of the positive-definite operator. This can replace expensive eigendecompositions or repeated matrix-function operations inside graph neural networks, whitening layers, implicit solvers, and diffusion modules. The most practical targets are inverse and inverse-square-root functions, where matrix-free sparse matrix-vector products make the method substantially cheaper than dense spectral computation.
Ideas from this paper
Unverified
2026
Implement f(A)b inside a neural network with a short Lanczos recurrence instead of an eigendecomposition or dense matrix-function operation. Use an SPD operator A such as a regularized graph Laplacian or feature covariance matrix, and choose the number of iterations by monitoring successive approximations. For Stieltjes functions, Lanczos is guaranteed to be close to the best vector in the same Krylov subspace.
Useful6/10
Difficulty5/10
Novelty6/10