Optimal near-optimality bounds for the Lanczos method for matrix functions

arXiv:2608.07160 2026 Architecture 1 ideas extracted · analyzed Aug 31, 2026

What the math gives to ML

The paper proves a sharp near-optimality guarantee for Lanczos approximations of matrix functions applied to vectors, measured in a matrix-power norm. The transferable asset is an explicit comparison between a short Krylov computation and the best possible approximation in the same Krylov subspace, with degradation controlled by the condition number of the positive-definite operator. This can replace expensive eigendecompositions or repeated matrix-function operations inside graph neural networks, whitening layers, implicit solvers, and diffusion modules. The most practical targets are inverse and inverse-square-root functions, where matrix-free sparse matrix-vector products make the method substantially cheaper than dense spectral computation.

Ideas from this paper

Unverified 2026

Near-Optimal Lanczos Spectral Layer

Implement f(A)b inside a neural network with a short Lanczos recurrence instead of an eigendecomposition or dense matrix-function operation. Use an SPD operator A such as a regularized graph Laplacian or feature covariance matrix, and choose the number of iterations by monitoring successive approximations. For Stieltjes functions, Lanczos is guaranteed to be close to the best vector in the same Krylov subspace.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Optimal near-optimality bounds for the Lanczos method for matrix functions arXiv:2608.07160