Signed random Fourier features for fast density estimation with indefinite kernels
arXiv:2608.29265
2026
Architecture
1 ideas extracted · analyzed Sep 1, 2026
What the math gives to ML
The paper provides a constructive Monte Carlo factorization for translation-invariant kernels whose Fourier transform is signed rather than nonnegative. This is useful beyond KDE because many neural architectures implicitly require positive-definite random-feature kernels, excluding compact-support similarities and other indefinite interactions. The transferable asset is the signed spectral measure: sample frequencies from the absolute spectral density and carry a separate sign into the feature contraction, yielding linear-time approximations to indefinite pairwise aggregation. A promising neural use is replacing quadratic attention or graph message passing with a compact radial signed-kernel interaction, while explicitly testing whether signed cancellation improves locality or expressivity without destabilizing normalization.
Ideas from this paper
△ Mechanism confirmed, baseline not beaten
2026
Replace a quadratic pairwise attention or graph aggregation kernel with a compact, translation-invariant indefinite kernel approximated by signed random Fourier features. The feature map preserves the kernel's negative spectral mass through a diagonal sign matrix, so the resulting linear-time aggregation can represent similarities that ordinary positive-definite random features cannot.
Useful7/10
Difficulty5/10
Novelty7/10