Multi-kernel spectral clustering: Entrywise eigenvector perturbation bounds and exact recovery
arXiv:2608.08704
2026
Regularization
1 ideas extracted · analyzed Sep 1, 2026
What the math gives to ML
The paper offers a transferable multi-scale similarity construction: instead of choosing one kernel bandwidth, it selects several bandwidths from empirical quantiles of pairwise squared distances. This is useful for neural representation learning because a single contrastive temperature or RBF scale can miss clusters with heterogeneous density and variance. Its row-wise spectral perturbation perspective also motivates preserving individual embedding locations, not merely the global span of a representation. The most practical adaptation is a quantile-calibrated multi-scale spectral regularizer for minibatch embeddings.
Ideas from this paper
Unverified
2026
Build several Gaussian similarity matrices on minibatch embeddings, using empirical distance quantiles as their bandwidths, then combine them before degree normalization and spectral embedding. Add a regularizer that encourages the resulting row-normalized spectral coordinates to form compact pseudo-clusters, making the representation robust to multiple geometric scales rather than one manually tuned temperature.
Useful6/10
Difficulty5/10
Novelty5/10