Multi-kernel spectral clustering: Entrywise eigenvector perturbation bounds and exact recovery

arXiv:2608.08704 2026 Regularization 1 ideas extracted · analyzed Sep 1, 2026

What the math gives to ML

The paper offers a transferable multi-scale similarity construction: instead of choosing one kernel bandwidth, it selects several bandwidths from empirical quantiles of pairwise squared distances. This is useful for neural representation learning because a single contrastive temperature or RBF scale can miss clusters with heterogeneous density and variance. Its row-wise spectral perturbation perspective also motivates preserving individual embedding locations, not merely the global span of a representation. The most practical adaptation is a quantile-calibrated multi-scale spectral regularizer for minibatch embeddings.

Ideas from this paper

Unverified 2026

Quantile-Calibrated Multi-Scale Spectral Regularizer

Build several Gaussian similarity matrices on minibatch embeddings, using empirical distance quantiles as their bandwidths, then combine them before degree normalization and spectral embedding. Add a regularizer that encourages the resulting row-normalized spectral coordinates to form compact pseudo-clusters, making the representation robust to multiple geometric scales rather than one manually tuned temperature.

Useful6/10
Difficulty5/10
Novelty5/10
Paper: Multi-kernel spectral clustering: Entrywise eigenvector perturbation bounds and exact recovery arXiv:2608.08704