Measuring Spatial Clustering via Metropolis-Hastings Diffusion Distance
arXiv:2607.14880
2026
Regularization
1 ideas extracted · analyzed Aug 30, 2026
What the math gives to ML
The paper introduces a graph-constrained notion of distributional discrepancy based on how rapidly a distribution f converges to a target distribution g under a Metropolis-Hastings chain. The transferable asset is the combination of a target-preserving Markov operator, multi-step convergence measurements, and spectral mixing behavior, which gives a tunable way to detect or penalize spatially concentrated probability mass. A practical neural-network adaptation is to regularize attention or routing distributions using multi-step MH diffusion distance rather than only one-hop smoothness or entropy. This can control locality and clustering while respecting arbitrary graph geometry and a nonuniform desired marginal.
Ideas from this paper
Unverified
2026
Regularize a neural attention or routing distribution according to how quickly it mixes toward a specified graph-dependent target, instead of penalizing only entropy or one-hop variation. The regularizer discourages pathological concentration on isolated graph regions while still allowing meaningful local structure, because concentration is judged after several graph-constrained Metropolis-Hastings steps.
Useful6/10
Difficulty4/10
Novelty6/10