Pego theorem for Hilbert space-valued functions on compact groups
arXiv:2608.13142
2026
Regularization
1 ideas extracted · analyzed Sep 1, 2026
What the math gives to ML
The paper supplies a compactness template for families of Hilbert-valued functions on a compact group: control small translations, suppress high Fourier modes, and, in infinite-dimensional feature spaces, enforce uniform tightness in the value-space. This is transferable to group-structured neural features, where spectral smoothness alone can still allow energy to escape into new feature directions as width, tasks, or training time increase. The practical adaptation is a three-part representation regularizer evaluated over a finite transformation group, with a low-rank feature-space projection enforcing the missing tightness condition.
Ideas from this paper
Unverified
2026
Regularize neural features indexed by a compact transformation group using the three conditions from the vector-valued Pego theorem: nearby group transformations should produce nearby features, high group-Fourier coefficients should have small energy, and feature energy should remain concentrated in a fixed low-dimensional value-space subspace. The third term is important for large or effectively infinite-dimensional feature spaces, because translation and Fourier smoothness alone do not…
Useful6/10
Difficulty5/10
Novelty6/10