Hardy-type norms of matrices
arXiv:2607.17373
2026
Regularization
1 ideas extracted · analyzed Aug 30, 2026
What the math gives to ML
The paper establishes that the spherical geometric mean of the stretch induced by a matrix is itself a genuine norm, despite geometric means normally failing to preserve convexity. This provides a principled alternative to spectral-norm or Frobenius penalties: it measures typical multiplicative amplification while retaining norm-like scaling and subadditivity. A direct neural-network use is to regularize linear layers with a Monte Carlo estimate of this norm, potentially controlling average signal amplification without forcing every singular direction to be small.
Ideas from this paper
Unverified
2026
Replace or supplement spectral-norm and Frobenius penalties on neural-network weight matrices with the Hardy-type norm given by the geometric mean of their gains over uniformly sampled unit directions. This penalizes typical multiplicative amplification through a logarithmic average, while the paper's theorem guarantees that the resulting quantity is a true norm rather than an ad hoc nonconvex statistic.
Useful5/10
Difficulty3/10
Novelty6/10