Hardy-type norms of matrices

arXiv:2607.17373 2026 Regularization 1 ideas extracted · analyzed Aug 30, 2026

What the math gives to ML

The paper establishes that the spherical geometric mean of the stretch induced by a matrix is itself a genuine norm, despite geometric means normally failing to preserve convexity. This provides a principled alternative to spectral-norm or Frobenius penalties: it measures typical multiplicative amplification while retaining norm-like scaling and subadditivity. A direct neural-network use is to regularize linear layers with a Monte Carlo estimate of this norm, potentially controlling average signal amplification without forcing every singular direction to be small.

Ideas from this paper

Unverified 2026

Spherical Geometric-Gain Regularization

Replace or supplement spectral-norm and Frobenius penalties on neural-network weight matrices with the Hardy-type norm given by the geometric mean of their gains over uniformly sampled unit directions. This penalizes typical multiplicative amplification through a logarithmic average, while the paper's theorem guarantees that the resulting quantity is a true norm rather than an ad hoc nonconvex statistic.

Useful5/10
Difficulty3/10
Novelty6/10
Paper: Hardy-type norms of matrices arXiv:2607.17373