Overlap-Field Coverage Regularizer
Implementation & benchmark of arXiv:2609.02156 — The higher-dimensional Shepp problem: an exact criterion for random ball coverings of tori
Source paper: The higher-dimensional Shepp problem: an exact criterion for random ball coverings of tori arXiv:2609.02156 ⓘ · analyzed Sep 3, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Represent augmentation centers or training examples in a low-dimensional torus and accumulate the geometric overlap of their augmentation neighborhoods. Add a finite-horizon penalty that detects latent locations with insufficient accumulated coverage, while constraining center uniformity so that coverage optimization does not collapse all samples to one location.
Formulas
Mathematical statement
The paper uses normalized Haar measure m on the d-dimensional torus T^d, independent random centers X_n, and decreasing radii r_n. For z in T^d, its overlap kernel is u_n(z)=m(B(0,r_n) intersection B(z,r_n)), where B(x,r) is a radius-r Euclidean ball under torus distance. The accumulated overlap field is H(z)=sum_{n>=1}u_n(z), and E_r=limsup_n B(X_n,r_n) is the set covered infinitely often. Its main theorem states P(E_r=T^d)=1 if and only if the integral over T^d of exp(H(z)) dm(z) diverges. For a finite neural run with centers c_i, radii rho_i, and N augmentations, use H_N(z)=sum_{i=1}^N u_{rho_i}(z-c_i), estimate the integral with uniform probe points, and penalize low coverage using exp(-H_N(z)). The theorem's independence and infinite-horizon assumptions are not inherited by learned centers; they motivate the statistic, not a formal training guarantee. A uniformity penalty is required because maximizing overlap alone could collapse all centers.
Implementation notes
Integrate this at the data-loader or augmentation layer, rather than inside the backbone. Choose d=2 or d=4 and map each training example or augmentation center c_i into [0,1)^d using a fixed random projection followed by a sigmoid, or use a learned projection with a modulo operation. Associate each augmentation with radius rho_i, using a decreasing schedule such as rho_i=rho_max(1-i/N)^q. At each training step, draw M uniform probe points z_j on the torus and compute H_N(z_j)=sum_i u_{rho_i}(z_j-c_i). For d=2, calculate u_r exactly from the disk-intersection formula. If s is the wrapped torus distance between centers, then u_r(s)=0 for s>=2r and u_r(s)=[2r^2 arccos(s/(2r))-(s/2)sqrt(4r^2-s^2)] divided by the torus volume otherwise. For d>2, tabulate the ball-intersection volume as a function of s and r using numerical integration, then interpolate during training. Use L_cov=(1/M)sum_j exp(-H_N(z_j)) to penalize uncovered probes. Estimate center uniformity with random Fourier-feature MMD against uniform torus samples, or use a repulsive periodic kernel. The paper supplies the overlap field and exponential-integral structure; finite-N truncation, differentiable embeddings, and MMD are adaptations. First test on CIFAR-10 with a small ResNet and compare ordinary random augmentation against the regularizer at equal augmentation count and FLOPs. Log mean and worst-decile H_N, validation accuracy, calibration, and rare-class accuracy. Success means higher worst-decile coverage and improved validation accuracy or accuracy at reduced labeled-data fraction without center collapse.
Verification
This idea has not been verified yet.
Verification happens in two stages: Stage 1 — a mechanism check on a toy system confirms the claimed mathematical phenomenon reproduces; Stage 2 — a benchmark implements the idea on a real (small) neural network task and compares it against a tuned baseline over 8 paired seeds with a permutation test.
Artifacts
Artifacts unavailable.