Reduced-Green discrepancy regularizer
Implementation & benchmark of arXiv:2607.25211 — An indefinite Coulomb interaction from the Steklov spectrum of perforated manifolds
Source paper: An indefinite Coulomb interaction from the Steklov spectrum of perforated manifolds arXiv:2607.25211 ⓘ · analyzed Aug 31, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Regularize a set of learned neural representations by the Green-kernel energy of their signed discrepancy from a target background distribution. Unlike a standard pairwise repulsion term, the regularizer penalizes both over-concentration and under-coverage relative to the prescribed density, and an indefinite kernel can encode attractive as well as repulsive interactions.
Formulas
Mathematical statement
The paper interprets the spectral error through a Coulomb-type energy of a discrepancy measure. Let $X$ be the representation space, let $\mu_{\theta}=\sum_{i=1}^{n}a_i\,\delta_{z_i(\theta)}$ be the empirical measure of learned points $z_i(\theta)\in X$ with nonnegative weights $a_i$, let $\nu$ be a target background probability measure, and define the signed discrepancy $\sigma_{\theta}=\mu_{\theta}-\nu$. Let $L$ be the limiting weighted Laplace--Beltrami operator and let $G_L(x,y)$ be its reduced Green function, meaning the inverse kernel on the subspace orthogonal to the nullspace of $L$; for a connected compact manifold the constant zero mode is removed. The transferred energy is $\mathcal E(\theta)=\frac12\iint_{X\times X}G_L(x,y)\,d\sigma_{\theta}(x)d\sigma_{\theta}(y)$. In finite form, with target samples $y_j$ and weights $b_j$, use $\sigma=\sum_i a_i\delta_{z_i}-\sum_j b_j\delta_{y_j}$ and $\mathcal E=\frac12\sum_{r,s}c_rc_sG_L(q_r,q_s)$, where $(q_r,c_r)$ concatenates $(z_i,a_i)$ and $(y_j,-b_j)$. The zero-mode condition is $\sum_r c_r=0$. A truncated spectral construction is $G_L(x,y)\approx\sum_{k=1}^{K}\phi_k(x)\phi_k(y)/(\lambda_k+\tau)$, where $(\lambda_k,\phi_k)$ are nonconstant eigenpairs of $L$ and $\tau>0$ is a numerical damping parameter. Because the reduced Green kernel need not be positive everywhere, the resulting quadratic form is not necessarily a conventional positive-definite MMD loss.
Implementation notes
Integrate the regularizer after the representation layer whose distribution should be controlled: for a prototype model use the class prototypes $z_i$; for MoE use per-expert router centroids; for a transformer use a small set of pooled token embeddings. First choose a compact latent domain, preferably a 2-D torus or sphere, and map each representation through a learned projection followed by normalization. Precompute or numerically approximate $K$ nonconstant eigenfunctions $\phi_k$ and eigenvalues $\lambda_k$ of the Laplacian on that domain; for a torus, use Fourier modes, which avoids solving an eigenproblem. In each minibatch, form representation points $z_i$ with weights $a_i=1/n$. Draw target points $y_j$ from the desired background density with weights $b_j=1/m$. Concatenate points $q=(z_1,\ldots,z_n,y_1,\ldots,y_m)$ and signed coefficients $c=(a_1,\ldots,a_n,-b_1,\ldots,-b_m)$, ensuring $\sum_r c_r=0$. Compute the feature matrix $\Phi_{rk}=\phi_k(q_r)$ and evaluate $G_K(q_r,q_s)=\sum_k\Phi_{rk}\Phi_{sk}/(\lambda_k+\tau)$; compute the quadratic energy $\frac12 c^T G_K c$ and add it to the task loss. Backpropagate through the projected coordinates and eigenfunctions. Estimate no paper-specific constants: choose $K$, $\tau$, and $\lambda_{\mathrm{disc}}$ by a small validation sweep, and monitor energy, nearest-neighbor distance, occupancy entropy, and task loss. Start with CIFAR-10 and a 2-layer MLP with a 2-D bottleneck, comparing cross-entropy alone, ordinary RBF-MMD, pairwise repulsion, and this signed Green loss. Success is lower validation loss or improved class separation at equal parameter count without collapse; for MoE, measure expert-load coefficient of variation and routing quality at equal compute.
Verification
This idea has not been verified yet.
Verification happens in two stages: Stage 1 — a mechanism check on a toy system confirms the claimed mathematical phenomenon reproduces; Stage 2 — a benchmark implements the idea on a real (small) neural network task and compares it against a tuned baseline over 8 paired seeds with a permutation test.
Artifacts
Artifacts unavailable.