# Coulomb transport loss for anti-collapse generation

- ID: 816
- Canonical URL: https://synthcore.org/idea/816/coulomb-transport-loss-for-anti-collapse-generation
- API JSON: https://synthcore.org/api/idea/816.json
- API Markdown: https://synthcore.org/api/idea/816.md
- Verification status: failed_benchmark
- Source: [arXiv:2607.12579](https://arxiv.org/abs/2607.12579)
- Category: regularization
- Solves: accuracy, generalization, stability
- ML areas: gan, vae, loss, regularization
- Math tags: optimal-transport, pde, harmonic-analysis, functional-analysis
- Ratings: usefulness 7/10; difficulty 5/10; novelty 6/10

## Idea description

Train a generator with a Coulomb discrepancy rather than, or in addition to, a local adversarial or reconstruction loss. The induced force attracts generated mass toward the target while repelling excess source mass, giving a geometry-aware anti-collapse regularizer.

## Mathematical statement

The paper evolves a source probability measure \(\rho_t\) toward a target probability measure \(\mu\) by \(\partial_t\rho-\operatorname{div}(\rho\nabla \mathsf g*(\rho-\mu))=0\). Here \(\rho\) is the generated-data distribution, \(\mu\) is the target distribution, \(\mathsf g\) is the Coulomb Green's function, and \(*\) denotes convolution. The corresponding velocity is \(v_\rho(x)=-\nabla\mathsf g*(\rho-\mu)(x)\). On the torus, \(-\Delta\mathsf g=\delta_0-1\), so if \(\sigma=\rho-\mu\) and \(u=\mathsf g*\sigma\), then \(-\Delta u=\sigma\). The squared Coulomb discrepancy is \(\mathcal E(\rho,\mu)=\int|\nabla u|^2dx=\langle\sigma,u\rangle\), up to normalization. The zero Fourier mode is removed because \(\rho\) and \(\mu\) have equal mass.

## Key formulas

- $$\partial_t\rho-\operatorname{div}\!\left(\rho\nabla \mathsf g*(\rho-\mu)\right)=0,$$
- $$-\Delta\mathsf g=\delta_0-1\quad\text{on }\mathbb T^d,\qquad -\Delta\mathsf g=\delta_0\quad\text{on }\mathbb R^d,$$
- $$\sigma=\rho-\mu,\qquad -\Delta u=\sigma,\qquad \mathcal E(\rho,\mu)=\int_{\mathbb T^d}|\nabla u(x)|^2\,dx=\langle\sigma,u\rangle,$$
- $$\mathcal L_C=\sum_{k\neq0}\frac{|\widehat\sigma(k)|^2}{4\pi^2|k|^2},\qquad \mathcal L=\mathcal L_{base}+\lambda_C\mathcal L_C.$$

## Implementation notes

Integrate the method at the generator output. Normalize data coordinates to a periodic box \([-1/2,1/2)^d\); for images, first use a frozen or jointly trained low-dimensional feature map because raw pixel-space Coulomb distances are usually inappropriate. For each minibatch, draw generated samples \(x_i=G_\theta(z_i)\) and target samples \(y_j\). Deposit both empirical measures onto an \(M^d\) periodic grid using differentiable bilinear or Gaussian splatting, producing grids \(r\) and \(m\), and set \(\sigma=r-m\). Compute the FFT \(\widehat u(k)=\widehat\sigma(k)/(4\pi^2|k|^2)\) for every nonzero frequency and set \(\widehat u(0)=0\). Evaluate \(\mathcal L_C=\sum_{k\ne0}|\widehat\sigma(k)|^2/(4\pi^2|k|^2)\), with consistent grid-volume normalization, and backpropagate through the splatting and FFT operations. Use \(\mathcal L=\mathcal L_{base}+\lambda_C\mathcal L_C\), ramping \(\lambda_C\) from zero during the first few epochs. The Poisson solve and energy formula come from the paper; grid size, splat bandwidth, coefficient \(\lambda_C\), and minibatch resampling are empirical choices. First test a small MLP GAN on the 2-D eight-Gaussians and a 2-D Swiss-roll distribution, comparing GAN, ordinary MMD, and GAN-plus-Coulomb at equal updates. Measure mode coverage, per-mode counts, sliced Wasserstein distance, FID where applicable, gradient variance, and Coulomb energy. Success means fewer missing modes and lower distributional discrepancy at similar sample quality, with no more than roughly 2x wall-clock cost. Also test targets with concentrated mass and empty regions because the paper shows that vacuum can invalidate uniform PL rates.

## Verification

- Status: failed_benchmark
- Mechanism evidence: yes
- Mechanism confirmed: no
- Practical verdict: no_effect
- Verdict: Built a differentiable Fourier Coulomb discrepancy and a reproducible eight-Gaussians MMD generator experiment in experiment.py. The mechanism checks matched theory: one-step and 25-step Fourier contraction errors were below 1e-15, zero Coulomb weight produced no update, low-frequency contraction was stronger (0.00405 vs 0.000312 per step), and the predicted stability boundary λ=493.48 was correctly crossed. In the toy comparison, Coulomb+MMD improved sliced Wasserstein (0.01754 vs 0.02305) and Coulomb energy (0.005998 vs 0.007072) at similar runtime, although both methods already achieved full 8/8 mode coverage.

### Mechanism check

- Verdict: Built a differentiable Fourier Coulomb discrepancy and a reproducible eight-Gaussians MMD generator experiment in experiment.py. The mechanism checks matched theory: one-step and 25-step Fourier contraction errors were below 1e-15, zero Coulomb weight produced no update, low-frequency contraction was stronger (0.00405 vs 0.000312 per step), and the predicted stability boundary λ=493.48 was correctly crossed. In the toy comparison, Coulomb+MMD improved sliced Wasserstein (0.01754 vs 0.02305) and Coulomb energy (0.005998 vs 0.007072) at similar runtime, although both methods already achieved full 8/8 mode coverage.
- Confidence: 9/10
- Limitations: Only one fixed-seed small eight-Gaussians experiment was run; no Swiss-roll, image feature space, adversarial GAN baseline, multiple-seed statistics, grid splatting implementation, or large-scale/runtime study was tested. The stability sweep tests the exact scalar Fourier-mode update rather than nonlinear particle transport near vacuum.

### Practical benchmark

- Paired seeds: 8
- Baseline mean: 0
- Idea mean: 0
- p-value: 0.7007
- Paired wins: 4/8
- Benchmark verdict: no significant win

## Artifacts

- [bench_experiment.py](https://synthcore.org/code/332/bench_experiment.py)
- [bench_report.json](https://synthcore.org/code/332/bench_report.json)
- [experiment.py](https://synthcore.org/code/332/experiment.py)
- [report.md](https://synthcore.org/code/332/report.md)
- [report_bench_2026-08-31T012639.md](https://synthcore.org/code/332/report_bench_2026-08-31T012639.md)
- [results.json](https://synthcore.org/code/332/results.json)
- [Download all files as ZIP](https://synthcore.org/download/332)

## Disclaimer

AI-generated research hypothesis, automatically tested. Not peer-reviewed.