Uniformly Mixing Coulomb Particle Bank
Implementation & benchmark of arXiv:2608.24863 — Uniform logarithmic Sobolev inequalities for the 2D Coulomb gas at the diffusive temperature scale
Source paper: Uniform logarithmic Sobolev inequalities for the 2D Coulomb gas at the diffusive temperature scale arXiv:2608.24863 ⓘ · analyzed Aug 29, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Represent a set of neural prototypes, mixture components, or latent particles by N points in R^2, and initialize or refresh them with Langevin dynamics targeting a quadratically confined logarithmic Coulomb gas. The logarithmic repulsion prevents particle collapse, while the paper's N-uniform logarithmic Sobolev inequality predicts that mixing need not degrade as the particle bank grows.
Formulas
Mathematical statement
The paper defines the Hamiltonian H_N(Z) = (1/2) sum_i |z_i|^2 + (1/N) sum_{i<j} g(z_i-z_j), where Z = (z_1,...,z_N) belongs to C^N, g(u) = -log|u|, and |u| is Euclidean distance in the plane. Its Gibbs distribution is dP_{N,beta}(Z) = Z_{N,beta}^{-1} exp(-beta H_N(Z)) dZ, where beta > 0 is inverse temperature and Z_{N,beta} is the normalizing constant. The main theorem gives a logarithmic Sobolev inequality Ent_P(f^2) <= (2/rho_beta) integral ||grad f||^2 dP, for suitable collision-free functions f, with rho_beta > 0 independent of N. Here Ent_P(f^2) = E_P[f^2 log(f^2)] - E_P[f^2] log(E_P[f^2]). The associated overdamped Langevin process has this Gibbs law as invariant distribution. Using grad_{z_i}[-log|z_i-z_j|] = -(z_i-z_j)/|z_i-z_j|^2, the repulsive force in the negative energy gradient is (1/N) sum_{j != i} (z_i-z_j)/|z_i-z_j|^2. The theorem's transferable property is dimension-uniform entropy contraction for this mean-field repulsive system, although discretization and collision smoothing require empirical validation.
Implementation notes
Integrate the method at a prototype-bank or latent-particle tensor. Let Z in R^{N x 2} contain N learnable or sampled two-dimensional coordinates. These coordinates can be used directly for routing, or passed through a learned map e_i = g_theta(z_i) to produce high-dimensional prototypes. At initialization or during periodic refreshes, run K unadjusted Langevin steps. For each step, compute pairwise differences D_ij = z_i - z_j and squared distances r2_ij = ||D_ij||^2. Set R_i = (1/N) sum_{j != i} D_ij / (r2_ij + epsilon), then update z_i <- z_i - eta (z_i - R_i) + sqrt(2 eta / beta) xi_i, where xi_i is a standard two-dimensional Gaussian. The confinement term z_i comes from the quadratic potential, the factor 1/N is the paper's mean-field scaling, beta controls noise, and epsilon prevents numerical blow-up at collisions. For a routing experiment, use logits l_i(h) = -||W h - z_i||^2 / tau and train W and the downstream model while either freezing Z after initialization or refreshing Z periodically. The paper supplies the N-independent LSI claim for the exact singular target; estimate the effective mixing rate of the discretized sampler empirically using autocorrelation of mean radius, pairwise distance, and assignment histograms. Start with CIFAR-10, a small MLP or ViT, and N in {16, 64, 256}. Compare Gaussian prototypes, repulsion-only gradient descent, and Coulomb Langevin at matched initialization cost. Record nearest-neighbor distance, dead-prototype fraction, assignment entropy, validation accuracy, and autocorrelation time. Success means stable minimum distances, fewer dead routes, and roughly unchanged mixing statistics as N increases, together with equal-or-better accuracy at fixed compute.
Verification
Stage 1 · Toy mechanism gate: Passed ✓
Stage 2 · Mechanism transferred to benchmark: Not reproduced ✗
Stage 2 · Practical benchmark result: Significantly worse ✗
Methodology: 8 paired seeds, permutation test (p<0.05) against a learning-rate-tuned baseline. How verification works
Stage 1 — Mechanism check agent confidence 7/10
Built a NumPy Coulomb-gas Langevin sampler with quadratic confinement, mean-field logarithmic repulsion, collision smoothing, finite-difference verification, autocorrelation estimation, and Gaussian prototype controls. The force identity matched finite differences to 2.1e-12 at the smallest tested step. Particle-radius integrated autocorrelation stayed essentially constant as N increased (76.34, 76.98, 78.50 for N=8,32,128), while Coulomb samples had no dead routes and higher assignment entropy than Gaussian controls, indicating a promising signal for uniform per-particle mixing and coverage. This does not verify the paper’s theorem itself; collective-radius autocorrelation decreased from 59.97 to 40.57.
- Agent confidence
- 7/10
- Baseline
- Gaussian controls N=8/32/128: normalized assignment entropy 0.7275/0.6089/0.5579; dead fraction 0/0.3125/0.7578; median nearest-neighbor distance 2.9588/1.0679/1.2121.
- Idea
- Coulomb Langevin N=8/32/128: per-particle radius IAT 76.34/76.98/78.50; normalized assignment entropy 0.9317/0.8970/0.9021; dead fraction 0/0/0; median nearest-neighbor distance 0.6293/0.1978/0.1262.
Limitations: Toy 2D sampler only; no CIFAR, learned prototype map, downstream routing accuracy, FLOP-matched training, multiple-seed confidence intervals, exact singular discretization, or direct verification of the paper’s logarithmic Sobolev constant was tested. Assignment statistics use random 2D Gaussian queries and the Gaussian control uses a manually matched scale, so these are illustrative rather than a full application benchmark.
How to run: python3 coulomb_bank.py
Stage 2 — Benchmark vs. tuned baseline (arXiv:2608.24863)
Significantly WORSE than the tuned baseline (+19.2%, p=0.0081, wins 0 / 8 paired seeds).
- Benchmark
- Tabular regression (Friedman)
- Model
- mlp_tiny
- Paired seeds
- 8
- Baseline mean
- 7.9275
- Idea mean
- 9.4467
- Effect (Δ)
- 1.5192 (+19.2%; negative = idea better)
- Wins
- 0 / 8 paired seeds
- p-value
- 0.0081 (permutation test, 20 000 shuffles)
- Smallest detectable effect
- ±9.7%
- Mechanism
- Not confirmed ✗
- Practical effect
- Hurts
- Baseline tuning
- swept over 3 configs
Only the built-in tabular initialization track was tested; no learned prototype routing, CIFAR experiment, refresh-during-training schedule, exact singular dynamics, or larger prototype-bank architectures were evaluated.
How to run: python3 run_bench.py
Verdict computed by deterministic test code from paired-seed statistics — not by the language model.
Stage 2 — Benchmark latest Failed ✗
Agent confidence: 9/10
Implemented Coulomb Langevin particle-bank initialization on the structurally appropriate tabular initialization track, using the same mlp_tiny architecture and train_model path as the Gaussian baseline. The tuned baseline achieved test MSE 7.9275 versus 9.4467 for the idea across 8 paired seeds; delta=+1.5192 and permutation p=0.0081, so the idea was significantly worse. The trained-model signature contradicted the prediction: Coulomb initialization produced smaller first-layer nearest-neighbor spacing, 0.0689 versus 0.4159, and confirmed=false.
- Baseline
- 8-seed MSE mean=7.9275478721, std=0.6638450061; best cfg lr=0.01, scale=1.3.
- Idea
- 8-seed MSE mean=9.4467310905, std=0.9494091152; cfg lr=0.01, scale=1.3; paired delta=+1.5191832185, p=0.0081, wins=0/8.
Benchmark result
Significantly WORSE than the tuned baseline (+19.2%, p=0.0081, wins 0 / 8 paired seeds).
- Benchmark
- Tabular regression (Friedman)
- Model
- mlp_tiny
- Paired seeds
- 8
- Baseline mean
- 7.9275
- Idea mean
- 9.4467
- Effect (Δ)
- 1.5192 (+19.2%; negative = idea better)
- Wins
- 0 / 8 paired seeds
- p-value
- 0.0081 (permutation test, 20 000 shuffles)
- Smallest detectable effect
- ±9.7%
- Mechanism
- Not confirmed ✗
- Practical effect
- Hurts
- Baseline tuning
- swept over 3 configs
Only the built-in tabular initialization track was tested; no learned prototype routing, CIFAR experiment, refresh-during-training schedule, exact singular dynamics, or larger prototype-bank architectures were evaluated.
How to run: python3 run_bench.py
Artifacts
- bench_report.json 2.6 KB View Raw
- coulomb_bank.py 3.0 KB View Raw
- report.md 1.8 KB View
- report_bench_2026-09-03T024641.md 3.8 KB View
- run_bench.py 5.2 KB View Raw