✗ Failed on benchmark 2026

Uniformly Mixing Coulomb Particle Bank

Implementation & benchmark of arXiv:2608.24863 — Uniform logarithmic Sobolev inequalities for the 2D Coulomb gas at the diffusive temperature scale

Usefulness6/10
Difficulty5/10
Novelty7/10

Source paper: Uniform logarithmic Sobolev inequalities for the 2D Coulomb gas at the diffusive temperature scale arXiv:2608.24863 ⓘ · analyzed Aug 29, 2026

AI-generated research hypothesis, automatically tested. Not peer-reviewed.

Idea description

Represent a set of neural prototypes, mixture components, or latent particles by N points in R^2, and initialize or refresh them with Langevin dynamics targeting a quadratically confined logarithmic Coulomb gas. The logarithmic repulsion prevents particle collapse, while the paper's N-uniform logarithmic Sobolev inequality predicts that mixing need not degrade as the particle bank grows.

Formulas

$$\mathcal{H}_{N}(Z)=\frac{1}{2}\sum_{i=1}^{N}|z_i|^{2}+\frac{1}{N}\sum_{1\leq i<j\leq N}\mathsf{g}(z_i-z_j),\qquad \mathsf{g}(u)=-\log|u|.$$
$$\mathrm{d}\mathbb{P}_{N,\beta}(Z)=\mathsf{Z}_{N,\beta}^{-1}e^{-\beta\mathcal{H}_{N}(Z)}\,\mathrm{d}Z=\mathsf{Z}_{N,\beta}^{-1}e^{-\beta|Z|^{2}/2}\prod_{i<j}|z_i-z_j|^{\beta/N}\,\mathrm{d}Z.$$
$$\operatorname{Ent}_{\mathbb{P}_{N,\beta}}(f^{2})\leq \frac{2}{\rho_{\beta}}\int\|\nabla f(Z)\|^{2}\,\mathrm{d}\mathbb{P}_{N,\beta}(Z),\qquad \rho_{\beta}>0\ \text{independent of }N.$$
$$z_i^{k+1}=z_i^{k}-\eta\left[z_i^{k}-\frac{1}{N}\sum_{j\neq i}\frac{z_i^{k}-z_j^{k}}{|z_i^{k}-z_j^{k}|^{2}+\varepsilon}\right]+\sqrt{\frac{2\eta}{\beta}}\,\xi_i^{k},\qquad \xi_i^{k}\sim\mathcal{N}(0,I_2).$$

Mathematical statement

The paper defines the Hamiltonian H_N(Z) = (1/2) sum_i |z_i|^2 + (1/N) sum_{i<j} g(z_i-z_j), where Z = (z_1,...,z_N) belongs to C^N, g(u) = -log|u|, and |u| is Euclidean distance in the plane. Its Gibbs distribution is dP_{N,beta}(Z) = Z_{N,beta}^{-1} exp(-beta H_N(Z)) dZ, where beta > 0 is inverse temperature and Z_{N,beta} is the normalizing constant. The main theorem gives a logarithmic Sobolev inequality Ent_P(f^2) <= (2/rho_beta) integral ||grad f||^2 dP, for suitable collision-free functions f, with rho_beta > 0 independent of N. Here Ent_P(f^2) = E_P[f^2 log(f^2)] - E_P[f^2] log(E_P[f^2]). The associated overdamped Langevin process has this Gibbs law as invariant distribution. Using grad_{z_i}[-log|z_i-z_j|] = -(z_i-z_j)/|z_i-z_j|^2, the repulsive force in the negative energy gradient is (1/N) sum_{j != i} (z_i-z_j)/|z_i-z_j|^2. The theorem's transferable property is dimension-uniform entropy contraction for this mean-field repulsive system, although discretization and collision smoothing require empirical validation.

Implementation notes

Integrate the method at a prototype-bank or latent-particle tensor. Let Z in R^{N x 2} contain N learnable or sampled two-dimensional coordinates. These coordinates can be used directly for routing, or passed through a learned map e_i = g_theta(z_i) to produce high-dimensional prototypes. At initialization or during periodic refreshes, run K unadjusted Langevin steps. For each step, compute pairwise differences D_ij = z_i - z_j and squared distances r2_ij = ||D_ij||^2. Set R_i = (1/N) sum_{j != i} D_ij / (r2_ij + epsilon), then update z_i <- z_i - eta (z_i - R_i) + sqrt(2 eta / beta) xi_i, where xi_i is a standard two-dimensional Gaussian. The confinement term z_i comes from the quadratic potential, the factor 1/N is the paper's mean-field scaling, beta controls noise, and epsilon prevents numerical blow-up at collisions. For a routing experiment, use logits l_i(h) = -||W h - z_i||^2 / tau and train W and the downstream model while either freezing Z after initialization or refreshing Z periodically. The paper supplies the N-independent LSI claim for the exact singular target; estimate the effective mixing rate of the discretized sampler empirically using autocorrelation of mean radius, pairwise distance, and assignment histograms. Start with CIFAR-10, a small MLP or ViT, and N in {16, 64, 256}. Compare Gaussian prototypes, repulsion-only gradient descent, and Coulomb Langevin at matched initialization cost. Record nearest-neighbor distance, dead-prototype fraction, assignment entropy, validation accuracy, and autocorrelation time. Success means stable minimum distances, fewer dead routes, and roughly unchanged mixing statistics as N increases, together with equal-or-better accuracy at fixed compute.

Verification

Failed on benchmark

Stage 1 · Toy mechanism gate: Passed ✓

Stage 2 · Mechanism transferred to benchmark: Not reproduced ✗

Stage 2 · Practical benchmark result: Significantly worse ✗

Methodology: 8 paired seeds, permutation test (p<0.05) against a learning-rate-tuned baseline. How verification works

Stage 1 — Mechanism check agent confidence 7/10

Built a NumPy Coulomb-gas Langevin sampler with quadratic confinement, mean-field logarithmic repulsion, collision smoothing, finite-difference verification, autocorrelation estimation, and Gaussian prototype controls. The force identity matched finite differences to 2.1e-12 at the smallest tested step. Particle-radius integrated autocorrelation stayed essentially constant as N increased (76.34, 76.98, 78.50 for N=8,32,128), while Coulomb samples had no dead routes and higher assignment entropy than Gaussian controls, indicating a promising signal for uniform per-particle mixing and coverage. This does not verify the paper’s theorem itself; collective-radius autocorrelation decreased from 59.97 to 40.57.

Agent confidence
7/10
Baseline
Gaussian controls N=8/32/128: normalized assignment entropy 0.7275/0.6089/0.5579; dead fraction 0/0.3125/0.7578; median nearest-neighbor distance 2.9588/1.0679/1.2121.
Idea
Coulomb Langevin N=8/32/128: per-particle radius IAT 76.34/76.98/78.50; normalized assignment entropy 0.9317/0.8970/0.9021; dead fraction 0/0/0; median nearest-neighbor distance 0.6293/0.1978/0.1262.

Limitations: Toy 2D sampler only; no CIFAR, learned prototype map, downstream routing accuracy, FLOP-matched training, multiple-seed confidence intervals, exact singular discretization, or direct verification of the paper’s logarithmic Sobolev constant was tested. Assignment statistics use random 2D Gaussian queries and the Gaussian control uses a manually matched scale, so these are illustrative rather than a full application benchmark.

How to run: python3 coulomb_bank.py

Stage 2 — Benchmark vs. tuned baseline (arXiv:2608.24863)

Significantly WORSE than the tuned baseline (+19.2%, p=0.0081, wins 0 / 8 paired seeds).

Benchmark
Tabular regression (Friedman)
Model
mlp_tiny
Paired seeds
8
Baseline mean
7.9275
Idea mean
9.4467
Effect (Δ)
1.5192 (+19.2%; negative = idea better)
Wins
0 / 8 paired seeds
p-value
0.0081 (permutation test, 20 000 shuffles)
Smallest detectable effect
±9.7%
Mechanism
Not confirmed ✗
Practical effect
Hurts
Baseline tuning
swept over 3 configs
Limitations:

Only the built-in tabular initialization track was tested; no learned prototype routing, CIFAR experiment, refresh-during-training schedule, exact singular dynamics, or larger prototype-bank architectures were evaluated.

How to run: python3 run_bench.py

Verdict computed by deterministic test code from paired-seed statistics — not by the language model.

Stage 2 — Benchmark latest Failed ✗

Agent confidence: 9/10

Implemented Coulomb Langevin particle-bank initialization on the structurally appropriate tabular initialization track, using the same mlp_tiny architecture and train_model path as the Gaussian baseline. The tuned baseline achieved test MSE 7.9275 versus 9.4467 for the idea across 8 paired seeds; delta=+1.5192 and permutation p=0.0081, so the idea was significantly worse. The trained-model signature contradicted the prediction: Coulomb initialization produced smaller first-layer nearest-neighbor spacing, 0.0689 versus 0.4159, and confirmed=false.

Baseline
8-seed MSE mean=7.9275478721, std=0.6638450061; best cfg lr=0.01, scale=1.3.
Idea
8-seed MSE mean=9.4467310905, std=0.9494091152; cfg lr=0.01, scale=1.3; paired delta=+1.5191832185, p=0.0081, wins=0/8.

Benchmark result

Significantly WORSE than the tuned baseline (+19.2%, p=0.0081, wins 0 / 8 paired seeds).

Benchmark
Tabular regression (Friedman)
Model
mlp_tiny
Paired seeds
8
Baseline mean
7.9275
Idea mean
9.4467
Effect (Δ)
1.5192 (+19.2%; negative = idea better)
Wins
0 / 8 paired seeds
p-value
0.0081 (permutation test, 20 000 shuffles)
Smallest detectable effect
±9.7%
Mechanism
Not confirmed ✗
Practical effect
Hurts
Baseline tuning
swept over 3 configs
Limitations:

Only the built-in tabular initialization track was tested; no learned prototype routing, CIFAR experiment, refresh-during-training schedule, exact singular dynamics, or larger prototype-bank architectures were evaluated.

How to run: python3 run_bench.py

Artifacts

Implementation overview ⬇ Download all as ZIP 5 files · code, reports and structured results