✓✓ Beats tuned baseline 2026

Symmetry-Preserving Flow Layer

Implementation & benchmark of arXiv:2607.29590 — Spindrift: Learning quantum degeneracy from thermal purity in restricted path integral Monte Carlo

Usefulness7/10
Difficulty5/10
Novelty4/10

Source paper: Spindrift: Learning quantum degeneracy from thermal purity in restricted path integral Monte Carlo arXiv:2607.29590 ⓘ · analyzed Aug 31, 2026

AI-generated research hypothesis, automatically tested. Not peer-reviewed.

Idea description

Construct hidden dynamics from permutation-equivariant vector fields and impose antisymmetry through an explicit antisymmetrizing readout. This prevents optimization from learning multiple equivalent copies of the same configuration and makes forbidden symmetry violations exactly zero, rather than merely penalizing them. The design applies to set models, particle systems, graph networks, and architectures handling unordered tokens.

Formulas

$$v_\phi(P_\pi x,t)=P_\pi v_\phi(x,t),\qquad \dot{x}(t)=v_\phi(x(t),t).$$
$$\mathcal{A}f(x)=\frac{1}{N!}\sum_{\pi\in S_N}\operatorname{sgn}(\pi)f(P_\pi x),\qquad \mathcal{A}f(P_\pi x)=\operatorname{sgn}(\pi)\mathcal{A}f(x).$$
$$\Psi_\theta(x)=\exp\big(J_\theta(x)\big)\mathcal{A}f_\theta(x),\qquad J_\theta(P_\pi x)=J_\theta(x).$$
$$E_{\mathrm{eq}}=\mathbb{E}_{x,\pi}\frac{\|v_\phi(P_\pi x,t)-P_\pi v_\phi(x,t)\|^2}{\|v_\phi(x,t)\|^2+\epsilon},\quad E_{\mathrm{as}}=\mathbb{E}_{x,\pi}\frac{|\Psi_\theta(P_\pi x)-\operatorname{sgn}(\pi)\Psi_\theta(x)|^2}{|\Psi_\theta(x)|^2+\epsilon}.$$

Mathematical statement

For an input configuration \(x=(x_1,\ldots,x_N)\), let \(P_\pi\) permute particle or token indices. An equivariant vector field satisfies \(v_\phi(P_\pi x,t)=P_\pi v_\phi(x,t)\), so the flow \(\dot{x}=v_\phi(x,t)\) commutes with permutations. A scalar symmetric factor satisfies \(J_\phi(P_\pi x)=J_\phi(x)\). To produce a fermionic or sign-changing output, use the antisymmetrizer \(\mathcal{A}f(x)=\frac{1}{N!}\sum_{\pi\in S_N}\operatorname{sgn}(\pi)f(P_\pi x)\), which obeys \(\mathcal{A}f(P_\pi x)=\operatorname{sgn}(\pi)\mathcal{A}f(x)\). The quantitative invariants are equivariance error and antisymmetry error, expected to be at numerical precision when implemented exactly.

Implementation notes

1. Integration point: replace a conventional MLP block acting on a set of N vectors by a shared equivariant block. For each item, compute \(h_i'=\operatorname{MLP}([h_i,\operatorname{mean}_j h_j,\operatorname{sum}_j g(h_i-h_j)])\); use the shared output as a residual update or ODE velocity. If an antisymmetric output is required, evaluate a base scalar on permutations and combine it with permutation signs, using a determinant or explicit antisymmetrizer for small N. 2. Pseudocode: sample x and a random permutation \(\pi\); compute \(y=\operatorname{Flow}_\phi(x,t)\) and \(y_{\mathrm{perm}}=\operatorname{Flow}_\phi(P_\pi x,t)\); optimize the task loss plus optional \(\lambda E_{\mathrm{eq}}\). For an antisymmetric head, compute \(s=\sum_\pi\operatorname{sgn}(\pi)f(P_\pi x)\), multiply by \(\exp(J(x))\), and use this as the output. 3. Computed exactly: permutation actions, sign factors, and equivariant message aggregation. Estimated empirically: task loss, Jacobian spectral norm, equivariance error, and antisymmetry error. 4. First cheap experiment: use N=4 or 6 unordered points with an invariant set-function target and a signed target for the antisymmetric variant; compare a vanilla concatenation MLP, DeepSets, and the equivariant flow block at equal parameter count. Measure test error under unseen permutations and integrate the flow for long horizons. The predicted signature is \(E_{\mathrm{eq}}\) and \(E_{\mathrm{as}}\) at floating-point noise for the structured model, versus nonzero errors for the unconstrained MLP. For the ODE version, permutation discrepancies should remain bounded by solver tolerance over time, while the unconstrained model's discrepancy should grow with integration depth.

Verification

Beats tuned baseline

Stage 1 · Toy mechanism gate: Passed ✓

Stage 2 · Mechanism transferred to benchmark: Confirmed ✓

Stage 2 · Practical benchmark result: Significant win ✓

Methodology: 8 paired seeds, permutation test (p<0.05) against a learning-rate-tuned baseline. How verification works

Stage 1 — Mechanism check agent confidence 9/10

Built an exact permutation-equivariant message-passing flow, explicit factorial antisymmetrizer, symmetric factor, Euler integration checks, and a small invariant-target comparison. The mechanism manifested: equivariance stayed at 1.4–1.8e-16 across input scales and 3.1–4.1e-17 across integration depths, versus about 0.167–0.168 for the unconstrained flow; antisymmetry absolute RMSE was 0 through N=4 and 1.1e-18 at N=6, with symmetric-factor error 6.6e-17. The predicted time scaling was confirmed with R2=0.99957, although the structured model did not improve the secondary task (RMSE 1.038 versus baseline 1.031).

Agent confidence
9/10
Baseline
Equivariance error 1.65–1.76 on the scale sweep; integrated-flow error 0.1666–0.1681 over 1–64 Euler steps; invariant-task RMSE 1.031.
Idea
Equivariance error 0–1.81e-16 over scales; integrated-flow error 3.1e-17–4.1e-17; antisymmetry absolute RMSE <=1.1e-18 for N<=6; symmetric-factor error 6.62e-17; time-displacement linear-fit R2 0.99957 with intercept 0.00274.

Limitations: Toy random-vector experiment only; no physical fermion density-matrix or energy benchmark, no learned flow task using an antisymmetric target, and explicit antisymmetrization was tested only through N=6 because its cost is factorial. The task comparison was small and did not equalize exact parameter counts or FLOPs.

How to run: python3 symmetry_flow_experiment.py

Stage 2 — Benchmark vs. tuned baseline (arXiv:2607.29590)

Beats the tuned baseline by 22.9% (p=0.0081, wins 8 / 8 paired seeds; metric: lower is better).

Benchmark
Correlated_token_moe_regression
Model
matched_custom
Paired seeds
8
Baseline mean
0.056
Idea mean
0.0432
Effect (Δ)
-0.0128 (−22.9%; negative = idea better)
Wins
8 / 8 paired seeds
p-value
0.0081 (permutation test, 20 000 shuffles)
Smallest detectable effect
±6.6%
Mechanism
Confirmed ✓
Practical effect
Helps
Baseline tuning
swept over 3 configs
Limitations:

Tested one registered correlated-token regression track and one matched baseline architecture; the explicit factorial antisymmetrizer and ODE integration aspects were not benchmarked at neural-network scale. The baseline and idea have similar but not exactly identical parameter counts, and no vision, sequence, or dynamics track was run because those tracks lack the required unordered-token structure.

How to run: python3 run_bench.py

Verdict computed by deterministic test code from paired-seed statistics — not by the language model.

Stage 2 — Benchmark latest Worked ✓

Agent confidence: 8/10

Implemented a matched end-to-end permutation-invariant set model and compared it with a label-sensitive flattened MLP on the structurally appropriate correlated-token regression benchmark. Across 8 paired seeds, the idea achieved MSE 0.043165 versus baseline 0.055977, with paired delta -0.012812 and permutation p=0.0081; all eight paired differences favored the idea. The trained-model mechanism signature was confirmed: mean swap sensitivity was 1.27e-08 for the idea versus 0.045198 for baseline.

Baseline
MSE 0.0559766, std 0.0045134; best sweep lr=0.001, epochs=20.
Idea
MSE 0.0431650, std 0.0048839; best sweep lr=0.003, epochs=20; delta=-0.0128116; p=0.0081; 8/8 wins; token-swap sensitivity 1.27e-08 versus baseline 0.0451983.

Benchmark result

Beats the tuned baseline by 22.9% (p=0.0081, wins 8 / 8 paired seeds; metric: lower is better).

Benchmark
Correlated_token_moe_regression
Model
matched_custom
Paired seeds
8
Baseline mean
0.056
Idea mean
0.0432
Effect (Δ)
-0.0128 (−22.9%; negative = idea better)
Wins
8 / 8 paired seeds
p-value
0.0081 (permutation test, 20 000 shuffles)
Smallest detectable effect
±6.6%
Mechanism
Confirmed ✓
Practical effect
Helps
Baseline tuning
swept over 3 configs
Limitations:

Tested one registered correlated-token regression track and one matched baseline architecture; the explicit factorial antisymmetrizer and ODE integration aspects were not benchmarked at neural-network scale. The baseline and idea have similar but not exactly identical parameter counts, and no vision, sequence, or dynamics track was run because those tracks lack the required unordered-token structure.

How to run: python3 run_bench.py

Artifacts

Implementation overview ⬇ Download all as ZIP 7 files · code, reports and structured results