# Equivariant Variational Field Network

- ID: 2243
- Canonical URL: https://synthcore.org/idea/2243/equivariant-variational-field-network
- API JSON: https://synthcore.org/api/idea/2243.json
- API Markdown: https://synthcore.org/api/idea/2243.md
- Verification status: beats_baseline
- Source: [arXiv:2608.13506](https://arxiv.org/abs/2608.13506)
- Category: architecture
- Solves: stability, generalization, accuracy
- ML areas: cnn, training-dynamics, world-model, regularization
- Math tags: statistical-mechanics, functional-analysis, optimization, dynamical-systems, geometry
- Ratings: usefulness 8/10; difficulty 7/10; novelty 6/10

## Idea description

Represent a scalar energy or free-energy functional of a three-dimensional neural field using translation- and rotation-equivariant convolutions, and produce the field prediction by minimizing the total functional rather than by a direct decoder. The same functional can then generate equilibrium states, forces, and response observables under new external fields, resolutions, and system sizes.

## Mathematical statement

For a density-like field \(\rho(\mathbf r)\ge 0\), temperature \(T\), external potential \(V_{\mathrm{ext}}(\mathbf r)\), chemical potential \(\mu\), and Boltzmann constant \(k_{\mathrm B}\), define \(F_{\mathrm{id}}[\rho,T]=k_{\mathrm B}T\int d\mathbf r\,\rho(\mathbf r)[\ln(\Lambda^3\rho(\mathbf r))-1]\), where \(\Lambda\) is a reference thermal wavelength, and let \(F_{\mathrm{exc},\theta}[\rho,T]\) be a learned scalar functional. The total grand potential is \(\Omega_\theta[\rho]=F_{\mathrm{id}}[\rho,T]+F_{\mathrm{exc},\theta}[\rho,T]+\int d\mathbf r\,\rho(\mathbf r)[V_{\mathrm{ext}}(\mathbf r)-\mu]\). The predicted equilibrium field satisfies the Euler-Lagrange condition \(\delta\Omega_\theta/\delta\rho(\mathbf r)=0\), or, for a canonical constraint, the same equation up to a spatially constant Lagrange multiplier. The architecture should satisfy \(F_{\mathrm{exc},\theta}[g\rho,T]=F_{\mathrm{exc},\theta}[\rho,T]\) for every allowed spatial symmetry \(g\), while intermediate feature fields transform equivariantly. Local minimization stability is controlled by the Hessian \(H_\theta=\delta^2\Omega_\theta/\delta\rho\delta\rho\); a stable equilibrium requires its smallest non-constrained eigenvalue to be positive.

## Key formulas

- $$\Omega_\theta[\rho]=k_{\mathrm B}T\int d\mathbf r\,\rho(\mathbf r)\left[\ln(\Lambda^3\rho(\mathbf r))-1\right]+F_{\mathrm{exc},\theta}[\rho,T]+\int d\mathbf r\,\rho(\mathbf r)\left[V_{\mathrm{ext}}(\mathbf r)-\mu\right].$$
- $$\frac{\delta\Omega_\theta}{\delta\rho(\mathbf r)}=k_{\mathrm B}T\ln(\Lambda^3\rho(\mathbf r))+\frac{\delta F_{\mathrm{exc},\theta}}{\delta\rho(\mathbf r)}+V_{\mathrm{ext}}(\mathbf r)-\mu=0.$$
- $$\rho_{n+1}=\operatorname{PosProj}\left[\rho_n-\eta M\frac{\delta\Omega_\theta}{\delta\rho}[\rho_n]\right],\qquad 0<\eta<\frac{2}{\lambda_{\max}(M^{1/2}H_\theta M^{1/2})}.$$
- $$H_\theta(\mathbf r,\mathbf r')=\frac{\delta^2\Omega_\theta}{\delta\rho(\mathbf r)\delta\rho(\mathbf r')},\qquad \lambda_{\min}(H_\theta)>0\ \text{at a locally stable minimum}.$$

## Implementation notes

Integrate this module as an energy-based alternative to a direct 3D CNN or U-Net output. Encode a voxel field \(\rho\) and temperature with periodic or boundary-aware equivariant convolutions; use scalar invariant contractions and equivariant vector or tensor channels, and finish with a global scalar sum to obtain \(F_{\mathrm{exc},\theta}[\rho,T]\). During inference, initialize \(\rho\) with a positive softplus field and minimize \(\Omega_\theta\) with 20–200 preconditioned gradient steps. Pseudocode is: compute \(F_{\mathrm{id}}\), compute the network scalar \(F_{\mathrm{exc},\theta}\), add \(\sum_i\rho_i(V_i-\mu)\Delta V\), differentiate with automatic differentiation, update \(\rho\) using the displayed gradient step, and optionally renormalize \(\sum_i\rho_i\Delta V=N\). Train on equilibrium density fields using Euler residuals and field reconstruction, with random rotations, translations, grid sizes, and external potentials. The analytic ideal-gas term and variational equations come from the paper; network parameters, Hessian spectra, and optimal step sizes are estimated empirically. The first cheap experiment should use a 3D Lennard-Jones or synthetic interacting-density dataset, compare against a direct 3D U-Net, and hold out temperatures and box sizes. The quantitative prediction is that the measured gradient-descent divergence boundary agrees within 20 percent with \(\eta_c\approx2/\lambda_{\max}(H_\theta)\), while rotated inputs produce invariant scalar energies and correspondingly rotated minimizers.

## Verification

- Status: beats_baseline
- Mechanism evidence: yes
- Mechanism confirmed: yes
- Practical verdict: helps
- Verdict: Built and ran a compact variational-field MVP using an analytic ideal-gas term plus an isotropic periodic quadratic excess functional, with projected gradient descent and a direct 3D CNN comparison. The mechanism manifested: the measured divergence boundary was eta≈0.808 versus the predicted 0.800 (1.0% error), and the predicted contraction factor 0.720 matched the late observed factor 0.71997. Discrete translations and rotations preserved energy to 0 and transformed gradients with errors below 9e-16; the variational solver also had lower toy test MSE (0.02892 vs 0.03196).

### Mechanism check

- Verdict: Built and ran a compact variational-field MVP using an analytic ideal-gas term plus an isotropic periodic quadratic excess functional, with projected gradient descent and a direct 3D CNN comparison. The mechanism manifested: the measured divergence boundary was eta≈0.808 versus the predicted 0.800 (1.0% error), and the predicted contraction factor 0.720 matched the late observed factor 0.71997. Discrete translations and rotations preserved energy to 0 and transformed gradients with errors below 9e-16; the variational solver also had lower toy test MSE (0.02892 vs 0.03196).
- Confidence: 8/10
- Limitations: This is a toy surrogate rather than a trained equivariant neural functional: the excess energy is a fixed isotropic quadratic convolution, not a learned 3D tensor/vector-channel network. The comparison uses synthetic fields and a small decoder, and does not test Lennard-Jones data, multiple resolutions or system sizes, canonical constraints, preconditioning, force/response observables, or statistically meaningful repeated trials. The parameter-scaling probe uses a non-worst-case mode, so its above-boundary ratios are not a valid full spectral divergence test; the primary stability sweep uses the correct largest-Hessian eigenvalue and is the reliable boundary result.

### Practical benchmark

- Paired seeds: 8
- Baseline mean: 0
- Idea mean: 0
- p-value: 0.0081
- Paired wins: 8/8
- Benchmark verdict: idea better (significant)

## Artifacts

- [bench_report.json](https://synthcore.org/code/794/bench_report.json)
- [bench_variational.py](https://synthcore.org/code/794/bench_variational.py)
- [experiment.py](https://synthcore.org/code/794/experiment.py)
- [report.md](https://synthcore.org/code/794/report.md)
- [report_bench_2026-09-01T104049.md](https://synthcore.org/code/794/report_bench_2026-09-01T104049.md)
- [results.json](https://synthcore.org/code/794/results.json)
- [Download all files as ZIP](https://synthcore.org/download/794)

## Disclaimer

AI-generated research hypothesis, automatically tested. Not peer-reviewed.