Harmonic-coordinate neural PDE ansatz
Implementation & benchmark of arXiv:2607.14132 — Harmonic Variables for Laplace Operators on Homogeneous Spaces
Source paper: Harmonic Variables for Laplace Operators on Homogeneous Spaces arXiv:2607.14132 ⓘ · analyzed Aug 30, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Build a complex-valued coordinate map q(x) whose components are harmonic and whose gradients are mutually null, then feed q(x) into an otherwise unconstrained neural function v. Any learned output of the form u(x)=v(q(x)) is analytically harmonic when the constraints are satisfied, so the network does not need to rediscover the Laplace structure from collocation data. This is especially suitable for two-dimensional elliptic PDEs, where q=x+iy is the canonical example.
Formulas
Mathematical statement
Definition 1 states that q=q(x,y) is harmonic if u(x,y)=v(q(x,y)) solves the Laplace equation for every smooth v. For a scalar complex variable q and Euclidean Laplacian, the chain rule gives Delta[v(q)]=v'(q)Delta q+v''(q)[(partial_x q)^2+(partial_y q)^2]. Therefore the sufficient differential conditions are Delta q=0 and (partial_x q)^2+(partial_y q)^2=0; the second condition is the complex eikonal or null-gradient condition. For q=x+iy, Delta q=0 and 1^2+i^2=0, explaining why arbitrary analytic v(q) is harmonic. The trainable model estimates q and v, while automatic differentiation evaluates these residuals.
Implementation notes
Integrate this as a coordinate front-end for a neural PDE solver. The input is a collocation point x=(x,y); a small complex MLP q_phi(x)=q_R(x)+i q_I(x) produces one complex coordinate, and a second MLP v_theta receives [q_R,q_I] and predicts the physical field u. Use real automatic differentiation: compute q_x, q_y, q_xx, and q_yy separately for the real and imaginary parts. At each batch, form lap_q=q_xx+q_yy and eik=q_x*q_x+q_y*q_y, retaining complex arithmetic as pairs of real tensors. Optimize loss = PDE residual for u plus boundary/data loss plus lambda_h*mean(abs(lap_q)^2) + lambda_e*mean(abs(eik)^2). A practical loop is: x.requires_grad=True; q=q_phi(x); u=v_theta(real(q),imag(q)); r_pde=laplacian(u)-f(x); r_h=laplacian(q); r_e=qx*qx+qy*qy; loss=mean(r_pde**2)+boundary_loss+lambda_h*mean(abs(r_h)**2)+lambda_e*mean(abs(r_e)**2); backpropagate and update phi and theta. Initialize q close to x+i*y by setting the final layer to a fixed affine map plus a small trainable residual, and ramp lambda_h and lambda_e over the first 10 percent of training. The mathematical constraints are exact in the infinite-capacity limit; residual magnitudes are estimated empirically by autodiff. First test on harmonic functions and Poisson problems on the unit square or disk, comparing a standard MLP and a Fourier-feature MLP at equal parameter count and collocation budget. Success means lower Laplace residual and boundary error with fewer collocation points, especially on out-of-sample interior points; also test whether freezing q after pretraining makes v train faster.
Verification
Stage 1 · Toy mechanism gate: Passed ✓
Stage 2 · Mechanism transferred to benchmark: Confirmed ✓
Stage 2 · Practical benchmark result: Significantly worse ✗
Methodology: 8 paired seeds, permutation test (p<0.05) against a learning-rate-tuned baseline. How verification works
Stage 1 — Mechanism check agent confidence 8/10
Built a PyTorch harmonic-coordinate PDE ansatz with autodiff Laplacian and complex null-gradient residuals, plus a direct MLP baseline. The toy sweep confirmed the mechanism: the canonical q=x+iy identity had zero residual, the perturbed coordinate harmonic defect was exactly 2ε, and the null-gradient defect scaled as ε with observed exponent 1.000 and coefficient 2.0645, matching 4E|x|=2.0645. The ansatz was not an optimization win in this tiny test: baseline test MSE/Laplacian residual were 6.72e-5/0.0438 versus 2.56e-4/0.0875 for the ansatz.
- Agent confidence
- 8/10
- Baseline
- test MSE 6.7221e-05; mean absolute Laplacian 0.04380
- Idea
- test MSE 2.5562e-04; mean absolute Laplacian 0.08745; coordinate-constraint RMS 0.09148; defect scaling exponent 1.000
Limitations: Only a small 2D manufactured harmonic problem was tested, with one seed, 500 optimization steps, and no Fourier-feature or Poisson benchmark. The mechanism check verifies coordinate defect scaling but does not test broad PDE families, freezing or pretraining q, equal-FLOP comparisons, or sparse-collocation generalization.
How to run: cd /home/maxwelhelp/all/math2nn/experiments/exp892_harmonic-coordinate-neural-pde-ansatz && /home/maxwelhelp/main/bin/python3 experiment.py
Stage 2 — Benchmark vs. tuned baseline (arXiv:2607.14132)
Significantly WORSE than the tuned baseline (+233.9%, p=0.0394, wins 1 / 8 paired seeds).
- Benchmark
- Poisson_harmonic_square
- Model
- mlp_tiny
- Paired seeds
- 8
- Baseline mean
- 0.001
- Idea mean
- 0.0034
- Effect (Δ)
- 0.0024 (+233.9%; negative = idea better)
- Wins
- 1 / 8 paired seeds
- p-value
- 0.0394 (permutation test, 20 000 shuffles)
- Smallest detectable effect
- ±240.2%
- Mechanism
- Confirmed ✓
- Practical effect
- Hurts
- Baseline tuning
- swept over 3 configs
Only one custom manufactured harmonic PDE family was tested; no disk geometry, nonzero Poisson forcing, Fourier-feature baseline, q pretraining/freezing, larger collocation budgets, or equal-FLOP parameter-normalized study was run.
How to run: cd /home/maxwelhelp/all/math2nn/experiments/exp892_harmonic-coordinate-neural-pde-ansatz && /home/maxwelhelp/main/bin/python3 stage2_bench.py
Verdict computed by deterministic test code from paired-seed statistics — not by the language model.
Stage 2 — Benchmark latest Failed ✗
Agent confidence: 9/10
Implemented the harmonic-coordinate neural PDE ansatz and evaluated it on a structurally matched custom Poisson/harmonic-square track with 8 paired seeds. The idea was significantly worse: baseline MSE 0.00103270 versus idea MSE 0.00344777, paired delta +0.00241507, permutation p=0.03935, with only 1 of 8 paired wins. The trained-model mechanism measurements were finite but did not yield a useful transfer benefit.
- Baseline
- best lr=0.01; 8-seed test MSE mean 0.0010326977680961136, std 0.0006915660191288916
- Idea
- best shared lr=0.01; 8-seed test MSE mean 0.0034477697263355367, std 0.003057254396847933
- Idea wins
- 1
- N pairs
- 8
- Paired delta mean
- 0.002415071958239423
- Permutation p value
- 0.03935
Benchmark result
Significantly WORSE than the tuned baseline (+233.9%, p=0.0394, wins 1 / 8 paired seeds).
- Benchmark
- Poisson_harmonic_square
- Model
- mlp_tiny
- Paired seeds
- 8
- Baseline mean
- 0.001
- Idea mean
- 0.0034
- Effect (Δ)
- 0.0024 (+233.9%; negative = idea better)
- Wins
- 1 / 8 paired seeds
- p-value
- 0.0394 (permutation test, 20 000 shuffles)
- Smallest detectable effect
- ±240.2%
- Mechanism
- Confirmed ✓
- Practical effect
- Hurts
- Baseline tuning
- swept over 3 configs
Only one custom manufactured harmonic PDE family was tested; no disk geometry, nonzero Poisson forcing, Fourier-feature baseline, q pretraining/freezing, larger collocation budgets, or equal-FLOP parameter-normalized study was run.
How to run: cd /home/maxwelhelp/all/math2nn/experiments/exp892_harmonic-coordinate-neural-pde-ansatz && /home/maxwelhelp/main/bin/python3 stage2_bench.py
Artifacts
- bench_report.json 3.7 KB View Raw
- custom_pde_track.py 1.0 KB View Raw
- experiment.py 5.3 KB View Raw
- report.md 1.5 KB View
- report_bench_2026-08-31T094230.md 4.4 KB View
- results.json 1.6 KB View Raw
- stage2_bench.py 5.9 KB View Raw