△ Mechanism confirmed, baseline not beaten 2026

Harmonic-coordinate neural PDE ansatz

Implementation & benchmark of arXiv:2607.14132 — Harmonic Variables for Laplace Operators on Homogeneous Spaces

Usefulness7/10
Difficulty5/10
Novelty7/10

Source paper: Harmonic Variables for Laplace Operators on Homogeneous Spaces arXiv:2607.14132 ⓘ · analyzed Aug 30, 2026

AI-generated research hypothesis, automatically tested. Not peer-reviewed.

Idea description

Build a complex-valued coordinate map q(x) whose components are harmonic and whose gradients are mutually null, then feed q(x) into an otherwise unconstrained neural function v. Any learned output of the form u(x)=v(q(x)) is analytically harmonic when the constraints are satisfied, so the network does not need to rediscover the Laplace structure from collocation data. This is especially suitable for two-dimensional elliptic PDEs, where q=x+iy is the canonical example.

Formulas

$$\left(\dfrac{\partial^{2}}{\partial x^{2}}+\dfrac{\partial^{2}}{\partial y^{2}}\right)u(x,y)=0.$$
$$u(x,y)=v(q(x,y))\quad\text{is harmonic for every smooth }v\ \Longleftrightarrow\ \Delta q=0,\qquad (\partial_xq)^2+(\partial_yq)^2=0.$$
$$\Delta[v(q)]=v'(q)\,\Delta q+v''(q)\left[(\partial_xq)^2+(\partial_yq)^2\right].$$
$$\mathcal L=\mathcal L_{\mathrm{data}}+\lambda_h\frac{1}{B}\sum_{i=1}^{B}|\Delta q_\phi(x_i)|^2+\lambda_e\frac{1}{B}\sum_{i=1}^{B}\left|(\partial_xq_\phi(x_i))^2+(\partial_yq_\phi(x_i))^2\right|^2.$$

Mathematical statement

Definition 1 states that q=q(x,y) is harmonic if u(x,y)=v(q(x,y)) solves the Laplace equation for every smooth v. For a scalar complex variable q and Euclidean Laplacian, the chain rule gives Delta[v(q)]=v'(q)Delta q+v''(q)[(partial_x q)^2+(partial_y q)^2]. Therefore the sufficient differential conditions are Delta q=0 and (partial_x q)^2+(partial_y q)^2=0; the second condition is the complex eikonal or null-gradient condition. For q=x+iy, Delta q=0 and 1^2+i^2=0, explaining why arbitrary analytic v(q) is harmonic. The trainable model estimates q and v, while automatic differentiation evaluates these residuals.

Implementation notes

Integrate this as a coordinate front-end for a neural PDE solver. The input is a collocation point x=(x,y); a small complex MLP q_phi(x)=q_R(x)+i q_I(x) produces one complex coordinate, and a second MLP v_theta receives [q_R,q_I] and predicts the physical field u. Use real automatic differentiation: compute q_x, q_y, q_xx, and q_yy separately for the real and imaginary parts. At each batch, form lap_q=q_xx+q_yy and eik=q_x*q_x+q_y*q_y, retaining complex arithmetic as pairs of real tensors. Optimize loss = PDE residual for u plus boundary/data loss plus lambda_h*mean(abs(lap_q)^2) + lambda_e*mean(abs(eik)^2). A practical loop is: x.requires_grad=True; q=q_phi(x); u=v_theta(real(q),imag(q)); r_pde=laplacian(u)-f(x); r_h=laplacian(q); r_e=qx*qx+qy*qy; loss=mean(r_pde**2)+boundary_loss+lambda_h*mean(abs(r_h)**2)+lambda_e*mean(abs(r_e)**2); backpropagate and update phi and theta. Initialize q close to x+i*y by setting the final layer to a fixed affine map plus a small trainable residual, and ramp lambda_h and lambda_e over the first 10 percent of training. The mathematical constraints are exact in the infinite-capacity limit; residual magnitudes are estimated empirically by autodiff. First test on harmonic functions and Poisson problems on the unit square or disk, comparing a standard MLP and a Fourier-feature MLP at equal parameter count and collocation budget. Success means lower Laplace residual and boundary error with fewer collocation points, especially on out-of-sample interior points; also test whether freezing q after pretraining makes v train faster.

Verification

Mechanism confirmed, baseline not beaten

Stage 1 · Toy mechanism gate: Passed ✓

Stage 2 · Mechanism transferred to benchmark: Confirmed ✓

Stage 2 · Practical benchmark result: Significantly worse ✗

Methodology: 8 paired seeds, permutation test (p<0.05) against a learning-rate-tuned baseline. How verification works

Stage 1 — Mechanism check agent confidence 8/10

Built a PyTorch harmonic-coordinate PDE ansatz with autodiff Laplacian and complex null-gradient residuals, plus a direct MLP baseline. The toy sweep confirmed the mechanism: the canonical q=x+iy identity had zero residual, the perturbed coordinate harmonic defect was exactly 2ε, and the null-gradient defect scaled as ε with observed exponent 1.000 and coefficient 2.0645, matching 4E|x|=2.0645. The ansatz was not an optimization win in this tiny test: baseline test MSE/Laplacian residual were 6.72e-5/0.0438 versus 2.56e-4/0.0875 for the ansatz.

Agent confidence
8/10
Baseline
test MSE 6.7221e-05; mean absolute Laplacian 0.04380
Idea
test MSE 2.5562e-04; mean absolute Laplacian 0.08745; coordinate-constraint RMS 0.09148; defect scaling exponent 1.000

Limitations: Only a small 2D manufactured harmonic problem was tested, with one seed, 500 optimization steps, and no Fourier-feature or Poisson benchmark. The mechanism check verifies coordinate defect scaling but does not test broad PDE families, freezing or pretraining q, equal-FLOP comparisons, or sparse-collocation generalization.

How to run: cd /home/maxwelhelp/all/math2nn/experiments/exp892_harmonic-coordinate-neural-pde-ansatz && /home/maxwelhelp/main/bin/python3 experiment.py

Stage 2 — Benchmark vs. tuned baseline (arXiv:2607.14132)

Significantly WORSE than the tuned baseline (+233.9%, p=0.0394, wins 1 / 8 paired seeds).

Benchmark
Poisson_harmonic_square
Model
mlp_tiny
Paired seeds
8
Baseline mean
0.001
Idea mean
0.0034
Effect (Δ)
0.0024 (+233.9%; negative = idea better)
Wins
1 / 8 paired seeds
p-value
0.0394 (permutation test, 20 000 shuffles)
Smallest detectable effect
±240.2%
Mechanism
Confirmed ✓
Practical effect
Hurts
Baseline tuning
swept over 3 configs
Limitations:

Only one custom manufactured harmonic PDE family was tested; no disk geometry, nonzero Poisson forcing, Fourier-feature baseline, q pretraining/freezing, larger collocation budgets, or equal-FLOP parameter-normalized study was run.

How to run: cd /home/maxwelhelp/all/math2nn/experiments/exp892_harmonic-coordinate-neural-pde-ansatz && /home/maxwelhelp/main/bin/python3 stage2_bench.py

Verdict computed by deterministic test code from paired-seed statistics — not by the language model.

Stage 2 — Benchmark latest Failed ✗

Agent confidence: 9/10

Implemented the harmonic-coordinate neural PDE ansatz and evaluated it on a structurally matched custom Poisson/harmonic-square track with 8 paired seeds. The idea was significantly worse: baseline MSE 0.00103270 versus idea MSE 0.00344777, paired delta +0.00241507, permutation p=0.03935, with only 1 of 8 paired wins. The trained-model mechanism measurements were finite but did not yield a useful transfer benefit.

Baseline
best lr=0.01; 8-seed test MSE mean 0.0010326977680961136, std 0.0006915660191288916
Idea
best shared lr=0.01; 8-seed test MSE mean 0.0034477697263355367, std 0.003057254396847933
Idea wins
1
N pairs
8
Paired delta mean
0.002415071958239423
Permutation p value
0.03935

Benchmark result

Significantly WORSE than the tuned baseline (+233.9%, p=0.0394, wins 1 / 8 paired seeds).

Benchmark
Poisson_harmonic_square
Model
mlp_tiny
Paired seeds
8
Baseline mean
0.001
Idea mean
0.0034
Effect (Δ)
0.0024 (+233.9%; negative = idea better)
Wins
1 / 8 paired seeds
p-value
0.0394 (permutation test, 20 000 shuffles)
Smallest detectable effect
±240.2%
Mechanism
Confirmed ✓
Practical effect
Hurts
Baseline tuning
swept over 3 configs
Limitations:

Only one custom manufactured harmonic PDE family was tested; no disk geometry, nonzero Poisson forcing, Fourier-feature baseline, q pretraining/freezing, larger collocation budgets, or equal-FLOP parameter-normalized study was run.

How to run: cd /home/maxwelhelp/all/math2nn/experiments/exp892_harmonic-coordinate-neural-pde-ansatz && /home/maxwelhelp/main/bin/python3 stage2_bench.py

Artifacts

Implementation overview ⬇ Download all as ZIP 7 files · code, reports and structured results