✓✓ Beats tuned baseline 2026

Corrector-Enriched Two-Scale Network

Implementation & benchmark of arXiv:2607.15702 — Non-Asymptotic Variational Learning for Monotone Nonlinear Multiscale Elliptic Equations: Scale-Robust Primal-Dual Bounds and Strong-Form Statistical Ill-Conditioning

Usefulness8/10
Difficulty5/10
Novelty6/10

Source paper: Non-Asymptotic Variational Learning for Monotone Nonlinear Multiscale Elliptic Equations: Scale-Robust Primal-Dual Bounds and Strong-Form Statistical Ill-Conditioning arXiv:2607.15702 ⓘ · analyzed Aug 30, 2026

AI-generated research hypothesis, automatically tested. Not peer-reviewed.

Idea description

Replace a single neural representation of a rapidly oscillatory PDE solution by a macroscopic network plus an explicitly oscillatory corrector network. Feed the network both the slow coordinate $x$ and fast coordinate $y=x/\varepsilon$, and train the resulting composite field in a variational energy objective. This targets the paper's scale-robust approximation bound rather than forcing the optimizer and finite sample set to discover oscillations of wavelength $\varepsilon$.

Formulas

$$\mathcal{A}_{m}^{\varepsilon}\leq C\bigl(\varepsilon+\Phi_{0,m_{0}}^{2}+\Phi_{1,m_{1}}^{2}\bigr)$$
$$u_\theta^\varepsilon(x)=u_{0,\theta_0}(x)+\varepsilon\sum_{j=1}^{d}\chi_{j,\theta_1}\!\left(x,\frac{x}{\varepsilon}\right)\partial_j u_{0,\theta_0}(x)$$
$$\mathcal{L}_{\mathrm{var}}(\theta)=\frac{1}{N}\sum_{n=1}^{N}\left[W\!\left(x_n,\nabla u_\theta^\varepsilon(x_n)\right)-f(x_n)u_\theta^\varepsilon(x_n)\right]$$

Mathematical statement

The paper states the two-scale approximation estimate $\mathcal{A}_{m}^{\varepsilon}\leq C\bigl(\varepsilon+\Phi_{0,m_{0}}^{2}+\Phi_{1,m_{1}}^{2}\bigr)$. Here $\mathcal{A}_{m}^{\varepsilon}$ is the population approximation error at microscopic scale $\varepsilon$, $C$ is independent of $\varepsilon$, $m=m_0+m_1$ is the total feature budget, and $\Phi_{0,m_0}$ and $\Phi_{1,m_1}$ are approximation errors of the coarse and first-order corrector feature classes with budgets $m_0$ and $m_1$. The transferable property is that the irreducible homogenization error is $O(\varepsilon)$ while the learned coarse and oscillatory components are approximated separately. Use the adapted ansatz $u_\theta^\varepsilon(x)=u_{0,\theta_0}(x)+\varepsilon\sum_{j=1}^{d}\chi_{j,\theta_1}(x,x/\varepsilon)\,\partial_j u_{0,\theta_0}(x)$, where $u_0$ is the macroscopic network, $\chi_j$ are learned or precomputed periodic correctors, $d$ is spatial dimension, and $\partial_j u_0$ is the coarse derivative.

Implementation notes

1. Integration point: modify the solution MLP used by a variational PINN or Deep Ritz solver. Keep a coarse MLP $u_{0,\theta_0}(x)$, add a corrector MLP $\chi_{\theta_1}(x,y)$, and evaluate it at $y=x/\varepsilon$; enforce homogeneous boundary conditions by multiplying the final output by a known boundary mask $b(x)$ or by adding a boundary extension $g(x)$. Use automatic differentiation to obtain $\nabla_x u_\theta^\varepsilon(x)$, including the chain-rule derivative through $y=x/\varepsilon$. 2. Pseudocode: sample collocation points $x_n$; set $y_n=x_n/\varepsilon$; compute $u_0=u_0(x_n)$ and $J_0=\nabla_xu_0(x_n)$; compute $\chi=\chi(x_n,y_n)$; form $u=u_0+\varepsilon\sum_j\chi_jJ_{0,j}$; compute $L=N^{-1}\sum_n[W(x_n,\nabla u_n)-f_nu_n]$; backpropagate and update both parameter sets. 3. The theoretical objects are the coarse and first-order feature errors $\Phi_{0,m_0}$ and $\Phi_{1,m_1}$; estimate them empirically using held-out energy error and gradient error. If coefficient correctors are known, initialize or freeze $\chi_j$ from cell-problem data; otherwise pretrain them on periodic cell residuals and enforce periodicity with Fourier features or modulo-one coordinates. 4. First experiment: solve a 2D nonlinear periodic elliptic equation at $\varepsilon\in\{1/8,1/16,1/32\}$ using the same MLP width and the same number of quadrature points. Compare a plain coordinate MLP against the two-scale ansatz at equal parameter count and equal FLOPs. Measure relative $H^1$ error, energy error, gradient variance, and updates to a fixed error. Success means error scaling remains roughly proportional to $\varepsilon$ plus feature error, while the plain MLP loses accuracy or requires substantially more samples as $\varepsilon$ shrinks.

Verification

Beats tuned baseline

Stage 1 · Toy mechanism gate: Passed ✓

Stage 2 · Mechanism transferred to benchmark: Confirmed ✓

Stage 2 · Practical benchmark result: Significant win ✓

Methodology: 8 paired seeds, permutation test (p<0.05) against a learning-rate-tuned baseline. How verification works

Stage 1 — Mechanism check agent confidence 8/10

Built a variational 1D two-scale network benchmark with a coarse MLP and explicitly supplied periodic corrector, plus a plain coordinate MLP baseline. The mechanism checks passed: truncation H1 error scaled as epsilon^1.001, consistent with the predicted O(epsilon) behavior, and squared H1 error scaled as (corrector-amplitude mismatch)^1.000, equivalent to linear H1 error versus amplitude mismatch. At equal parameter count, the two-scale model substantially beat the plain MLP across all tested epsilon values, although the corrector was precomputed rather than learned.

Agent confidence
8/10
Baseline
Relative H1 errors: 0.922, 0.978, 0.976 at epsilon=1/8, 1/16, 1/32; absolute weighted H1 errors: 2.788, 2.913, 2.905.
Idea
Relative H1 errors: 0.088, 0.080, 0.052 at epsilon=1/8, 1/16, 1/32; absolute weighted H1 errors: 0.259, 0.236, 0.154. Both models had 481 parameters.

Limitations: Only a 1D manufactured elliptic problem was tested, not the requested 2D nonlinear PDE. The corrector was known and frozen, so this validates the precomputed-corrector variant rather than learned-corrector optimization. Derivative/FLOP costs were not matched, only parameter count and training sample/step budget; the epsilon law is for weighted H1 truncation error rather than a full population approximation-theorem bound.

How to run: python3 experiment.py

Stage 2 — Benchmark vs. tuned baseline (arXiv:2607.15702)

Beats the tuned baseline by 71.0% (p=0.0081, wins 8 / 8 paired seeds; metric: lower is better).

Benchmark
Oscillatory_poisson_dirichlet
Model
mlp_tiny
Paired seeds
8
Baseline mean
0.0006
Idea mean
0.0002
Effect (Δ)
-0.0004 (−71.0%; negative = idea better)
Wins
8 / 8 paired seeds
p-value
0.0081 (permutation test, 20 000 shuffles)
Smallest detectable effect
n/a
Mechanism
Confirmed ✓
Practical effect
Helps
Baseline tuning
swept over 3 configs
Limitations:

The custom PDE track is 1-D manufactured oscillatory Dirichlet regression rather than a 2-D nonlinear PDE. The corrector is precomputed and fixed rather than learned, and derivative/FLOP matching was not explicitly profiled. The signature tests trained-model behavior but does not establish the full theoretical approximation bound.

How to run: python3 bench_two_scale.py

Verdict computed by deterministic test code from paired-seed statistics — not by the language model.

Stage 2 — Benchmark latest Worked ✓

Agent confidence: 8/10

Implemented a structurally matched oscillatory Poisson/Dirichlet custom PDE track and an end-to-end two-scale MLP with a precomputed periodic corrector evaluated at x/epsilon. The core numerical check confirmed O(epsilon) H1-like truncation scaling with slope 1.0006. Across 8 paired seeds, the idea significantly improved test MSE over the tuned baseline, with permutation p=0.0081; the trained-model oscillatory projection signature also confirmed improved recovery.

Baseline
Test MSE mean 0.0005627610, std 0.0000462969; best config lr=0.01, epochs=40.
Idea
Test MSE mean 0.0001630888, std 0.0000209176; paired delta -0.0003996722, 8/8 wins, permutation p=0.0081.
Mechanism signature
Observed high-frequency projection absolute error: baseline 0.00109588, idea 0.00046643; confirmed=true.
Relative improvement
70.99% lower mean test MSE.

Benchmark result

Beats the tuned baseline by 71.0% (p=0.0081, wins 8 / 8 paired seeds; metric: lower is better).

Benchmark
Oscillatory_poisson_dirichlet
Model
mlp_tiny
Paired seeds
8
Baseline mean
0.0006
Idea mean
0.0002
Effect (Δ)
-0.0004 (−71.0%; negative = idea better)
Wins
8 / 8 paired seeds
p-value
0.0081 (permutation test, 20 000 shuffles)
Smallest detectable effect
n/a
Mechanism
Confirmed ✓
Practical effect
Helps
Baseline tuning
swept over 3 configs
Limitations:

The custom PDE track is 1-D manufactured oscillatory Dirichlet regression rather than a 2-D nonlinear PDE. The corrector is precomputed and fixed rather than learned, and derivative/FLOP matching was not explicitly profiled. The signature tests trained-model behavior but does not establish the full theoretical approximation bound.

How to run: python3 bench_two_scale.py

Artifacts

Implementation overview ⬇ Download all as ZIP 6 files · code, reports and structured results