Smooth-Plus-Boundary-Lifting Network
Implementation & benchmark of arXiv:2607.02312 — The structure of solution spaces for fractional-order operators, with gradient estimates
Source paper: The structure of solution spaces for fractional-order operators, with gradient estimates arXiv:2607.02312 ⓘ · analyzed Aug 30, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Represent the prediction as a sum of a smooth interior branch and a fractional boundary branch: u_theta(x)=u_int_theta(x)+d(x)^a u_bd_theta(x). This mirrors the paper's direct-sum solution structure and allocates separate network capacity to the globally regular component and the boundary layer.
Formulas
Mathematical statement
For forcing data of regularity s in [0,tau-2a), the paper describes the solution space as a direct sum of a full-regularity component H_q^(2a+s)(closure Omega) and a component d^a times a Poisson lifting of boundary values. Here 2a is the order of P, d(x)=dist(x,partial Omega), and tau describes boundary regularity. The proposed network uses u_int_theta to model the full-regularity component and d^a u_bd_theta to model the boundary-lifting component. The PDE residual trains their sum, while branch regularizers encourage u_int_theta to remain smooth and u_bd_theta to act primarily near the boundary.
Implementation notes
Use two coordinate networks with shared low-level features: N_int_theta(x) for the smooth branch and N_bd_theta(x) for the boundary quotient. Define u_theta(x)=N_int_theta(x)+d_delta(x)^a N_bd_theta(x), using a smoothed distance d_delta when needed, and set u_theta=0 outside the domain. At every training step, sample ordinary interior points X and oversample a boundary strip X_b={x:d(x)<rho}. Evaluate the combined solution, compute r=P[u_theta]-f, and minimize the PDE residual plus a branch regularizer. The exact paper ingredient is the direct-sum structure H_q^(2a+s) plus d^a times a lifting. In code, approximate smoothness with automatic-differentiation gradients evaluated on X, and approximate boundary-branch localization with m_b(x)=exp(-d(x)/rho). Use L_sep=mean(||nabla N_int||^2)+lambda_bd mean(m_b||d_delta^(1-a)nabla N_bd||^2)+lambda_far mean((1-m_b)N_bd^2). Initialize the interior branch with low-frequency Fourier features and the boundary branch with ordinary positional features. Test on a unit disk or square using manufactured solutions containing both a smooth term and d^a times a smooth term. Compare with a single unconstrained PINN and the single factored architecture, keeping parameter count and collocation budget fixed. Track total L2 error, boundary-strip error, residual convergence, and branch magnitudes away from the boundary. Success means lower boundary-layer error at equal parameter count without worsening interior accuracy.
Verification
This idea has not been verified yet.
Verification happens in two stages: Stage 1 — a mechanism check on a toy system confirms the claimed mathematical phenomenon reproduces; Stage 2 — a benchmark implements the idea on a real (small) neural network task and compares it against a tuned baseline over 8 paired seeds with a permutation test.
Artifacts
Artifacts unavailable.