Finite-Difference Conditional Neural Operator
Implementation & benchmark of arXiv:2608.11134 — Mastering Stochastic OLG Models in Continuous Time
Source paper: Mastering Stochastic OLG Models in Continuous Time arXiv:2608.11134 ⓘ · analyzed Sep 1, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Replace a tensor-product network over a low-dimensional state and a large distribution embedding with a neural operator that consumes the distribution vector once and outputs values on a finite-difference grid in the low-dimensional state. Train it with the governing PDE residual, explicit boundary residuals, and optional signed shape constraints, allowing the network to preserve numerical structure that a generic MLP would learn only implicitly.
Formulas
Mathematical statement
The paper formulates the target value function as V:X_1 imes X_2 o\mathbb{R}, where X_1\cong\mathbb{R}^{q_1} is the low-dimensional state, X_2\cong\mathbb{R}^{q_2} is a high-dimensional representation of a distribution, and q_2\gg q_1. The governing nonlinear first-order PDE is F(x_1,x_2,V,\partial_{x_1}V,\partial_{x_2}V)=0 on a domain E\subset X_1 imes X_2. Use a neural operator G_ heta(x_2) that outputs values at low-state grid points x_{1,j}; denote these outputs by v_j=G_ heta(x_2)_j\approx V(x_{1,j},x_2). For grid spacing h_i in coordinate i of x_1, approximate the derivative by the central finite difference D_i v_j=(v_{j+e_i}-v_{j-e_i})/(2h_i), with one-sided differences at boundaries. The trainable PDE residual is R_j=F(x_{1,j},x_2,v_j,D_1v_j,\ldots,D_{q_1}v_j,\widehat{\partial_{x_2}V}(x_{1,j},x_2)). Here \widehat{\partial_{x_2}V} can be obtained by automatic differentiation through the distribution encoder, or by directional finite differences. Add boundary residuals B_k(v,x_2)=0 and shape penalties P_j=\sum_{i\in S}[\max(0,-s_i(D_i v_j))]^2, where S is the set of constrained coordinates and s_i\in\{+1,-1\} is the known monotonicity direction. The objective is L( heta)=E[\frac{1}{|J|}\sum_j R_j^2+\lambda_B\frac{1}{|K|}\sum_k B_k^2+\lambda_S\frac{1}{|J|}\sum_jP_j].
Implementation notes
(1) Integration point: implement a conditional value-function module for an RL/world-model task or a solver for a known dynamic-programming PDE. Let x2 be a fixed-length vector such as a histogram, empirical-measure embedding, population statistic, or set-encoder output. Let x1 be q1<=4 continuous state coordinates with a rectangular grid of J points. Use an MLP or DeepSets encoder E_phi(x2), concatenate its embedding with a learned positional encoding of every x1 grid point, and decode all grid values v=G_theta(x2) in one forward pass. (2) Pseudocode: sample a batch of x2 and PDE parameters; compute v=G_theta(x2); reshape v to the x1 grid; compute central differences D_i v and one-sided boundary differences; compute x2 derivatives by autograd through x2, or estimate a coordinate r by [G_theta(x2+epsilon e_r)-G_theta(x2-epsilon e_r)]/(2 epsilon); evaluate R_j=F(x1_j,x2,v_j,Dv_j,dVdx2); add boundary loss and the signed shape penalty; backpropagate L and apply AdamW. (3) Compute from the paper's mathematics the finite-difference residual and explicit boundary and shape terms. Estimate grid spacings h_i, derivative step epsilon, PDE coefficients, and shape signs s_i from the task; do not learn them unless no prior is available. Use masked stencils near boundaries and normalize each residual term by its batch standard deviation. (4) First experiment: solve a two-dimensional HJB or Black-Scholes-style PDE whose coefficients depend on a 128-bin distribution vector, comparing a tensor-product MLP, a standard PINN, and this operator with matched parameter counts. Measure PDE residual, boundary error, held-out distribution generalization, and wall-clock time. The expected signal is lower residual and boundary violation at equal compute, with memory scaling approximately linearly in the low-state grid size rather than exponentially in q1+q2.
Verification
This idea has not been verified yet.
Verification happens in two stages: Stage 1 — a mechanism check on a toy system confirms the claimed mathematical phenomenon reproduces; Stage 2 — a benchmark implements the idea on a real (small) neural network task and compares it against a tuned baseline over 8 paired seeds with a permutation test.
Artifacts
Artifacts unavailable.