# Conservative Flux Neural Operator

- ID: 2503
- Canonical URL: https://synthcore.org/idea/2503/conservative-flux-neural-operator
- API JSON: https://synthcore.org/api/idea/2503.json
- API Markdown: https://synthcore.org/api/idea/2503.md
- Verification status: beats_baseline
- Source: [arXiv:2608.18148](https://arxiv.org/abs/2608.18148)
- Category: architecture
- Solves: stability, accuracy, generalization
- ML areas: ssm, rnn, training-dynamics
- Math tags: pde, dynamical-systems, harmonic-analysis, linear-algebra, numerical-analysis
- Ratings: usefulness 8/10; difficulty 5/10; novelty 6/10

## Idea description

Replace pointwise prediction of the next field with prediction of a learned flux followed by a discrete divergence. Combine Fourier spatial mixing with a causal temporal kernel over the recent resolved-history slab, so the model learns finite-memory closure effects while preserving local conservation exactly under periodic or compatible boundary conditions. The architecture should reduce spurious mass drift and improve autoregressive rollout stability on coarse-grained PDE data.

## Mathematical statement

The source PDE has conservative form $u_t+\nabla\cdot F(u,\nabla u,\ldots)=0$, where $u(x,t)\in\mathbb{R}^{d_u}$ is the resolved field, $F$ is a flux tensor, and $\nabla\cdot$ is spatial divergence. Given resolved history $h_n(x,s)=u(x,t_n+s)$ for $s\in[-T_{\mathrm{in}},0]$, the neural operator predicts a flux $\widehat F_\theta[h_n](x)$ using spatial Fourier mixing and a causal temporal kernel that only accesses past times. The update is $\widehat u^{n+1}=\widehat u^n-\Delta t D_h\widehat F_\theta[h_n]$, where $D_h$ is a discrete divergence and $\Delta t$ is the rollout step. For a periodic conservative finite-volume discretization, $\sum_i(D_hF)_i=0$, so total mass is invariant independently of the learned flux. Causality prevents future-information leakage and makes the operator compatible with autoregressive deployment.

## Key formulas

- $$u_t+\nabla\cdot F(u,\nabla u,\nabla^2u,\ldots)=0.$$
- $$\widehat F_\theta[h_n](x)=\mathcal{F}^{-1}\!\left(M_\theta(k)\,\mathcal{F}[h_n](k)\right)(x)+\int_{-T_{\mathrm{in}}}^{0}K_\theta(x,\tau;h_n)h_n(x,\tau)\,d\tau.$$
- $$\widehat u^{n+1}=\widehat u^n-\Delta t D_h\widehat F_\theta[h_n],\qquad \sum_i(D_hF)_i=0\Longrightarrow\sum_i\widehat u_i^{n+1}=\sum_i\widehat u_i^n.$$
- $$\|\widehat u^{n+1}-u^{n+1}\|\leq\|\widehat u^n-u^n\|+\Delta t\|D_h\|\|\widehat F_\theta[h_n]-F[h_n]\|.$$

## Implementation notes

Use this as the one-step core of a Fourier neural operator, recurrent state-space model, or causal spatiotemporal predictor. Store the last $m$ resolved grids, with $m\Delta t=T_{\mathrm{in}}$. Encode the history, apply causal temporal attention or a depthwise temporal convolution over lags, apply Fourier spatial mixing, and output one flux component per spatial direction and physical channel. Compute the next state with a periodic finite-volume divergence instead of adding the network output directly to the field. Pseudocode is: `history = queue(u[t-m+1:t])`; `z = causal_temporal_mixer(history)`; `z = fourier_mixer(z)`; `flux = flux_head(z)`; `u_next = u - dt * divergence(flux)`. Train with next-step loss and optionally a multi-step rollout loss. Compute the divergence exactly; estimate network Jacobians, Fourier multipliers, and flux errors empirically. The first cheap experiment should use equal-size pointwise and flux-form FNOs on filtered one-dimensional viscous Burgers trajectories. Measure mass drift, rollout error, and empirical rollout Jacobian spectral radius over 100 to 500 steps. The prediction is that periodic flux-form mass drift remains at floating-point or discretization level, while the pointwise model accumulates drift. Error growth should become sharply worse near the empirical Jacobian spectral-radius boundary $\rho(J)\approx1$, with the flux model having a larger stable range of $\Delta t$.

## Verification

- Status: beats_baseline
- Mechanism evidence: yes
- Mechanism confirmed: no
- Practical verdict: helps
- Verdict: Built a causal temporal-plus-Fourier flux-form operator and compared it with an equal-size pointwise predictor on periodic Burgers data. All three mechanism predictions were confirmed: periodic divergence conserved mass to 3.6e-12 worst-case across grid sizes and amplitudes, pointwise mass drift scaled linearly with rollout steps exactly as predicted while flux drift was zero in the direct check, and the upwind spectral-radius boundary occurred at CFL=1. The learned flux model also improved 100-step rollout RMSE and reduced mass drift substantially, although this is a small toy experiment.

### Mechanism check

- Verdict: Built a causal temporal-plus-Fourier flux-form operator and compared it with an equal-size pointwise predictor on periodic Burgers data. All three mechanism predictions were confirmed: periodic divergence conserved mass to 3.6e-12 worst-case across grid sizes and amplitudes, pointwise mass drift scaled linearly with rollout steps exactly as predicted while flux drift was zero in the direct check, and the upwind spectral-radius boundary occurred at CFL=1. The learned flux model also improved 100-step rollout RMSE and reduced mass drift substantially, although this is a small toy experiment.
- Confidence: 9/10
- Limitations: Only a tiny 1D periodic Burgers setup was tested, with a short training run and one fixed seed. The stability boundary sweep is an analytic upwind-flux check rather than an empirical Jacobian spectral-radius sweep of the trained neural models; no 2D, nonperiodic, filtered multiscale, or multi-seed evaluation was performed.

### Practical benchmark

- Paired seeds: 8
- Baseline mean: 0
- Idea mean: 0
- p-value: 0.0081
- Paired wins: 8/8
- Benchmark verdict: idea better (significant)

## Artifacts

- [bench_flux.py](https://synthcore.org/code/898/bench_flux.py)
- [bench_report.json](https://synthcore.org/code/898/bench_report.json)
- [experiment.py](https://synthcore.org/code/898/experiment.py)
- [report.md](https://synthcore.org/code/898/report.md)
- [report_bench_2026-09-01T143516.md](https://synthcore.org/code/898/report_bench_2026-09-01T143516.md)
- [results.json](https://synthcore.org/code/898/results.json)
- [Download all files as ZIP](https://synthcore.org/download/898)

## Disclaimer

AI-generated research hypothesis, automatically tested. Not peer-reviewed.