# Entropy-Symmetrized Neural Flux

- ID: 682
- Canonical URL: https://synthcore.org/idea/682/entropy-symmetrized-neural-flux
- API JSON: https://synthcore.org/api/idea/682.json
- API Markdown: https://synthcore.org/api/idea/682.md
- Verification status: beats_baseline
- Source: [arXiv:2607.10364](https://arxiv.org/abs/2607.10364)
- Category: dynamics
- Solves: stability, accuracy, generalization
- ML areas: world-model, training-dynamics, ssm
- Math tags: pde, dynamical-systems, convex-analysis, linear-algebra, numerical-analysis
- Ratings: usefulness 8/10; difficulty 6/10; novelty 7/10

## Idea description

Replace an unconstrained neural flux Jacobian with a matrix of the form \(A(u)=H(u)^{-1}S(u)\), where \(S(u)\) is symmetric and \(H(u)\) is the positive-definite Hessian of a strictly convex entropy. Because \(A(u)\) is similar to a symmetric matrix, every characteristic speed is real. Reconstruct the flux by integrating this Jacobian along a fixed path from a reference state, and use the resulting module inside a differentiable finite-volume solver or learned dynamical model.

## Mathematical statement

For the conservation law \(\partial_t\mathbf{u}+\sum_i\partial_{x_i}f_i(\mathbf{u})=0\), the directional flux Jacobian is \(A(\mathbf{u};\mathbf{n})=\sum_i n_iA_i(\mathbf{u})\), where \(A_i(\mathbf{u})=\nabla_{\mathbf{u}}f_i(\mathbf{u})\), \(\mathbf{u}\in\mathcal{D}\subset\mathbb{R}^p\) is the conserved state, and \(\mathbf{n}\) is a unit spatial direction. Parameterize \(A(\mathbf{u})=H(\mathbf{u})^{-1}S(\mathbf{u})\), where \(S(\mathbf{u})=S(\mathbf{u})^\top\) is symmetric and \(H(\mathbf{u})=\nabla^2_{\mathbf{u}}\eta(\mathbf{u})\succ0\) is the Hessian of a strictly convex entropy \(\eta\). Then \(H^{1/2}AH^{-1/2}=H^{-1/2}SH^{-1/2}\) is symmetric, so \(A\) is diagonalizable with real eigenvalues. Reconstruct the flux along the straight path from reference state \(\mathbf{u}_0\) to \(\mathbf{u}\) using \(f(\mathbf{u})=f(\mathbf{u}_0)+\int_0^1A(\mathbf{u}_0+s(\mathbf{u}-\mathbf{u}_0))(\mathbf{u}-\mathbf{u}_0)\,ds\), where \(s\in[0,1]\) is the path parameter. Enforce positive definiteness in implementation with \(H=LL^\top+\varepsilon I\), where \(L\) is lower triangular and \(\varepsilon>0\).

## Key formulas

- $$\frac{\partial\mathbf{u}}{\partial t}+\sum_{i=1}^{d}\frac{\partial f_i(\mathbf{u})}{\partial x_i}=0,\qquad A_i(\mathbf{u})=\nabla_{\mathbf{u}}f_i(\mathbf{u}),\qquad A(\mathbf{u};\mathbf{n})=\sum_{i=1}^{d}n_iA_i(\mathbf{u}).$$
- $$A(\mathbf{u})=H(\mathbf{u})^{-1}S(\mathbf{u}),\qquad S(\mathbf{u})=S(\mathbf{u})^{\top},\qquad H(\mathbf{u})=\nabla^2_{\mathbf{u}}\eta(\mathbf{u})\succ0.$$
- $$H(\mathbf{u})^{1/2}A(\mathbf{u})H(\mathbf{u})^{-1/2}=H(\mathbf{u})^{-1/2}S(\mathbf{u})H(\mathbf{u})^{-1/2}=\left(H(\mathbf{u})^{-1/2}S(\mathbf{u})H(\mathbf{u})^{-1/2}\right)^{\top}.$$
- $$f(\mathbf{u})=f(\mathbf{u}_0)+\int_0^1A\!\left(\mathbf{u}_0+s(\mathbf{u}-\mathbf{u}_0)\right)(\mathbf{u}-\mathbf{u}_0)\,ds,\qquad H(\mathbf{u})=L(\mathbf{u})L(\mathbf{u})^{\top}+\varepsilon I.$$

## Implementation notes

(1) Integration point: use this module wherever a neural PDE or world model currently predicts a flux \(f_\theta(u)\) directly. For a state tensor with shape [batch, cells, p], construct one directional Jacobian per spatial direction, or begin with a one-dimensional system. The module predicts a symmetric matrix \(S_\theta(u)\) and a positive-definite entropy Hessian \(H_\phi(u)\). (2) Pseudocode: `u0 = reference_state`; `du = u-u0`; `flux = f0`; `for s,w in quadrature_nodes_weights: v=u0+s*du; S=0.5*(Snet(v)+Snet(v).T); L=CholeskyFactorNet(v); H=L@L.T+eps*I; A=solve(H,S); flux += w*(A@du)`; return `flux`. Use 4-8 Gauss-Legendre nodes on \([0,1]\). For each spatial direction, use the corresponding directional \(S\)-network or condition the network on the unit direction \(\mathbf{n}\). Feed the reconstructed flux into the existing finite-volume, finite-difference, or differentiable time integrator. (3) Mathematics versus estimation: the real-eigenvalue guarantee follows exactly from symmetry of \(S\) and positive definiteness of \(H\). Quadrature error, finite-precision conditioning, and the maximum wave speed are empirical quantities. Estimate the CFL speed from the symmetric proxy \(B=H^{-1/2}SH^{-1/2}\), using a symmetric eigensolver; set the time step to \(\Delta t\leq\mathrm{CFL}\,\Delta x/\max|\lambda(B)|\). Monitor the minimum eigenvalue of \(H\) and the imaginary part of direct eigenvalues of \(A\). (4) First cheap experiment: train a small learned three-state one-dimensional conservation-law model on random smooth initial conditions and Riemann problems. Compare a direct MLP flux, a spectral-normalized MLP flux, and the entropy-symmetrized flux at matched parameter count and FLOPs. Evaluate one-step flux error, long-horizon rollout error, energy growth, CFL violations, and solver crashes. A successful result should show no meaningful complex eigenvalues, fewer divergent rollouts, bounded energy, and lower trajectory error at long horizons. Then apply the same component to the M1 state \(u=(E,F_x,F_y)\), whose x-direction flux is \((F_x,P_{xx},P_{yx})\) and y-direction flux is \((F_y,P_{xy},P_{yy})\), testing discontinuous beam-crossing or shadow configurations.

## Verification

- Status: beats_baseline
- Mechanism evidence: yes
- Mechanism confirmed: yes
- Practical verdict: helps
- Verdict: Implemented the entropy-symmetrized flux MVP in experiment.py using symmetric S, Cholesky-parameterized H=LL^T+epsilon I, and Gauss-Legendre path integration. The similarity identity held numerically with zero observed imaginary eigenvalue parts through condition number 1e12, while antisymmetric contamination produced complex spectra at rates close to analytic predictions. The constrained model also achieved lower toy held-out flux MSE than the direct MLP, but no PDE rollout or long-horizon stability win was established.

### Mechanism check

- Verdict: Implemented the entropy-symmetrized flux MVP in experiment.py using symmetric S, Cholesky-parameterized H=LL^T+epsilon I, and Gauss-Legendre path integration. The similarity identity held numerically with zero observed imaginary eigenvalue parts through condition number 1e12, while antisymmetric contamination produced complex spectra at rates close to analytic predictions. The constrained model also achieved lower toy held-out flux MSE than the direct MLP, but no PDE rollout or long-horizon stability win was established.
- Confidence: 8/10
- Limitations: Only a small two-state flux-regression experiment was tested. Finite-volume integration, long-horizon rollouts, CFL behavior, Riemann problems, multidimensional directions, and repeated-seed statistical significance were not evaluated.

### Practical benchmark

- Paired seeds: 8
- Baseline mean: 0
- Idea mean: 0
- p-value: 0.0081
- Paired wins: 8/8
- Benchmark verdict: idea better (significant)

## Artifacts

- [REPORT.md](https://synthcore.org/code/129/REPORT.md)
- [bench_entropy_flux.py](https://synthcore.org/code/129/bench_entropy_flux.py)
- [bench_report.json](https://synthcore.org/code/129/bench_report.json)
- [experiment.py](https://synthcore.org/code/129/experiment.py)
- [report.md](https://synthcore.org/code/129/report.md)
- [report_bench_2026-09-02T160119.md](https://synthcore.org/code/129/report_bench_2026-09-02T160119.md)
- [results.json](https://synthcore.org/code/129/results.json)
- [Download all files as ZIP](https://synthcore.org/download/129)

## Disclaimer

AI-generated research hypothesis, automatically tested. Not peer-reviewed.