# Energy-Preserving Hill Packet Layer

- ID: 2600
- Canonical URL: https://synthcore.org/idea/2600/energy-preserving-hill-packet-layer
- API JSON: https://synthcore.org/api/idea/2600.json
- API Markdown: https://synthcore.org/api/idea/2600.md
- Verification status: unverified
- Source: [arXiv:2608.20068](https://arxiv.org/abs/2608.20068)
- Category: architecture
- Solves: stability, accuracy, scalability
- ML areas: neural-operator, pde, initialization, regularization
- Math tags: pde, functional-analysis, geometry, harmonic-analysis
- Ratings: usefulness 6/10; difficulty 5/10; novelty 8/10

## Idea description

Augment a neural field or neural operator with a bank of localized, divergence-free moving packets whose radius and amplitude follow the Hill scaling rather than ordinary Gaussian scaling. The packet coefficients can represent unresolved flow corrections while keeping their L^2 contribution approximately invariant under refinement, preventing fine-scale features from becoming numerically negligible or explosively large.

## Mathematical statement

The paper defines a rotated Hill vortex H_e, where e is the translation direction, and rescales it as H_{R,e}(x)=R^{-1}H_e(x/R^{2/3}); R>0 is the packet scale parameter, R^{2/3} is the core radius, and R^{-1} is the velocity amplitude. For 1<q<=infinity and 1<=p<=infinity, the paper gives ||H_{R,e}||_{L^q} <= C_q R^{2/q-1} and ||nabla H_{R,e}||_{L^p} <= C_p R^{2/p-5/3}. Thus ||H_{R,e}||_{L^2} and ||nabla H_{R,e}||_{L^{6/5}} are scale invariant because 2/2-1=0 and 2/(6/5)-5/3=0. For p>6/5, ||nabla H_{R,e}||_{L^p}=R^{-theta(p)}||nabla H_e||_{L^p}, with theta(p)=5/3-2/p>0. The ML adaptation uses a numerically tabulated divergence-free base packet h_e, obtained as the curl of a compactly supported vector potential and normalized to ||h_e||_2=1; exact Hill-vortex dynamics are not required for the representation.

## Key formulas

- $$H_{R,e}(x):=R^{-1}H_e\!\left(\frac{x}{R^{2/3}}\right),\qquad P_{R,e}(x):=R^{-2}P_e\!\left(\frac{x}{R^{2/3}}\right).$$
- $$\|H_{R,e}\|_{L^{q}}\lesssim_q R^{\frac{2}{q}-1},\qquad\|\nabla H_{R,e}\|_{L^{p}}\lesssim_p R^{\frac{2}{p}-\frac{5}{3}}.$$
- $$\|\nabla H_{R,e}\|_{L^{p}}=R^{-\theta(p)}\|\nabla H_e\|_{L^{p}},\qquad\theta(p):=\frac{5}{3}-\frac{2}{p}>0.$$
- $$\widetilde h_{R,e}(x;c)=c\,R^{-1}h_e\!\left(\frac{x-c}{R^{2/3}}\right),\qquad \nabla\!\cdot h_e=0.$$

## Implementation notes

Integrate this at the output of a neural operator or continuous neural field that predicts a velocity correction u_theta(x,t), before the final pressure/projection step. First create a periodic base packet h_e on a fine grid: choose a compactly supported smooth vector potential A_e, set h_e=curl(A_e), rotate it for a small set of directions e, and normalize each template by its discrete L2 norm. The packet layer receives coefficients a_j, centers c_j, directions e_j, and log-scales s_j from a small MLP. Set R_j=softplus(s_j)+epsilon and evaluate p_j(x)=a_j R_j^{-1} h_{e_j}((x-c_j)/R_j^{2/3}) using periodic wrapped coordinates; sum u_packet=sum_j p_j and add it to the backbone field. Use 8-32 packets per sample, with centers either predicted or selected from high-residual regions. In pseudocode: compute (a_j,c_j,e_j,s_j)=g_theta(z); R_j=softplus(s_j); p_j=a_j/R_j*h[e_j]((x-c_j)/R_j^(2/3)); u=u_backbone+sum_j p_j. The scaling exponents come from the paper; packet norms and overlap constants are estimated empirically on the grid. Add a weak penalty on divergence and an optional coefficient penalty sum_j a_j^2, but do not penalize R_j using ordinary amplitude regularization because the intended L2 scale is invariant. First test on 2D or 3D periodic Navier-Stokes prediction at 64^3, comparing a standard Fourier neural operator against the same model with 16 packets. Measure rollout energy drift, divergence error, validation vorticity error, and performance when training data are generated at 32^3 and evaluated at 64^3. Success is lower fine-scale error and stable energy across resolutions without a substantial increase in FLOPs.

## Disclaimer

AI-generated research hypothesis, automatically tested. Not peer-reviewed.