# Power-Preserving Formation GNN

- ID: 3165
- Canonical URL: https://synthcore.org/idea/3165/power-preserving-formation-gnn
- API JSON: https://synthcore.org/api/idea/3165.json
- API Markdown: https://synthcore.org/api/idea/3165.md
- Verification status: unverified
- Source: [arXiv:2609.04158](https://arxiv.org/abs/2609.04158)
- Category: dynamics
- Solves: stability, accuracy
- ML areas: graph-nn, training-dynamics, optimizer
- Math tags: control-theory, dynamical-systems, graph-theory, optimization, linear-algebra
- Ratings: usefulness 8/10; difficulty 5/10; novelty 6/10

## Idea description

Replace an unconstrained graph-message-passing block with a port-Hamiltonian layer whose edge interactions are generated by a skew-symmetric formation-matrix coupling and whose node damping is positive semidefinite. The layer can model relative graph structure while preventing unforced hidden-state energy growth, reducing exploding activations and oversmoothing caused by arbitrary repeated propagation.

## Mathematical statement

For node state $r\in\mathbb{R}^{2n}$ and edge force vector $f\in\mathbb{R}^{m}$, the paper introduces a formation matrix $\mathcal{F}(r)$ that maps node velocities to edge velocities, $\zeta=\mathcal{F}(r)\dot r$. Its interconnection subsystem uses the skew-symmetric matrix $\begin{bmatrix}0&-\mathcal{F}(r)^T\\\mathcal{F}(r)&0\end{bmatrix}$, implying the power identity $\zeta^Tf+\dot r^T\dot p=0$. A port-Hamiltonian neural layer should use $\dot h=[J(h)-R(h)]\nabla H(h)$, where $h$ is the concatenated node hidden state, $J(h)^T=-J(h)$ is the graph interconnection, $R(h)\succeq0$ is damping, and $H(h)\geq0$ is the learned energy. Then $\dot H=-\nabla H^TR\nabla H\leq0$ in the absence of external input. For a quadratic energy $H(h)=\frac12h^TM^{-1}h$, $M\succ0$, choosing $J$ from edge incidence or formation operators and $R=L_RL_R^T$ gives a computable stability certificate.

## Key formulas

- $$\begin{bmatrix}\dot r\\\dot f\end{bmatrix}=\begin{bmatrix}0&-\mathcal{F}(r)^T\\\mathcal{F}(r)&0\end{bmatrix}\begin{bmatrix}\dot r\\f\end{bmatrix}+\begin{bmatrix}\nu\\0\end{bmatrix},\qquad \zeta=\mathcal{F}(r)\dot r$$
- $$\zeta^Tf+\dot r^T\dot p=0$$
- $$\dot h=[J(h)-R(h)]\nabla H(h),\quad J^T=-J,\quad R\succeq0,\qquad \dot H=-\nabla H(h)^TR(h)\nabla H(h)\leq0$$
- $$h_{k+1}=h_k+\Delta t\,[J(h_k)-R(h_k)]\nabla H(h_k),\qquad \Delta t<\frac{2}{\lambda_{\max}(M^{-1/2}RM^{-1/2})}$$

## Implementation notes

Integrate this as a replacement for one or more residual message-passing blocks in a graph neural network. Let each node carry hidden state $h_i\in\mathbb{R}^d$ and let each graph edge $(i,j)$ carry an edge state or force $f_{ij}$. Build a learned formation operator $F_\theta(h)$ from relative node features, with one row per edge; its action can approximate edge differences, for example $F_\theta h=\{W_e(h_i-h_j)\}_e$. Construct the node-edge interconnection explicitly as $J_F=\begin{bmatrix}0&-F_\theta^T\\F_\theta&0\end{bmatrix}$, which is skew-symmetric by construction. Use energy $H_\theta(h)=\frac12h^TM_\theta^{-1}h+\sum_e\psi_{e,\theta}(f_e)$ with diagonal positive masses parameterized by softplus, and parameterize damping as $R_\theta=L_\theta L_\theta^T$ rather than learning an unrestricted matrix. The update is: compute $F$ from edges; compute $g=\nabla H$; compute $v=(J_F-R)g$; update $h\leftarrow h+\Delta t v$. Estimate $\lambda_{\max}$ by 5-10 power iterations and clip or adapt $\Delta t$ below $2/\lambda_{\max}(M^{-1/2}RM^{-1/2})$. The paper supplies the power-preserving interconnection and energy argument; the neural energy, edge feature map, and damping factors are learned. First test on Cora or a synthetic spring-graph node-classification task with 20-50 repeated layers, comparing an unconstrained GNN, an antisymmetric GNN, and this layer. Measure hidden energy $H_k$, gradient norms, accuracy, and failure rate while sweeping $\Delta t$. The prediction is that the unforced layer has non-increasing energy up to numerical error, and instability should appear near the predicted explicit-Euler boundary $\Delta t_c\approx2/\lambda_{\max}(M^{-1/2}RM^{-1/2})$; measured divergence should occur within 20% of this value, while the skew-only variant should show bounded but non-decaying energy.

## Disclaimer

AI-generated research hypothesis, automatically tested. Not peer-reviewed.