# Glued Feature Fields

- ID: 2014
- Canonical URL: https://synthcore.org/idea/2014/glued-feature-fields
- API JSON: https://synthcore.org/api/idea/2014.json
- API Markdown: https://synthcore.org/api/idea/2014.md
- Verification status: unverified
- Source: [arXiv:2608.08811](https://arxiv.org/abs/2608.08811)
- Category: regularization
- Solves: accuracy, stability, generalization
- ML areas: graph-nn, embedding, regularization
- Math tags: geometry, topology, differential-geometry
- Ratings: usefulness 6/10; difficulty 5/10; novelty 6/10

## Idea description

Run local neural experts on overlapping subsets of an irregular support and impose the paper's restriction-and-extension condition on their outputs. Instead of averaging inconsistent local predictions, add an overlap compatibility loss and optionally compute a global feature by a least-squares extension, producing representations with no discontinuous seams between patches.

## Mathematical statement

The paper defines the support of the underlying measure as \(\tilde M:=\operatorname{supp}\tilde\rho\subset\mathscr F\), allowing \(\tilde M\) to be discrete or singular. For differential-form spaces \(\Omega^{s,m,\ell}(\tilde M)\), the restriction map to a measurable set \(A\subset\tilde M\) is denoted \(|_A\), and two sets \(A,B\) are \(\mathcal L\)-separating when \(\Omega^{s,m,\ell}(\tilde M)=\operatorname{span}(\ker|_A,\ker|_B)\) in equation (7.35). Lemma 7.11 states that if \(U\setminus V\) and \(V\setminus U\) are \(\mathcal L\)-separating, then local forms \(\eta_U\in\Omega^{s,m,\ell}(U\subset\tilde M)\) and \(\eta_V\in\Omega^{s,m,\ell}(V\subset\tilde M)\) satisfying \(\eta_U|_{U\cap V}=\eta_V|_{U\cap V}\) possess a global extension \(\eta\in\Omega^{s,m,\ell}(\tilde M)\) with \(\eta|_U=\eta_U\) and \(\eta|_V=\eta_V\). In the neural adaptation, \(R_A\) is the tensor restriction operator selecting features at points in \(A\), \(h_U\) and \(h_V\) are local expert outputs, and the overlap condition is approximated by \(R_{U\cap V}h_U=R_{U\cap V}h_V\). The separating condition is estimated empirically by checking whether the union of the two complement masks observes all feature coordinates; exact extension is replaced by a differentiable minimum-norm reconstruction.

## Key formulas

- $$\tilde M:=\operatorname{supp}\tilde\rho\subset\mathscr F$$
- $$\Omega^{s,m,\ell}(\tilde M)=\operatorname{span}\big(\ker|_{A},\ker|_{B}\big)$$
- $$\eta_U|_{U\cap V}=\eta_V|_{U\cap V}\quad\Longrightarrow\quad\exists\,\eta\in\Omega^{s,m,\ell}(\tilde M):\ \eta|_U=\eta_U,\ \eta|_V=\eta_V$$
- $$\mathcal L_{\mathrm{glue}}=\sum_{(U,V)}\frac{1}{|U\cap V|}\left\|R_{U\cap V}h_U-R_{U\cap V}h_V\right\|_2^2$$

## Implementation notes

1. Integration point: use this in a graph neural network or point-cloud encoder before the final classifier. Partition each input support \(\tilde M\) into overlapping neighborhoods \(U_1,\ldots,U_K\), for example k-nearest-neighbor balls or spatial windows. Each neighborhood is processed by the same local encoder \(f_\theta\), producing \(h_i=f_\theta(x_{U_i},\text{local edges})\in\mathbb R^{|U_i|\times d}\). Align each local output to global point indices with a restriction/scatter operator \(R_{U_i}\). 2. Pseudocode: `for each patch U_i: h_i = local_encoder(U_i); for each overlapping pair (i,j): delta_ij = R_{U_i\cap U_j}(h_i)-R_{U_i\cap U_j}(h_j); L_glue += mean(delta_ij**2); h_global[p] = mean_i R_{U_i}(h_i)[p]`; optimize `L_task + alpha*L_glue`. For a stronger extension version, construct the sparse incidence matrix \(C\) whose rows encode equality constraints between duplicate patch-point features, and compute \(h^*=\arg\min_h\sum_i\|R_{U_i}h-h_i\|_2^2+\beta\|h\|_2^2\) by 3--10 conjugate-gradient iterations. 3. The paper supplies the compatibility-to-extension principle; the network estimates overlap restrictions and does not need to symbolically compute \(\mathcal L\)-separation. Estimate coverage by requiring every point to occur in at least two patches and monitor the smallest singular value of the sampled constraint matrix \(C\); discard poorly connected patch pairs. 4. First experiment: use a 3-layer PointNet++ or GraphSAGE model on ModelNet40 and a synthetic classification task with randomly deleted points and nonuniform density. Compare ordinary global pooling, overlapping patch averaging, and the gluing loss/projection at equal parameter count and FLOPs. Measure clean accuracy, accuracy under point deletion, disagreement between two patches on the same point, and gradient variance. Success means lower overlap disagreement and improved corrupted-input accuracy without increasing inference cost by more than 20%; the projection variant should additionally remove visible patch-boundary artifacts.

## Disclaimer

AI-generated research hypothesis, automatically tested. Not peer-reviewed.