Young-Projected Tensor Channels
Implementation & benchmark of arXiv:2607.10662 — The Bernstein-Gelfand-Gelfand (BGG) Construction: Algebra, Geometry, and Analysis; Part I
Source paper: The Bernstein-Gelfand-Gelfand (BGG) Construction: Algebra, Geometry, and Analysis; Part I arXiv:2607.10662 ⓘ · analyzed Aug 30, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Decompose tensor-valued hidden states into invariant symmetric, alternating, and higher Young-symmetry channels before applying learned maps. This removes redundant tensor coordinates and prevents a neural layer from mixing incompatible representation types, yielding smaller equivariant modules with a cleaner inductive bias.
Formulas
Mathematical statement
The paper explicitly decomposes the tensor product of two covectors as R^{n*} tensor R^{n*} is isomorphic to S^2 R^{n*} direct sum Lambda^2 R^{n*}. The symmetric subspace S^2 R^{n*} and alternating subspace Lambda^2 R^{n*} are invariant under GL(n,R), and therefore under SL(n,R) and O(n). For a rank-two tensor X, the projectors are P_sym(X)=(X+X^T)/2 and P_alt(X)=(X-X^T)/2, with P_sym+P_alt=I and P_sym P_alt=0. The BGG construction generalizes this principle by selecting irreducible components h_{k,l} inside spaces of differential forms with representation-valued coefficients. The neural adaptation is to parameterize separate maps on these projected channels instead of learning on the full tensor product.
Implementation notes
Integrate this into the first tensor-valued hidden block of an O(n)-aware geometric network, tensor MLP, graph neural network, or geometric transformer. For every rank-two feature X with shape batch by nodes by n by n by channels, compute the symmetric projection X_s=(X+transpose(X))/2 and alternating projection X_a=(X-transpose(X))/2 along the two geometric indices. Apply independent channel-mixing maps f_s and f_a, then reconstruct Y=f_s(X_s)+f_a(X_a). Do not feed the raw tensor to the learned map in the main condition; this tests whether representation separation itself provides the benefit. For rank-three features, implement antisymmetrization by summing signed permutations and setting components with repeated indices to zero, following the wedge-product rule. A compact variant retains only symmetric and alternating channels and uses a learned scalar gate g, with Y=g f_s(X_s)+(1-g) f_a(X_a). The mathematical quantities are computed exactly; no eigenvalues or representation multiplicities need to be estimated for the rank-two test. Validate equivariance by drawing random orthogonal matrices Q and checking that F(Q X Q-transpose) is close to Q F(X) Q-transpose. Start on a small 2-D or 3-D elasticity dataset with a tensor MLP or message-passing baseline matched for parameter count. Measure validation error, equivariance error, parameter count, and activation memory. Success is lower error at equal parameters or at least 30 percent fewer tensor parameters at unchanged error, with no increase in equivariance residual.
Verification
This idea has not been verified yet.
Verification happens in two stages: Stage 1 — a mechanism check on a toy system confirms the claimed mathematical phenomenon reproduces; Stage 2 — a benchmark implements the idea on a real (small) neural network task and compares it against a tuned baseline over 8 paired seeds with a permutation test.
Artifacts
Artifacts unavailable.