Multiplicity-free Schur channel tying
Implementation & benchmark of arXiv:2608.02881 — Type $B$ fermionic coinvariant rings
Source paper: Type $B$ fermionic coinvariant rings arXiv:2608.02881 ⓘ · analyzed Aug 31, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Tie neural parameters across feature channels according to the Schur multiplicity pattern of the fermionic coinvariant representation. In the two-fermion case, use one learned parameter block for each Schur degree instead of independently parameterizing every ordered pair of fermionic channels, eliminating redundant copies while preserving the relevant GL2 channel symmetry.
Formulas
Mathematical statement
For two auxiliary grading variables u,v, the paper defines [r]_{u,v}=u^{r-1}+u^{r-2}v+...+v^{r-1} and uses s_(a,b)(u,v)=(uv)^b[a-b+1]_{u,v}. Its type-B two-fermion Hilbert series is a sum of single Schur polynomials: Hilb(R_Bn^(0,2);u,v)=sum over the stated bipartitions of binom(n,i)K_{lambda,(1^i)}K_{mu,(1^(n-i))}s_(n-ell-lambda_1,ell+lambda_2)(u,v). Here lambda and mu are partitions forming a bipartition of n, i=|lambda|, lambda=(lambda_1,lambda_2), mu=(2^ell,1^(n-lambda_1-lambda_2-2ell)), and K are Kostka numbers. Each Schur term is a single GL2 representation rather than an arbitrary multiplicity. The engineering interpretation is to parameterize channel mixing by Schur blocks indexed by (a,b), with basis dimension a-b+1, instead of using an independent matrix for every channel ordering.
Implementation notes
Apply this to a two-stream feature mixer, such as two views, two augmentation streams, two heads, or two fermionic feature channels. Let h^(1) and h^(2) have identical token dimensions. Instead of concatenating them and using a dense unconstrained projection, construct homogeneous monomials u^(a-t)v^(b+t) for each selected pair a>=b; represent the corresponding channel subspace W_(a,b) with a shared parameter matrix B_(a,b) applied identically to all t. Concretely, create q_(a,b)[t]=Mix(h^(1),h^(2)) projected to degree (a-t,b+t), stack q over t, and compute y_(a,b)[t]=sum_s B_(a,b)[t,s]q_(a,b)[s], with B shared across tokens and optionally constrained to commute with the GL2 action. Generate the polynomial basis recursively from the displayed [r]_(u,v) formula. For a small model, use degrees (1,0), (1,1), (2,0), and (2,1), retaining only blocks whose activation variance exceeds a threshold. For small n, compute Hilbert coefficients from the Kostka formula; for larger n, estimate graded feature ranks from activation covariance. Compare against an untied MLP mixer with equal FLOPs on two-view classification or signed-set regression. Success is a 20–40% reduction in mixer parameters and activation memory at equal accuracy, or higher accuracy at equal parameter count. Also test stream swapping: the tied model should degrade less than the untied baseline when the two inputs are exchanged.
Verification
This idea has not been verified yet.
Verification happens in two stages: Stage 1 — a mechanism check on a toy system confirms the claimed mathematical phenomenon reproduces; Stage 2 — a benchmark implements the idea on a real (small) neural network task and compares it against a tuned baseline over 8 paired seeds with a permutation test.
Artifacts
Artifacts unavailable.