Unverified 2026

Positive Grassmannian subset head

Implementation & benchmark of arXiv:2607.19593 — Maximum Likelihood Estimation on the Grassmannian of Lines

Usefulness5/10
Difficulty6/10
Novelty6/10

Source paper: Maximum Likelihood Estimation on the Grassmannian of Lines arXiv:2607.19593 ⓘ · analyzed Aug 30, 2026

AI-generated research hypothesis, automatically tested. Not peer-reviewed.

Idea description

Replace independent logits for all d-subsets with a neural head that outputs a d-by-n matrix A and assigns subset weight x_I=det(A_{:,I}). After normalization, these minors define a probability distribution over subsets. The head imposes a strong algebraic coupling between subset probabilities, reducing parameters and potentially improving extrapolation to rarely observed subsets.

Formulas

$$\operatorname{Prob}(Z=I)=\frac{x_I}{\sum_{J\in\binom{[n]}{d}}x_J},\qquad I\in\binom{[n]}{d}.$$
$$\mathrm{Gr}(d,n)_{>0}=\left\{x\in\mathrm{Gr}(d,n)_{\mathbb R}:\operatorname{sgn}(x_I)>0\ \text{for all }I\subseteq[n],\ |I|=d\right\}.$$
$$x_I=\det(A_{:,I}),\qquad p_A(I)=\frac{\det(A_{:,I})}{Z(A)},\qquad Z(A)=\sum_{J\in\binom{[n]}{d}}\det(A_{:,J}).$$
$$\mathcal{L}(A)=-\sum_{I\in\binom{[n]}{d}}u_I\log p_A(I)=-\sum_Iu_I\log\det(A_{:,I})+\left(\sum_Iu_I\right)\log Z(A).$$

Mathematical statement

The paper defines a probability distribution on d-subsets I of [n] by Prob(Z=I)=x_I/(sum_{J in binom([n],d)} x_J), where x_I is the Plucker coordinate indexed by I. A real Grassmannian point x defines a valid positive distribution when all coordinates have the same positive sign; the positive Grassmannian is Gr(d,n)_{>0}={x in Gr(d,n)_R: sgn(x_I)>0 for every |I|=d}. For implementation, represent a Grassmannian point by a full-row-rank matrix A in R^{d x n}, set x_I=det(A_{:,I}), and require every maximal minor x_I>0. The resulting normalized model is p_A(I)=det(A_{:,I})/Z(A), with Z(A)=sum_{|J|=d}det(A_{:,J}). Here A_{:,I} is the d-by-d submatrix formed by columns in I. The determinant representation makes the coordinates decomposable rather than independent; the positivity condition guarantees nonnegative probabilities. Since A and GA represent the same Grassmannian point for any G in GL_d with positive determinant, fix a gauge or add mild column/norm regularization.

Implementation notes

Integrate this as the final subset-distribution head of a model that receives an input embedding h, such as a set encoder, graph neural network, or transformer. The head outputs A=f_theta(h) in R^{d x n}; column i corresponds to item i and each candidate output is a d-subset. For an MVP with n<=32 and d<=4, initialize A from a strictly totally-positive matrix A_{r,i}=exp((r-1)t_i) with t_1<...<t_n, or use this matrix plus small noise. Compute every candidate minor x_I=det(A[:,I]) for I in combinations(range(n),d). Penalize invalid signs with a barrier B(A)=-lambda sum_I log(clamp(x_I,epsilon)), compute Z=sum_I x_I, and set p_I=x_I/Z. Add a gauge penalty lambda_g||AA^T-I||_F^2 to reduce the GL_d parameter redundancy. Pseudocode is: A=f_theta(h); x={I:det(A[:,I]) for I in combinations(items,d)}; loss=-sum_I counts[I]*log(clamp(x[I],eps))/N + log(sum_I x[I]) + barrier + gauge; loss.backward(); optimizer.step(). The paper's probability formula supplies the normalization and the determinant formula supplies the structured coordinates; determinants and Z are computed exactly for small n. For larger n, estimate Z by sampled subsets and compare against exact enumeration on smaller instances. Benchmark against an unconstrained softmax over all subsets and a factorized-logit baseline on synthetic data generated from a positive Grassmannian model, then test a small multilabel graph or set-prediction task. Record validation NLL, calibration, rare-subset accuracy, parameter count, and runtime. Success is lower held-out NLL or better rare-subset prediction with O(dn) output parameters instead of O(binomial(n,d)) independent logits, while maintaining positive normalized probabilities.

Verification

This idea has not been verified yet.

Verification happens in two stages: Stage 1 — a mechanism check on a toy system confirms the claimed mathematical phenomenon reproduces; Stage 2 — a benchmark implements the idea on a real (small) neural network task and compares it against a tuned baseline over 8 paired seeds with a permutation test.

Artifacts

Artifacts unavailable.