Orthogonal transitivity projection for pairwise logits
Implementation & benchmark of arXiv:2608.25923 — Efficient tensor bases for pairwise comparisons
Source paper: Efficient tensor bases for pairwise comparisons arXiv:2608.25923 ⓘ · analyzed Aug 29, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Given arbitrary pairwise preference logits, project their skew-symmetric part onto the additive-consistent subspace before converting logits into probabilities or rankings. This removes cyclic inconsistency using the Frobenius-nearest consistent matrix, guaranteeing transitive pairwise predictions while preserving the closest possible signal under squared error.
Formulas
Mathematical statement
Let S=[s_{ij}] be an n by n skew-symmetric matrix, with Frobenius inner product <X,Y>=sum_{i,j} x_{ij}y_{ij}. The additive-consistent subspace A_n consists of matrices S_{ij}=u_i-u_j. The paper constructs an orthogonal basis B_1,...,B_{n-1} of A_n, so <B_k,B_l>=0 for k not equal to l. Theorem 6.3 gives the nearest Frobenius projection P_A S=sum_k <S,B_k>/<B_k,B_k> B_k. For a positive pairwise-ratio matrix M, Theorem 7.2 applies the same operation in log space: P_C M=exp(P_A(log M)). In the neural adaptation, Z is an unconstrained pairwise-logit tensor, S=(Z-Z^T)/2 is its skew-symmetric component, and S_hat=P_A S is fed to the pairwise loss. The projection is exact, differentiable, and removes every cycle component orthogonal to A_n.
Implementation notes
(1) Insert the layer after a network produces pairwise logits Z with shape [batch,n,n], and before Bradley-Terry, sigmoid, softmax, or ranking losses. First form S=(Z-Z.transpose(-1,-2))/2; optionally mask invalid pairs. Precompute basis matrices B[k] with shape [n-1,n,n], using the paper's orthogonal basis or an equivalent QR-orthogonalized basis spanning matrices u 1^T-1 u^T. (2) Compute denom[k]=(B[k]*B[k]).sum(), alpha[k]=(S*B[k]).sum((-1,-2))/denom[k], and S_hat=(alpha[...,k,None,None]*B[k]).sum(-3). Use loss=bce_with_logits(S_hat, pairwise_labels) and retain gradients through all operations. (3) The basis and projection coefficients are computed exactly from the linear-algebra formula; no spectrum or hyperparameter estimate is required. If ratios M are used instead of logits, compute L=log(clamp(M,eps)), project L, and return exp(L_hat). (4) Start with n=16 or n=32 synthetic Bradley-Terry data: draw true utilities u, label pairs from sigmoid(u_i-u_j), then flip 10%, 20%, and 30% of labels to inject inconsistent cycles. Compare an unconstrained pairwise head, projection only at inference, and projection during training. Report pairwise accuracy, ranking regret, held-out noisy-label loss, number of predicted 3-cycles, and gradient variance. The expected signal is fewer cycles and better noisy-data generalization at similar clean accuracy, with no measurable inference instability.
Verification
Stage 1 · Toy mechanism gate: Passed ✓
Stage 2 · Mechanism transferred to benchmark: Not tested
Stage 2 · Practical benchmark result: Not run
Methodology: Toy-system gate first; the benchmark stage runs only after a pass. How verification works
Stage 1 — Mechanism check agent confidence 8/10
Implemented differentiable Frobenius projection of skew pairwise logits onto the additive-consistent subspace, with numerical checks and matched noisy Bradley–Terry experiments. The math check passed at approximately 1e-15 error; training-time projection eliminated all 3-cycles, improved clean accuracy from 0.814 to 0.904, and reduced ranking regret from 0.101 to 0.027. It increased noisy-label BCE and CPU time, so the observed benefit is consistency and clean-ranking robustness rather than corrupted-label fit or speed.
- Agent confidence
- 8/10
- Baseline
- Mean over 6 runs: clean accuracy 0.8139, noisy BCE 0.1964, ranking regret 0.1011, 78.8 directed 3-cycles, 0.428 s/run.
- Idea
- Mean over 6 runs: clean accuracy 0.9042, noisy BCE 0.4569, ranking regret 0.0274, 0 directed 3-cycles, 0.642 s/run. Projection errors: idempotence 2.2e-16 and basis orthogonality 2.6e-15.
Limitations: Only n=16 synthetic Bradley–Terry data, two seeds per noise level, and 180 Adam steps were tested. No neural network backbone, held-out pair split, gradient-variance measurement, ratio-space implementation, masking pattern, or larger-scale runtime benchmark was evaluated.
How to run: python3 run_experiment.py
Verdict computed by deterministic test code from paired-seed statistics — not by the language model.
Artifacts
- report.md 1.4 KB View
- results.json 4.9 KB View Raw
- run_experiment.py 4.7 KB View Raw