✓ Mechanism works 2026

Orthogonal transitivity projection for pairwise logits

Implementation & benchmark of arXiv:2608.25923 — Efficient tensor bases for pairwise comparisons

Usefulness6/10
Difficulty3/10
Novelty6/10

Source paper: Efficient tensor bases for pairwise comparisons arXiv:2608.25923 ⓘ · analyzed Aug 29, 2026

AI-generated research hypothesis, automatically tested. Not peer-reviewed.

Idea description

Given arbitrary pairwise preference logits, project their skew-symmetric part onto the additive-consistent subspace before converting logits into probabilities or rankings. This removes cyclic inconsistency using the Frobenius-nearest consistent matrix, guaranteeing transitive pairwise predictions while preserving the closest possible signal under squared error.

Formulas

$$\mathcal{P}_{\mathcal{A}}S=\sum_{k=1}^{n-1}\frac{\left\langle S,B_k\right\rangle}{\left\langle B_k,B_k\right\rangle}B_k$$
$$\mathcal{P}_{\mathcal{C}}M=\exp\left(\mathcal{P}_{\mathcal{A}}(\ln M)\right)=\exp\left(\sum_{k=1}^{n-1}\frac{(n-k+1)\left\langle\ln M,B_k\right\rangle}{2n(n-k)}B_k\right)$$
$$r_{ij}=\exp\left(\sum_{k=1}^{n-1}\frac{(n-k+1)b^{(k)}_{ij}}{2n(n-k)}\sum_{u,v=1}^{n}b^{(k)}_{uv}\ln m_{uv}\right)$$
$$S=\frac{Z-Z^T}{2},\qquad \widehat S=\sum_{k=1}^{n-1}\frac{\langle S,B_k\rangle}{\langle B_k,B_k\rangle}B_k$$

Mathematical statement

Let S=[s_{ij}] be an n by n skew-symmetric matrix, with Frobenius inner product <X,Y>=sum_{i,j} x_{ij}y_{ij}. The additive-consistent subspace A_n consists of matrices S_{ij}=u_i-u_j. The paper constructs an orthogonal basis B_1,...,B_{n-1} of A_n, so <B_k,B_l>=0 for k not equal to l. Theorem 6.3 gives the nearest Frobenius projection P_A S=sum_k <S,B_k>/<B_k,B_k> B_k. For a positive pairwise-ratio matrix M, Theorem 7.2 applies the same operation in log space: P_C M=exp(P_A(log M)). In the neural adaptation, Z is an unconstrained pairwise-logit tensor, S=(Z-Z^T)/2 is its skew-symmetric component, and S_hat=P_A S is fed to the pairwise loss. The projection is exact, differentiable, and removes every cycle component orthogonal to A_n.

Implementation notes

(1) Insert the layer after a network produces pairwise logits Z with shape [batch,n,n], and before Bradley-Terry, sigmoid, softmax, or ranking losses. First form S=(Z-Z.transpose(-1,-2))/2; optionally mask invalid pairs. Precompute basis matrices B[k] with shape [n-1,n,n], using the paper's orthogonal basis or an equivalent QR-orthogonalized basis spanning matrices u 1^T-1 u^T. (2) Compute denom[k]=(B[k]*B[k]).sum(), alpha[k]=(S*B[k]).sum((-1,-2))/denom[k], and S_hat=(alpha[...,k,None,None]*B[k]).sum(-3). Use loss=bce_with_logits(S_hat, pairwise_labels) and retain gradients through all operations. (3) The basis and projection coefficients are computed exactly from the linear-algebra formula; no spectrum or hyperparameter estimate is required. If ratios M are used instead of logits, compute L=log(clamp(M,eps)), project L, and return exp(L_hat). (4) Start with n=16 or n=32 synthetic Bradley-Terry data: draw true utilities u, label pairs from sigmoid(u_i-u_j), then flip 10%, 20%, and 30% of labels to inject inconsistent cycles. Compare an unconstrained pairwise head, projection only at inference, and projection during training. Report pairwise accuracy, ranking regret, held-out noisy-label loss, number of predicted 3-cycles, and gradient variance. The expected signal is fewer cycles and better noisy-data generalization at similar clean accuracy, with no measurable inference instability.

Verification

Mechanism works

Stage 1 · Toy mechanism gate: Passed ✓

Stage 2 · Mechanism transferred to benchmark: Not tested

Stage 2 · Practical benchmark result: Not run

Methodology: Toy-system gate first; the benchmark stage runs only after a pass. How verification works

Stage 1 — Mechanism check agent confidence 8/10

Implemented differentiable Frobenius projection of skew pairwise logits onto the additive-consistent subspace, with numerical checks and matched noisy Bradley–Terry experiments. The math check passed at approximately 1e-15 error; training-time projection eliminated all 3-cycles, improved clean accuracy from 0.814 to 0.904, and reduced ranking regret from 0.101 to 0.027. It increased noisy-label BCE and CPU time, so the observed benefit is consistency and clean-ranking robustness rather than corrupted-label fit or speed.

Agent confidence
8/10
Baseline
Mean over 6 runs: clean accuracy 0.8139, noisy BCE 0.1964, ranking regret 0.1011, 78.8 directed 3-cycles, 0.428 s/run.
Idea
Mean over 6 runs: clean accuracy 0.9042, noisy BCE 0.4569, ranking regret 0.0274, 0 directed 3-cycles, 0.642 s/run. Projection errors: idempotence 2.2e-16 and basis orthogonality 2.6e-15.

Limitations: Only n=16 synthetic Bradley–Terry data, two seeds per noise level, and 180 Adam steps were tested. No neural network backbone, held-out pair split, gradient-variance measurement, ratio-space implementation, masking pattern, or larger-scale runtime benchmark was evaluated.

How to run: python3 run_experiment.py

Verdict computed by deterministic test code from paired-seed statistics — not by the language model.

Artifacts

Implementation overview ⬇ Download all as ZIP 3 files · code, reports and structured results