{
 "artifacts": null,
 "category": "geometry",
 "description": "Replace unconstrained directed attention logits by observables that are one-sided 1-Lipschitz under a learned quasi-metric: an observable may increase from node j to node i by at most the directed cost from j to i, while the reverse direction can behave differently. Apply this constraint at several subsampled resolutions and penalize the Hausdorff mismatch between observable families of two augmented views, preserving directed structure while making attention stable under perturbations.",
 "formulas_latex": [
  "$$\\operatorname{Lip}^{+}_{1}(X)=\\{f:X\\to\\mathbb{R}: f(x)-f(y)\\le d_X(x,y)\\ \\text{for all }x,y\\in X\\}.$$",
  "$$H_S\\coloneqq\\left(d^{S}_{\\infty}\\right)_{H}(\\operatorname{Lip}^{+}_{1}(A)\\circ\\operatorname{pr}_{1},\\operatorname{Lip}^{+}_{1}(B)\\circ\\operatorname{pr}_{2}),\\qquad d^{S}_{\\infty}(f,g)=\\sup_{(a,b)\\in S}|f(a)-g(b)|.$$",
  "$$\\operatorname{dis}S\\leq 2H_S.$$",
  "$$\\mathcal L_{\\mathrm{pyr}}=\\sum_{r=1}^{R}\\left[\\frac{1}{|F_r|}\\sum_{f\\in F_r}\\min_{g\\in G_r}\\sup_{(i,j)\\in S_r}|f_i-g_j|+\\frac{1}{|G_r|}\\sum_{g\\in G_r}\\min_{f\\in F_r}\\sup_{(i,j)\\in S_r}|f_i-g_j|\\right].$$"
 ],
 "id": 1657,
 "implementation": "(1) Integration point: add this regularizer around the attention-logit construction in a graph Transformer or set Transformer. For a batch of nodes with embeddings z_i, define a directed quasi-metric q(i,j)=softplus(u(z_i,z_j)); do not symmetrize it. Let each attention head produce R scalar observables f_r(i), such as the pre-softmax query-key logit against a learned probe or a linear probe applied to the head output. (2) Pseudocode: compute q[i,j]. For every observable f and sampled ordered pair (i,j), add hinge=max(0, f[i]-f[j]-q[i,j]) to L_lip. Create two stochastic views A and B of the same graph or token sequence, with correspondence S={(i,j)} supplied by node identity or augmentation matching. At resolutions r, obtain observable sets F_r and G_r from the full batch and randomly pooled or subsampled nodes. Compute the bidirectional finite Hausdorff surrogate in the displayed formula and optimize L=L_task+lambda_lip*L_lip+lambda_pyr*L_pyr. (3) The mathematical quantities are the one-sided Lipschitz inequality, directed distortion surrogate, and multiscale Hausdorff matching; q, lambda_lip, lambda_pyr, and the number of probes are engineering choices. Estimate q with a low-rank pairwise scorer, and use sampled O(K^2) pairs rather than all pairs. (4) First experiment: train a 4-layer graph Transformer on ogbn-arxiv or a synthetic directed citation task, comparing ordinary attention, symmetric metric regularization, and this asymmetric regularizer at equal parameter count. Track validation accuracy, robustness after reversing or deleting 10% of directed edges, and attention-logit violation rate. Success is lower violation and improved perturbed-graph accuracy without degrading clean accuracy by more than 1%, plus smoother loss across random augmentations.",
 "math_summary": "For a quasi-metric d, define the one-sided Lipschitz class \\(\\operatorname{Lip}^{+}_{1}(X)=\\{f:X\\to\\mathbb{R}: f(x)-f(y)\\le d(x,y)\\ \\forall x,y\\in X\\}\\). The paper compares observable families on a coupling relation \\(S\\subset A\\times B\\) using \\(H_S=(d^{S}_{\\infty})_{H}(\\operatorname{Lip}^{+}_{1}(A)\\circ\\operatorname{pr}_{1},\\operatorname{Lip}^{+}_{1}(B)\\circ\\operatorname{pr}_{2})\\), where \\(d^{S}_{\\infty}(f,g)=\\sup_{(a,b)\\in S}|f(a)-g(b)|\\), \\((\\cdot)_H\\) is Hausdorff distance, and \\(\\operatorname{pr}_1,\\operatorname{pr}_2\\) are projections. The proof establishes \\(\\operatorname{dis}S\\le 2H_S\\), where \\(\\operatorname{dis}S=\\sup_{(a,b),(a',b')\\in S}|d_A(a,a')-d_B(b,b')|\\) is directed distortion. It also gives \\(d_{\\Pi}^{\\mathcal M}(\\mathcal P(X),\\mathcal P(Y))\\le d_{\\operatorname{conc}}(X,Y)\\), so the pyramid representation is nonexpansive under concentration distance. The adaptation uses the first inequality as a finite-batch consistency bound: matching one-sided attention observables controls mismatch in the underlying directed geometry.",
 "math_tags": [
  "metric-geometry",
  "functional-analysis",
  "topology",
  "optimization"
 ],
 "ml_areas": [
  "attention",
  "graph-nn",
  "regularization"
 ],
 "paper": {
  "arxiv_id": "2608.01145",
  "arxiv_url": "https://arxiv.org/abs/2608.01145",
  "summary_what_math_gives_to_ml": "The paper develops a compactification for asymmetric metric-measure spaces using one-sided Lipschitz observables, domination by measure-preserving nonexpansive maps, and multiscale lower sets called pyramids. Its most transferable asset is that directed geometry can be represented and compared through families of asymmetric observables without collapsing directionality via early symmetrization. This suggests a directed-attention or graph-neural module whose logits are constrained to be one-sided Lipschitz with respect to a learned quasi-metric, while matching observable families across augmentations or resolutions. The paper's explicit Hausdorff-distortion bound provides a practical stability loss for this representation.",
  "title": "Pyramidal Compactification of Asymmetric Metric Measure Spaces via Adjoint Transport",
  "year": "2026"
 },
 "ratings": {
  "difficulty": 5,
  "novelty": 7,
  "usefulness": 5
 },
 "solves": [
  "stability",
  "generalization",
  "accuracy"
 ],
 "title": "Pyramidal one-sided Lipschitz attention",
 "url": "https://synthcore.org/idea/1657/pyramidal-one-sided-lipschitz-attention",
 "verification": {
  "peer_reviewed": false,
  "status": "unverified",
  "status_label": "Unverified",
  "verdict_source": "deterministic test code (paired-seed permutation statistics)",
  "verification_axes": {
   "benchmark_mechanism": {
    "confirmed": null,
    "tested": false
   },
   "practical_benchmark": {
    "beats_baseline": null,
    "tested": false
   },
   "toy_mechanism_gate": {
    "confirmed": null,
    "tested": false
   }
  }
 }
}