△ Mechanism confirmed, baseline not beaten
2026
Compress a causal sequence by retaining history positions at equal increments of cumulative representation variation instead of at uniform time intervals. Use the resulting N representatives in a decoder that reconstructs piecewise-constant keys and values; the paper's minimax result predicts a worst-case reconstruction error of total variation divided by 2N, independent of where rapid changes occur.
Useful8/10
Difficulty5/10
Novelty6/10
△ Mechanism confirmed, baseline not beaten
2026
Replace token-by-token KV storage after an SSM or recurrent encoder with an online allocate-on-novelty cache. A new slot is created only when the incoming key is sufficiently dissimilar from every stored key; otherwise the incoming value is merged into its nearest slot, so repeated or redundant content does not grow the cache.
Useful8/10
Difficulty4/10
Novelty6/10
△ Mechanism confirmed, baseline not beaten
2026
Replace flat all-pairs attention with attention neighborhoods induced by a compatible tree over tokens, patches, nodes, or retrieved items. Retain exact or approximate attention inside nearby tree subtrees and add a path-monotonicity regularizer so semantically distant endpoints are not more similar than intervening tree neighbors.
Useful7/10
Difficulty5/10
Novelty6/10
✗ Failed on benchmark
2026
Insert a linear Johnson–Lindenstrauss bottleneck around a set of jointly processed representations, choosing its width from the sharp finite-set dimension bound rather than from the model's nominal hidden size. The projection should preserve pairwise distances between tokens, patches, or retrieved items, allowing a downstream attention or MLP block to operate at lower width while retaining the geometry relevant to similarity computations.
Useful7/10
Difficulty5/10
Novelty5/10
△ Mechanism confirmed, baseline not beaten
2026
Replace multiplicative query-key attention scores with an affinity based on the l1 distance between first-spike latency vectors. For each query token and key token, small latency differences produce large affinity and distant timings decay exponentially, yielding a locality-sensitive attention pattern naturally compatible with leaky spiking neurons.
Useful7/10
Difficulty5/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Represent a graph, set, or attributed network as a measurable Z-valued kernel and train on lifted representatives while explicitly minimizing over node couplings. The quotient objective is invariant to relabeling by construction, while the lifted loss gives a dense correspondence signal that can stabilize graph attention and relational encoders.
Useful7/10
Difficulty5/10
Novelty5/10
✓✓ Beats tuned baseline
2026
Replace dense token-to-token attention by a multiscale spiderweb communication pattern. Tokens first aggregate upward through a dyadic hierarchy, communicate horizontally only with a small number of cells at the appropriate height, and then receive information broadcast downward. Hyperbolic distance supplies a principled rule for choosing the height at which two tokens interact: nearby tokens interact at fine scales, while far-apart tokens interact through coarse representatives.
Useful7/10
Difficulty5/10
Novelty6/10
△ Mechanism confirmed, baseline not beaten
2026
Replace or augment dot-product attention with a non-increasing radial kernel of pairwise representation distance. The bandwidth is normalized using an estimated local intrinsic dimension and local neighbor scale, creating an explicit locality-controlled attention operator.
Useful7/10
Difficulty5/10
Novelty6/10
✓ Mechanism works
2026
Replace an unconstrained nonlinearity on hyperbolic pairwise similarities with a function from the paper's exact Lorentz–Gram preserver family. The transformed similarity matrix remains realizable as Lorentz inner products of future-directed unit timelike vectors, allowing a network to sharpen or smooth hyperbolic neighborhoods without introducing geometrically impossible pairwise relations.
Useful7/10
Difficulty5/10
Novelty7/10
Unverified
2026
Attach each token or graph node a learned scalar charge q_i and add a fractional stable kernel K_ij = exp(-tau D |q_i-q_j|^alpha) to the interaction mechanism. Constrain 0 < alpha <= 2, the exact range in which the kernel is positive semidefinite for arbitrary finite real charge sets, and optionally make tau layer-dependent to obtain multiscale interactions. This provides a principled alternative to unconstrained learned distance biases and can be used either as an attention-logit bias or as a…
Useful6/10
Difficulty4/10
Novelty5/10
Unverified
2026
Constrain a graph or token attention layer to behave like a row-stochastic diffusion with walk dimension \(\beta\), and choose its neighborhood radius from the paper's first-hitting-time tail bound. At propagation time \(t\), interactions with effective distance larger than \(r(t,\varepsilon)\) are removed because their total reachability probability is bounded by a prescribed error budget \(\varepsilon\).
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace Euclidean updates and interpolation of probability vectors in a mixture-of-experts router or attention simplex with updates in square-root coordinates, where the Fisher–Rao geometry is spherical. If the task has a desired neutral or calibrated family of distributions, represent that family as a linear subsphere in square-root space and project router outputs onto it after every update.
Useful6/10
Difficulty4/10
Novelty4/10
Unverified
2026
Use the number of tokens participating in an attention operation to adapt the projected query/key dimension according to the sharp Johnson–Lindenstrauss bound. Short attention windows receive a dimension limited by n-1, while longer windows use a logarithmic dimension, avoiding a fixed large head dimension when the current attention set contains too few points to require it.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Make Laplacian latency attention hardware-friendly by quantizing the exponential decay and row normalization to powers of two. Exponentials and divisions can then be implemented with lookup tables and integer shifts, enabling a low-bit attention kernel for neuromorphic and edge accelerators.
Useful6/10
Difficulty4/10
Novelty7/10
Unverified
2026
Replace a uniformly sampled trajectory sequence by a binary temporal partition whose intervals are split only when the observed trajectory makes an excursion larger than a threshold. Encode one summary token per retained leaf, optionally including duration and endpoint displacement, so smooth trajectory regions receive fewer tokens while rapidly changing regions retain resolution.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Compute each graph edge's Lin–Lu–Yau curvature exactly from one p=1/2 Wasserstein problem, then use the resulting scalar as an edge bias or multiplicative gate in graph attention. Positive-curvature edges receive stronger message exchange while negatively curved edges are attenuated, giving the network a geometry-derived inductive bias rather than requiring the model to learn all edge importance from scratch.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Build a refined Freudenthal-Kuhn simplicial graph over mesh vertices or geometric samples and inject its piecewise-linear metric into attention logits. Refinement is increased until the explicit distortion target is met, making attention scores less sensitive to arbitrary mesh resolution, triangulation, or local curvature.
Useful6/10
Difficulty6/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Replace a large graph-token set by a smaller set of connected wedge regions generated through adaptive two-seed shortest-path partitions. Each pooled token is the mean of the node features in its region, while the binary partition tree and region sizes are retained for unpooling or skip connections. This provides a deterministic, graph-aware alternative to arbitrary token merging that can be inserted before graph-transformer message passing.
Useful6/10
Difficulty5/10
Novelty6/10
✗ Failed on benchmark
2026
Replace coordinate-wise mean pooling of metric-valued items with a finite representation of their free integral. Each item x in a pointed metric space M is represented through evaluations of learned Lipschitz probes, and the pooled feature is the weighted integral of those probe values. A dual Lipschitz critic estimates the free-space norm of differences between pooled groups, making the representation sensitive to metric geometry while remaining permutation-invariant.
Useful6/10
Difficulty5/10
Novelty7/10
✗ Mechanism failed
2026
Add global directed-curvature features to every node in a graph neural network or directed graph transformer. The features distinguish how a node functions as a source versus a destination in the graph's asymmetric metric, potentially exposing bottlenecks, hubs, sinks, and structurally central nodes that local message passing cannot identify.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Replace dense attention on tree-structured inputs with stochastic attention neighborhoods formed by metric balls of sampled radii. Use the paper's exact trimming rule to ensure that every sampled cover remains valid while its total radius budget is bounded, then average predictions over several independent covers during training. This creates sparse, globally covering attention masks with an explicit locality-versus-coverage control.
Useful5/10
Difficulty6/10
Novelty8/10
Unverified
2026
Replace unconstrained directed attention logits by observables that are one-sided 1-Lipschitz under a learned quasi-metric: an observable may increase from node j to node i by at most the directed cost from j to i, while the reverse direction can behave differently. Apply this constraint at several subsampled resolutions and penalize the Hausdorff mismatch between observable families of two augmented views, preserving directed structure while making attention stable under perturbations.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Construct a nested sequence of representations in which each coarser representation is obtained from the previous one by a 1-Lipschitz projection. Train prediction heads at multiple scales so coarse predictions remain stable and approximately recoverable from the finer representation, enabling early exit, token pooling, and controlled multiresolution inference.
Useful5/10
Difficulty6/10
Novelty6/10
Unverified
2026
Construct a filtration from learned directed edge or transition weights, compute persistent path homology, and feed compact persistence features into a graph or sequence neural network. Because the paper proves stability under network-distance perturbations, these features should be less sensitive to small changes in edge scores than raw adjacency statistics, while retaining orientation-sensitive information that ordinary undirected topology loses.
Useful5/10
Difficulty7/10
Novelty6/10