Architecture ideas

Attention variants, state-space and recurrent cells, normalization and token-mixing schemes — each tested against the standard block it replaces.

✗ Mechanism failed 2026

Regret-aware evidential cost compression

Attach an evidential cost head to a neural graph model, representing each edge cost by a weighted set of interval boxes, and compress this representation before the downstream shortest-path or routing solver. Instead of minimizing Jaccard or Jousselme distance between the original and compressed mass functions, choose merges that minimize the induced cost error on the currently selected route, while enforcing a conservative monotonicity condition so that the resulting path regret is bounded.

Useful7/10
Difficulty5/10
Novelty8/10
Paper: Decision-Aware Approximation of Belief Functions for Evidential Combinatorial Optimization arXiv:2608.10650
Unverified 2026

Calibration-validated uncertainty-aware sparse routing

Replace a single plug-in top-k router decision with a confidence correspondence containing every router parameter candidate and sparse expert assignment that remains compatible with calibration and the current input. Project this set onto a hierarchy of expert groups and return the finest group-level decision supported by all surviving explanations; otherwise coarsen the route or abstain. Active endpoint bracketing evaluates only candidates that could still change the projected routing report.

Useful6/10
Difficulty6/10
Novelty7/10
Paper: Physical-Support Confidence Sets for Highly Coherent Dictionaries arXiv:2608.20295
Unverified 2026

Cycle-certified nonnegative rank-one attention

Represent a nonnegative attention or routing score matrix by two nonnegative vectors, X = uv^T, and learn only entries on a sparse bipartite graph of important query-key or token-expert interactions. Complete the remaining entries multiplicatively and monitor cycle residuals as a certificate of whether the sparse representation is compatible with rank one. Use local ratio violations to trigger additional edges or relax the rank-one approximation only where needed.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Tight Conic Relaxations for Rank-one Doubly Nonnegative Matrix Completion arXiv:2607.16796