Unverified
2026
Replace a neural layer's dense parameters by a real parameter tensor and a binary activity mask, then update the mask using importance scores measured across multiple perturbation intervals. Gates that repeatedly occur in non-dominated accuracy–cost configurations receive larger scores and are more likely to be retained or activated, avoiding uniformly random sparse rewiring.
Useful5/10
Difficulty5/10
Novelty4/10
Unverified
2026
Replace an unconstrained order-k weight tensor with a sum of components that are symmetric only within selected contiguous index blocks. This preserves interactions between blocks while tying parameters under within-block permutations, providing a tunable middle ground between a fully dense tensor and a fully symmetric tensor.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Construct a sparse attention or message-passing mask by sampling edges with preferential weights (d_u+alpha)(d_v+alpha), while keeping the edge count below the predicted connectivity threshold. This creates hub-like local communication patterns but prevents one giant component from forcing dense information mixing, reducing attention cost and potentially mitigating oversmoothing.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Generate temporal attention or convolution weights with the Graham–Knuth–Patashnik recurrence instead of learning every lag weight independently. For nonnegative recurrence parameters, the resulting lag sequence is strongly log-concave, so its normalized kernel is naturally unimodal and suppresses high-frequency sign-free oscillations without requiring a separate smoothness penalty. The six parameters can be learned per head, channel group, or layer, giving O(1) learned parameters for an…
Useful5/10
Difficulty3/10
Novelty6/10
Unverified
2026
Use the paper's skew product as a parameter-free recurrent state: one phase rotates by an irrational increment and a second state accumulates a lacunary Fourier readout of that phase. This supplies deterministic long-range memory with only scalar updates, avoiding a learned recurrent transition matrix and its potentially unstable spectrum.
Useful5/10
Difficulty5/10
Novelty6/10
Unverified
2026
Represent a sparse higher-order attention head by a 3-uniform hypergraph whose hyperedge $(v,x,y)$ allows anchor token $v$ to aggregate a pairwise interaction between tokens $x$ and $y$. During mask construction, greedily reject edges that would create a $4$-cycle in the link graph $L(v)$, so the same pair of source tokens cannot reach an anchor through multiple redundant pairings. This produces a diversity-constrained sparse attention pattern with an explicit, measurable collision bound.
Useful5/10
Difficulty6/10
Novelty7/10
Unverified
2026
Represent a population of N circular latent states using a three-parameter Möbius transformation applied to fixed uniform reference phases, rather than learning N unrelated angles. The resulting states remain on the circle by construction and can model concentrated or nearly uniform phase populations through a single concentration parameter.
Useful5/10
Difficulty4/10
Novelty7/10
Unverified
2026
Construct a finite menu of experts or LoRA adapters by quantizing the oracle action manifold under a task-aware Fisher-information distortion rather than Euclidean parameter distance. The router can choose an installed expert after observing the input, but only k experts are stored or evaluated. The paper's frontier rate gives a falsifiable accuracy-versus-menu-size prediction.
Useful5/10
Difficulty6/10
Novelty4/10
Unverified
2026
Replace dense token-to-token attention with a learned composition of adjacent routing operators whose connectivity is stored as a non-crossing labelled arc diagram. Canonicalize the composed routing program using the Okada relations, then execute only the surviving sparse token paths.
Useful4/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace an unconstrained linear residual adapter by an operator \(T\) satisfying a polynomial relation in the commutator operator \(\Delta_A(X)=AX-XA\). Choose the polynomial roots in a stable half-plane so that repeated commutators become nilpotent, making repeated adapter application terminate algebraically and permitting a finite-polynomial inverse of \(I+T\).
Useful4/10
Difficulty6/10
Novelty9/10
Unverified
2026
Tie neural parameters across feature channels according to the Schur multiplicity pattern of the fermionic coinvariant representation. In the two-fermion case, use one learned parameter block for each Schur degree instead of independently parameterizing every ordered pair of fermionic channels, eliminating redundant copies while preserving the relevant GL2 channel symmetry.
Useful4/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace explicitly stored independent random positional features with deterministic multiplicative phase features generated from a small table of random phases indexed by primes. Restrict positions to integers whose prime factors exceed a slowly growing threshold, because the paper's central-limit result says periodic weighted sums over these rough integers recover Gaussian behavior despite strong multiplicative dependence.
Useful4/10
Difficulty5/10
Novelty9/10
Unverified
2026
Insert a fixed polynomial mixer before an MLP or retrieval index for tuples of discrete features. The mixer maps n+2 bounded scalar feature codes to one or several expanded scalar codes, and the paper's theorem guarantees that its image cannot collapse below order |A|^n when all coordinates come from a finite alphabet A. Use multiple independent permutations or coefficient choices to obtain a vector representation while retaining the deterministic algebraic structure.
Useful4/10
Difficulty4/10
Novelty7/10