Unverified
2026
Replace a uniformly sampled trajectory sequence by a binary temporal partition whose intervals are split only when the observed trajectory makes an excursion larger than a threshold. Encode one summary token per retained leaf, optionally including duration and endpoint displacement, so smooth trajectory regions receive fewer tokens while rapidly changing regions retain resolution.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Use a low-rank controller that observes and actuates only the graph's harmonic coordinates rather than all edge features. For a graph with first Betti number beta_1 = dim ker(B), a beta_1-dimensional cycle basis is sufficient to represent the entire harmonic sector, yielding a compact recurrent memory or adapter for circulation-dependent graph dynamics.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Replace top-k token pruning by greedy maximization of a diversity-aware monotone submodular utility under a spacing or coverage constraint. The selector repeatedly chooses the feasible token with the largest marginal utility, avoiding the redundant-token failure mode of independent score ranking while inheriting a constant-factor approximation guarantee under the stated 2-system abstraction.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Implement f(A)b inside a neural network with a short Lanczos recurrence instead of an eigendecomposition or dense matrix-function operation. Use an SPD operator A such as a regularized graph Laplacian or feature covariance matrix, and choose the number of iterations by monitoring successive approximations. For Stieltjes functions, Lanczos is guaranteed to be close to the best vector in the same Krylov subspace.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace an unconstrained spatial gate or interpolation kernel by a compactly supported function whose translates under a lattice exactly sum to one. Impose zero products between translates under a second lattice, so active gates do not collide; thresholding a positive superlevel set then provides a nonzero separation margin and predictable sparse computation.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Use an LKJ correlation factor as the correlation component of a variational posterior over a compact adapter, LoRA factor, or Bayesian neural-network parameter block. The model learns marginal scales separately while the correlation matrix remains automatically positive semidefinite and unit-diagonal, avoiding unconstrained covariance matrices, invalid correlations, and fragile covariance decompositions.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Replace globally backpropagated hidden-layer losses with independent recurrent layers that receive bottom-up, top-down, and lateral inputs. Train each layer to assign low activity to correctly paired input-label examples and high activity to mismatched examples, then classify by selecting the label with the lowest accumulated surprise.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace repeated full-dimensional matrix-exponential or ODE solves in a conditioned continuous-time state-space layer with contour quadrature evaluated in a projection basis. The same reduced basis and contour nodes can serve many conditioning vectors, while shifted reduced resolvents provide a stable and differentiable approximation over a prescribed time window.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Construct a recurrent module with a phase variable and a transverse memory coordinate modeled on a perturbed twist map. Train the transverse state to lie on an invariant graph over the phase, while the phase follows an approximately irrational rigid rotation. A KAM-inspired graph correction and residual penalty should reduce long-horizon drift in recurrent prediction.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Use enumerated weighing matrices as sparse orthogonal channel-mixing operators inside MLPs or residual blocks. Their ternary entries reduce multiplication to signed additions, while exact orthogonality prevents amplification or attenuation of feature norms; a trainable fixed-support version can recover expressivity without giving up computational sparsity.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Use the support graph of a sparse attention or routing mask as a feasibility object before applying normalization. Reject or minimally repair masks whose neighborhoods violate Hall's condition, ensuring that every selected query/key subset has enough reachable mass to support the desired marginals.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Represent a neural architecture as an undirected support graph and prune a matching of edges, so no two simultaneously removed edges share an endpoint. Use the paper's degree/connectivity theorem as a certificate that the pruned architecture retains k-edge-connectivity, preserving multiple routes between computational units instead of relying on unconstrained magnitude pruning.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace ordinary reverse-mode differentiation through a long sequence of stiff relaxation updates with a projected adjoint that separates slow conserved features from rapidly relaxing residual features. The neural layer can use large outer time steps even when its internal relaxation time is very small, while reconstructing only the microscopic gradient component required by the preceding layer.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Represent a neural-network weight tensor by rank-one terms whose mode factors are selected from shared orthonormal bases, and impose the same basis alignment across tensor flattenings. During or after training, retain the largest coefficients to obtain a structured truncation analogous to truncated SVD. This should produce better-conditioned tensorized layers than unconstrained CP factors while preserving a directly controllable accuracy/compute tradeoff.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Use a strictly upper-triangular block operator to represent interactions between ordered layers, experts, or token groups, and compute its inverse exactly with a finite Neumann series. Because nilpotency truncates the series after a known number of blocks, the module avoids an iterative solver while retaining controlled long-range interactions.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Use the paper's monotone allocation viewpoint to decide which parameters receive progressively more pruning, bit reduction, or update opportunities. A van der Corput order prevents a fixed early prefix of structured groups from being systematically over-pruned, while the logarithmic comb bound quantifies worst cumulative imbalance across nested groups.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Replace communicated floating-point gradients in synchronous federated or data-parallel training with one-bit threshold queries whose thresholds are sampled publicly before gradients are observed. Use several fixed geometric amplitude scales so the same protocol handles unknown gradient means and heavy-tailed client updates without an interactive localization round. Decode each coordinate from the scale whose neighboring estimates are statistically consistent, then apply the decoded aggregate…
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Replace heuristic magnitude pruning in a layerwise convex reconstruction problem with safe screening based on a perspective relaxation of the cardinality constraint. A channel is removed only when a lower bound for every solution containing that channel exceeds the loss of a feasible incumbent; conversely, a channel is forced to remain when every solution excluding it is provably worse.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace a learned sequence-mixing matrix with a structured lower-triangular Sprugnoli operator whose square is exactly the identity. Applying the same operator in reverse reconstructs activations exactly, so it can be used as a reversible Transformer mixer or reversible channel permutation while retaining nontrivial long-range mixing.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace a generic recurrent update by a positive-state continuous-time cell whose interactions are restricted to a quadratic zero-one reaction-network motif with three state variables and six reactions. Select a motif known to possess three positive equilibria, then use the two stable equilibria as binary memory states and the intervening unstable equilibrium as the separatrix. This creates an explicitly multistable RNN module with a bounded attractor count and a measurable stability…
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Build a neural feature-mixing block from a sparse exchange matrix and a fixed sequence of cluster-style mutations. Transpose-related channels share parameters through orbit tying, while positive multiplicative-additive updates are evaluated with log-sum-exp. The block is a concrete alternative to a dense MLP projection and can be tested at equal parameter count and compute.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Construct a symmetric token affinity matrix and approximate only its spectrally outlying token-mixing modes using a small set of sampled landmark columns. The resulting low-rank operator replaces an \(O(n^2)\) dense mixer by two skinny matrix multiplications, while the paper's residual guarantee predicts that large-magnitude global interaction modes are preserved.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Replace a learned nonnegative banded transition matrix by an ordered product of learnable stochastic bidiagonal factors. Each factor performs one local left or right transport step, so a product of p lower and q upper factors creates an effective bandwidth of p+q while retaining nonnegative entries, row sums equal to one, and a highly structured propagation kernel.
Useful6/10
Difficulty3/10
Novelty7/10
Unverified
2026
Replace unconstrained low-rank compression of a neural state with an augmented basis that always contains vectors representing known conserved quantities or diagnostically important linear statistics. After each learned transition, project the state back onto the affine constraint set with an exact minimum-norm correction, preventing rank truncation and model error from accumulating in those statistics.
Useful6/10
Difficulty5/10
Novelty6/10