Unverified
2026
Use the paper's one-bit compressed-sensing lower bound to choose the number of binary latent measurements and to set a nonzero achievable-error floor during training. A sign bottleneck should not be given an unrealistically small bit budget: for approximately sparse latents, the target reconstruction error scales no faster than a power of effective sparsity divided by the number of sign measurements.
Useful5/10
Difficulty4/10
Novelty7/10
Unverified
2026
Add a topology-aware lower bound to point-cloud or graph token pruning: at each geometric scale, retain at least as many latent representatives as the persistent-homology rank between that scale and a larger scale. The method prevents the pruning module from collapsing independent connected components or cycles that remain persistent, while still allowing compression in topologically redundant regions.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Augment a graph neural network or graph transformer with counts of cyclic walks whose successive steps are required to be graph edges or graph non-edges according to a binary pattern. These features encode induced-subgraph structure that ordinary adjacency powers miss, and can be concatenated to the graph-level token or used as an auxiliary prediction target.
Useful5/10
Difficulty4/10
Novelty7/10
Unverified
2026
Replace step-by-step hidden-state storage in a latent ODE, state-space model, or world model with a polynomial trajectory represented independently on short time blocks. At the end of each block, pass the next hidden state by summing temporal coefficients, allowing training and inference to discard the completed block while retaining a mathematically exact block interface.
Useful5/10
Difficulty6/10
Novelty7/10
Unverified
2026
Augment pairwise attention on a set of n tokens with a rigidity operator derived from normalized pairwise directions. The operator couples infinitesimal node displacements through changes in pairwise distances, while the complete-graph theorem provides a geometry-independent eigenvalue target n/2 after spherical centering and normalization.
Useful5/10
Difficulty6/10
Novelty7/10
Unverified
2026
Use the paper's explicit tree support pattern as a cheap certificate that a sparse neural linear map contains a nearly singular submatrix. During mask construction or rewiring, penalize root-row-child configurations with many disjoint child branches, or increase overlap and row degree locally when such a configuration is detected. The goal is to prevent sparse MLP, projection, or MoE expert matrices from developing directions that are almost annihilated by the layer.
Useful5/10
Difficulty6/10
Novelty8/10
Unverified
2026
Replace an ordinary token aggregation step with a p-replica cyclic-equivariant block. Features are copied into p replicas, processed by shared operators, coupled through a cap-like bilinear interaction, and projected onto cyclic invariants. An auxiliary commutation loss enforces that applying the operator before or after the p-fold lift gives similar outputs.
Useful5/10
Difficulty5/10
Novelty8/10
Unverified
2026
Replace uniform set or point-cloud pooling with a microscopic weighting computed from pairwise feature-space distances. The resulting signed pooling vector should retain boundary and geometrically isolated points that ordinary mean pooling suppresses, potentially improving recognition when class information is concentrated on shape extremities or rare local configurations.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
For data with known hyperbolic or Möbius symmetries, constrain learned infinitesimal transformations to commute with the symmetry group generators. This produces a neural ODE, recurrent update, or hyperbolic embedding layer whose dynamics cannot arbitrarily break quotient-space symmetries, potentially improving extrapolation across symmetry-related examples.
Useful5/10
Difficulty5/10
Novelty5/10
Unverified
2026
Replace an unconstrained order-k weight tensor with a sum of components that are symmetric only within selected contiguous index blocks. This preserves interactions between blocks while tying parameters under within-block permutations, providing a tunable middle ground between a fully dense tensor and a fully symmetric tensor.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Use the logarithmic exhaustion as a geometry for bounded hidden representations rather than only as a parameter constraint. A representation approaching the boundary receives an increasingly large metric, making ordinary Euclidean motion expensive and discouraging brittle saturation while preserving a bounded intrinsic gradient for the boundary coordinate.
Useful5/10
Difficulty6/10
Novelty7/10
Unverified
2026
Treat each directed attention matrix as a graph transition matrix and form its Laplacian L = I - A. Compute the principal-cofactor vector to identify tokens with weak global access to the rest of the layer, and regularize the nonzero-eigenvalue product so attention does not become reducible or nearly singular. This targets pathological attention heads that isolate token groups and produce unstable or poorly propagated representations.
Useful5/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace ordinary dot-product attention logits with a strictly totally positive kernel evaluated on positive, ordered scalar coordinates attached to queries and keys. Use the modified-Bessel kernel K(x,s)=I_s(x), whose every ordered minor is positive, then row-normalize it as an attention matrix. This creates an attention operator with a mathematically enforced anti-oscillatory structure rather than merely positive entries.
Useful5/10
Difficulty6/10
Novelty8/10
Unverified
2026
Represent each matroid circuit as a structured hyperedge and perform message passing from circuit embeddings back to their constituent elements. Tie all circuit-update parameters that lie in the same automorphism orbit, so relabelings preserving the matroid produce exactly relabeled hidden states rather than requiring the network to learn this symmetry from data.
Useful5/10
Difficulty5/10
Novelty6/10
Unverified
2026
Add a Vandermonde conditioning objective to a mixture-of-experts router so that experts acquire distinct scalar routing signatures instead of collapsing onto the same score region. The regularizer uses powers of one learned scalar score and directly penalizes near-coincident expert scores, providing a finite-mode identifiability signal complementary to load balancing.
Useful5/10
Difficulty4/10
Novelty7/10
Unverified
2026
Estimate how often a representation lies on a separating hyperplane for alternative separable dichotomies, and use this quantity as a boundary-concentration penalty. Unlike a single classifier margin, the score measures whether many admissible separators consider the point ambiguous.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Use the Bernoulli corank asymptotic to choose sparsity for binary or sparse linear layers and reject initial matrices with excessive numerical rank deficiency. The layer should also explicitly prevent zero columns, because the paper's probability law indicates that zero-column events are a leading mechanism behind large corank in the sparse regime.
Useful5/10
Difficulty4/10
Novelty5/10
Unverified
2026
Prepend an adaptive Savitzky-Golay derivative bank to a temporal neural network. For each input channel and derivative order, select the local window by minimizing Stein's unbiased risk estimate, then concatenate the raw signal with the estimated derivatives. This supplies denoised velocity and acceleration features without requiring clean derivative targets or forcing the backbone to learn unstable finite-difference filters.
Useful5/10
Difficulty3/10
Novelty6/10
Unverified
2026
Represent entities, tokens, or graph nodes by learnable rays subject to orthogonality constraints on prescribed hypergraph contexts. In addition to enforcing orthogonality within each context, penalize distinct vertices that become collinear, because contextual orthogonality alone can permit or force geometric collapse. This creates a structured embedding layer for graph neural networks or context-aware attention.
Useful5/10
Difficulty5/10
Novelty6/10
Unverified
2026
Parameterize candidate eigenfunctions with a neural network, project them into a finite spectral trial space, and compute Ritz eigenvalues from the resulting Galerkin matrices. Train against the paper's rigorous lower-bound transform rather than trusting the raw Ritz values, producing a certificate that the predicted eigenvalues do not underestimate the exact eigenvalues under the projection-error assumptions.
Useful5/10
Difficulty5/10
Novelty8/10
Unverified
2026
Replace ordinary summation of several matrix-valued residual branches by a concave spectral aggregation: form the branch sum, take its absolute value, and apply a nonnegative concave function to singular values. The paper's transfer theorem predicts that the sharp Schatten-norm amplification constant is no worse than the corresponding linear Lee-type constant, while square-root, logarithmic, and capped maps suppress dominant singular directions.
Useful5/10
Difficulty6/10
Novelty8/10
Unverified
2026
Construct a block of gradient, preconditioned-gradient, or Hessian-vector-product directions without performing full-dimensional Gram-Schmidt. Use a random sketch to orthogonalize the block cheaply, then solve a small generalized eigenproblem using the true parameter-space overlap matrix so the extracted curvature modes are accurate for the generated subspace. Use the selected curvature modes to form a damped or trust-region optimizer step.
Useful5/10
Difficulty6/10
Novelty7/10
Unverified
2026
Add a norm-controlled feature mixer that applies a polynomial spectral filter to the channel covariance of a transformer or MLP block. A quadratic filter centered at \(\rho\) suppresses covariance eigenmodes far from the target and preserves modes near it, providing a tunable alternative to purely variance-maximizing mixing or standard normalization.
Useful5/10
Difficulty5/10
Novelty6/10
Unverified
2026
Add a spectral regularizer to a linear state-space or recurrent layer that controls the overlap between its controllable and observable state directions. The regularizer uses the paper's identity to monitor eigenvalues of (I+PQ)^{-1}, equivalently the squared canonical correlations between reachable and observable subspaces, and penalizes degenerate or overly concentrated spectra.
Useful5/10
Difficulty5/10
Novelty6/10