Unverified
2026
Use BB1 for inexpensive curvature adaptation, but monitor the projective gradient state for the periodic behavior identified in the paper. When the normalized gradient and scalar step size approximately repeat after seven iterations, temporarily switch to BB2 or a damped gradient step to destroy the attracting cycle, then return to BB1.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Build a low-dimensional basis for the principal module generated by the all-ones vector, then perform adjacency and degree propagation in compressed coordinates. On forests, the paper states that this module equals the automorphism-orbit module, so the reduced representation can preserve principal adjacency-degree information while using far fewer coordinates than the number of vertices.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Augment a graph neural network with features generated by noncommutative words in the adjacency matrix and diagonal degree matrix. Ordered patterns such as AD^2A and DADA distinguish where degree information occurs along a walk; the paper proves that the full scalar moment family determines every tree.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Construct a sparse routing or graph-neural architecture whose activation gates satisfy a hard-core constraint: neighboring sites, experts, or token groups cannot be active simultaneously. Compare the same local routing rule on bipartite and random regular interaction graphs; the graph structure should change the maximum usable activation dimension and may also change optimization stability.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Model each expert as a cell with occupancy q_i, vacancy n_i = 1 − q_i, and a nonzero localization floor Δ_i. Add a free-volume potential whose derivative becomes strong when an expert is poorly utilized, but remains finite because of Δ_i. Unlike ordinary entropy balancing, this mechanism predicts a quantitative inverse-vacancy regime and a measurable crossover to saturation.
Useful6/10
Difficulty4/10
Novelty5/10
Unverified
2026
Replace ordinary graph propagation, which repeatedly revisits the edge it just traversed, with a directed-edge non-backtracking operator. Normalize its learned gain using an estimate of the Hashimoto spectral radius so that feature magnitudes neither explode on high-growth graphs nor vanish on sparse graphs.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
When training a neural state-space model, SSM, or recurrent world model from trajectories, constrain the data-generation policy or augmentation process to satisfy both a Hankel-rank condition and a task-weighted frequency-coverage condition. The rank condition prevents unidentifiable dynamics, while the frequency condition concentrates samples at frequencies that affect the target prediction horizon, tracking objective, or closed-loop controller instead of merely producing broadband-looking…
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace occasional gradient updates in a neural-network optimizer with a Gaussian-smoothed cubic-regularization step estimated entirely from loss evaluations. The cubic term stabilizes steps under uncertain curvature, while the Goldstein neighborhood interpretation makes the method robust to discontinuous or rapidly varying Hessians and gives it an explicit negative-curvature escape mechanism.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Augment each recurrent channel, feature group, or state-space stream with a latent phase oscillator and allow cross-stream coupling only when the receiving oscillator lies inside a learned or fixed phase window. The window suppresses destructive mixing outside the relevant dynamical regime while retaining Kuramoto-style attraction during the active interval, potentially improving long-horizon coherence without forcing all hidden states to synchronize continuously.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Add a shallow neural interpolation controller to a neural ODE or state-space model so one shared vector field matches prescribed derivatives at several anchor trajectories. At every control time, compute controller weights from a small linear system instead of learning all task-specific parameters by backpropagation.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Give each query-token pair a positive adaptive edge weight that evolves by a multiplicative rule instead of relying only on instantaneous dot-product attention logits. Edges whose aggregate interaction is useful can grow, while overloaded or incompatible neighborhoods can shrink. Sparse initialization is preserved because an edge initialized at zero remains zero under the multiplicative dynamics.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Add a learned scalar ordering to a directed graph attention layer and retain only forward edges, producing a DAG attention mask without requiring a supplied topological order. Train the ordering with a differentiable surrogate for weighted surplus, and regularize it toward the paper's explicit half-weight-minus-l2 certificate. This supplies a principled alternative to random masking or unconstrained bidirectional graph attention when causal or hierarchical information flow is desirable.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Use the conjugate degree sequence of codimension-one faces as a mathematically justified upper envelope for the spectrum of a simplicial up-Laplacian. Penalize violations of the corresponding top-k eigenvalue budgets in a simplicial message-passing layer, discouraging a few dominant propagation modes that cause oversmoothing or unstable amplification.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace a generic recurrent transition with a finite spectral approximation of the paper's augmented generator: one state block represents ordinary latent dynamics and another represents delayed or refractory history. Inject the input through two learned channels, analogous to bulk forcing and boundary-condition forcing, so the model can represent abrupt events and delayed consequences without requiring a large delay buffer. Parameterize selected mode pairs as stable real Jordan blocks or…
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Use the paper's correspondence between KAN splines and finite-element or isogeometric shape functions to build coordinate-separable tensor-product trial layers. Replace additive coordinate aggregation with a multiplicative contraction of one-dimensional spline expansions, yielding an explicit tensor-product basis without storing a dense multidimensional grid.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace a conventional softmax router or fixed halting score with a scalar confidence state that evolves as a bounded martingale diffusion. The state starts at the network's prior confidence, receives evidence-dependent stochastic increments, and is absorbed at 0 or 1; absorption selects an MoE expert or halts additional transformer blocks. State-dependent volatility lets the model explore aggressively when uncertain and commit rapidly when confident, while the martingale constraint prevents…
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace an explicit MoE router or constrained output head with the solution of a variational inequality over a convex feasible set. The neural operator can be nonmonotone, but training should enforce a measurable strong-pseudomonotonicity margin so the selected route or control is unique and has bounded sensitivity to changes in the token representation. Use an explicit projection residual for approximate solving and for monitoring whether the implicit layer has actually converged.
Useful6/10
Difficulty6/10
Novelty5/10
Unverified
2026
Replace fixed sequence-to-sequence attention with a dynamically maintained tree of connected token groups. Groups can be fused to reduce the number of attention units or split when their representation is heterogeneous, while hypergraph connectivity and nestedness ensure that every intermediate hierarchy remains valid.
Useful6/10
Difficulty6/10
Novelty5/10
Unverified
2026
Replace unconstrained MoE router logits with structured phase scores indexed by N-subsets of M ordered parameters. Each token is assigned to the dominant phase, while neighboring routing regions obey the Grassmannian rule that adjacent labels share N-1 indices, reducing arbitrary fragmented decision boundaries and encouraging smooth expert transitions.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Augment every graph or set token with a positive learned mass M_i that controls how strongly it contributes to other nodes and evolves through a growth-minus-inhibition equation. Use separate learned interaction kernels for state transport and mass inhibition, while retaining a directed interaction matrix so the layer is not forced to be permutation-symmetric or conservative.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace a dense tensor-product positional encoding or first MLP layer with a hierarchical sparse-grid B-spline feature map. The network evaluates only localized basis functions indexed by multi-levels with bounded total level, reducing feature count while retaining high-order approximation for functions with mixed derivative regularity. The basis can initially be fixed and later fine-tuned jointly with the downstream network.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Compress a dense neural-network weight tensor with mode-wise selected fibers and a small sampled core, then convert the result into a Tucker layer for efficient execution. Select indices greedily using reconstruction residuals rather than random sampling, and fine-tune the compressed model to recover task accuracy.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Augment a neural controller with a differentiable residual-authority margin that measures the distance between the requested task wrench and the boundary of the actuator-feasible wrench polytope. During training, penalize commands with small margin; during deployment, project the policy output onto the largest-margin feasible wrench that remains close to the requested output. This should reduce saturation-induced failures during sustained contact and improve robustness to disturbances that…
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Compute separate doubled-angle orientation order parameters for left and right image regions, then expose their sum and difference as symmetric and antisymmetric global features. This gives a network a low-dimensional inductive bias for global vertical structure versus left-right imbalance, while retaining magnitude channels that indicate when either readout is undefined because orientations cancel.
Useful6/10
Difficulty5/10
Novelty7/10