Unverified
2026
Apply the paper's weighted nuclear elastic-net principle to the transition matrix of a recurrent or linear state-space layer. Penalize low-rank structure after whitening by the observed hidden-state covariance, while retaining a ridge term that prevents poorly excited state directions from producing unstable or arbitrarily large transition weights.
Useful6/10
Difficulty6/10
Novelty5/10
Unverified
2026
Replace random or k-means initialization of a k-expert router with a moment-based range finder on a calibration batch of hidden states. Estimate a low-dimensional second-moment subspace, enlarge it using one-free-index third-Hermite contractions, and fit the router's expert centroids and weights only in this resulting subspace. The router can then operate on projected hidden states while retaining an optional small residual adapter.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Represent a collection of neural directions as generators of a zonotope and reward the volume spanned by their subsets. The objective favors complementary, non-collapsed vectors rather than merely pairwise-separated vectors, making it suitable for attention heads, MoE expert signatures, or embedding prototypes. Use normalized generators and positive gates so the regularizer cannot be increased trivially by scaling.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace fixed graph message weights with a source-node activity gate that amplifies or suppresses every outgoing message from that node. Use the linearized epidemic growth condition to calibrate the residual propagation strength so that the dominant graph mode is near, but below, an explicitly chosen stability threshold rather than being determined accidentally by the graph spectrum.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Insert a proximal layer after a graph, mesh, or spherical convolution that groups all coordinates belonging to the same Laplacian eigenspace and applies one shared shrinkage gate to the whole group. Unlike coefficientwise spectral pruning, the result is unchanged if the eigenvectors inside a repeated eigenspace are rotated, preventing arbitrary basis-dependent feature selection.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Build neural computation graphs with explicitly phase-budgeted serial and parallel branches, treating serial compositions as SRG products and parallel residual branches as SRG sums. Allocate phase centers theta_i so that every loop or branch aggregate stays away from -1, enabling stability-aware architecture search and constructive control of branch gains.
Useful6/10
Difficulty7/10
Novelty8/10
Unverified
2026
Replace an unconstrained q-way polynomial or tensorized feature layer with separate decomposable and primitive interaction channels. The decomposable channel models interactions explainable as products of lower physical-weight feature blocks, while the primitive channel captures residual factors that cannot be represented by those products. This should reduce redundant high-order parameters and provide a controllable inductive bias for compositional or disentangled representations.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Insert a differentiable Fourier-domain layer after a network predicts a symmetric strain field, projecting every frequency onto the subspace satisfying isotropic mechanical equilibrium. The projection is a closed-form least-squares correction, so the network cannot spend capacity representing large equilibrium violations and the resulting field is physically admissible by construction.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Represent a nonnegative neural output as a homogeneous polynomial with coefficients indexed by count vectors, and penalize violations of the Lorentzian Hessian signature after factorial normalization. Add an M-convex support penalty so mass can move between coordinates through valid exchange operations rather than forming disconnected or brittle coefficient patterns.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Make Laplacian latency attention hardware-friendly by quantizing the exponential decay and row normalization to powers of two. Exponentials and divisions can then be implemented with lookup tables and integer shifts, enabling a low-bit attention kernel for neuromorphic and edge accelerators.
Useful6/10
Difficulty4/10
Novelty7/10
Unverified
2026
Replace a random cyclic filter bank or patch projection with the Weyl–Heisenberg orbit of one normalized learnable prototype. Regularize the prototype so that all nonzero shift and modulation correlations have a large and nearly equal magnitude, maximizing the smallest eigenvalue of the induced feature Gram matrix and preventing poorly observed feature directions.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Insert a projective normalization and spectral monitor into a recurrent or deep residual dynamical block. If the effective linearized map has one real eigenvalue whose modulus dominates all others, the block is predicted to collapse features toward one direction; constrain the spectral ratio or preserve a controlled two-dimensional rotational mode to maintain representational rank.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Replace the fixed number of Sinkhorn iterations used to normalize an attention kernel with a per-example stopping rule based on the local spectral contraction factor. Estimate the remaining marginal error geometrically and stop early on easy examples while retaining extra iterations on difficult or nearly disconnected examples.
Useful6/10
Difficulty4/10
Novelty5/10
Unverified
2026
Approximate a long hidden-state or key/value trajectory by a small sum of exponential modes, storing only the mode nodes and vector weights instead of every timestep. Recover the modes from a Hankel matrix through an annihilating polynomial, then reconstruct the trajectory or a compact recurrent state during inference.
Useful6/10
Difficulty6/10
Novelty5/10
Unverified
2026
Use a low-dimensional polynomial model of local training dynamics to detect when the leading nonlinear restoring behavior becomes degenerate. Shrink the optimizer step in that region, or fit higher-order terms before restoring it, because the paper shows that quartic nondegeneracy determines whether local nonlinear stability can be certified and that sixth-order terms resolve inconclusive cases.
Useful6/10
Difficulty7/10
Novelty8/10
Unverified
2026
Apply a Birkhoff-normal-form-inspired monitor to momentum optimization and recurrent-state updates, where oscillatory modes are identified from recent parameter or hidden-state trajectories. When two dominant frequencies approach a low-order ratio such as 2:1 or 3:1, increase damping before nonlinear mode coupling produces large oscillations; away from resonance, retain the faster low-damping update.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Use a PEP-generated quadratic Lyapunov function as a runtime monitor for minimax training. When the measured Lyapunov decrease becomes positive, reduce the learning rate or reset optimizer memory; when the decrease is safely negative, retain or cautiously increase the step size.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Replace an ordinary hierarchical graph encoder with a finite chain-complex encoder whose learned boundary maps satisfy \(\partial_{k-1}\partial_k=0\). Compute Smith normal form on the integer incidence matrices and treat unit-labelled cell pairs as refinement overhead: cancel or gate those pairs before message passing, while preserving non-unit labels that encode genuinely nontrivial structure. The resulting representation should be insensitive to arbitrary cell subdivision while retaining…
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Track where the loss Hessian's eigenvectors are most sensitive to the current minibatch perturbation, rather than using only eigenvalues or a global learning-rate estimate. Apply extra damping only to spectral bands with high geometric response, allowing flat and well-separated curvature modes to retain a larger step size.
Useful6/10
Difficulty7/10
Novelty7/10
Unverified
2026
Use the conditioning of a learned symmetry-commutant manifold as a training-time detector for frozen or weakly reachable hidden-state regions. When replica observables become nearly linearly dependent, the commutant Gram matrix becomes ill-conditioned; reduce injected noise and learning rate there, or perturb only directions with measurable response. The mechanism predicts a transition in relaxation curves at a conditioning threshold rather than relying only on validation loss.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Replace an unconstrained recurrent residual update with a sparse coordinated state-space block whose gains and state radii are synthesized jointly by a linear program. The block receives bounded feature disturbances, keeps every hidden coordinate inside a certified interval for all time, and uses an affine feedforward correction to reduce the output sensitivity of downstream coordinates.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
When a symmetry-frequency block becomes critical, initialize or perturb the network specifically along its critical representation rather than injecting isotropic noise into all hidden channels. This creates trainable branches for the symmetry patterns predicted by the bifurcation calculation and can expose useful periodic solutions that ordinary symmetry-preserving training fails to reach.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Construct a recurrent layer with a hidden clock coordinate that advances by a nonzero drift and use that coordinate to define a state-dependent metric for the remaining hidden channels. The layer may contain neutral or sign-flipping Euclidean modes, but the metric is designed so that forward and backward Jacobian products become uniformly contracting on complementary subspaces, imitating the White-map mechanism. This targets vanishing or exploding gradients in long sequences while preserving…
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Add a neural feature, adapter, or expert block only through the component of its outputs that is orthogonal to the span of all previously installed blocks. Quotient coefficient directions that produce nearly identical outputs with an SVD or pseudoinverse, so the new block contributes intrinsic representational dimensions instead of duplicating old features. The expected benefit is a smaller effective architecture and better-conditioned block expansion.
Useful6/10
Difficulty5/10
Novelty6/10