Unverified
2026
Replace a dense recurrent transition matrix with a periodic CMV-style product of alternating local 2x2 unitary cores. The transition is exactly norm-preserving, has O(n) trainable parameters under periodic tying, and can be applied through local factor operations rather than stored as an n-by-n matrix. Use turnover refactorization when changing the ordering or boundary connection of cores, enabling a compact cyclic unitary state-space layer.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Replace the usual linear predictor in continuation of an implicit neural state with a fractional-power predictor fitted from recent states, then correct the prediction using a pseudo-arclength constraint. This is designed for equilibrium layers, implicit sequence models, or homotopy training schedules where the state Jacobian becomes nearly singular and ordinary Newton correction or fixed-point iteration becomes unstable.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Add a training-time regularizer that keeps the empirical joint covariance of hidden activations on multiple inputs close to the recursively predicted NNGP covariance. The regularizer targets the finite-width fluctuations quantified by the Wasserstein result, and is particularly appropriate for recurrent networks and attention blocks with shared weights, where hidden states at different positions or time steps are statistically coupled.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Turn row dropout into an adversarial conditioning problem rather than independent Bernoulli noise. At each training step, search for a subset of surviving channels or measurements with unusually small least singular value, train the downstream network on that subset, and gradually increase the search strength so training directly exposes failure modes hidden by average-case dropout.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Replace a binary classifier's unconstrained final logit with a differentiable likelihood-ratio head based on two squared Mahalanobis radii in a learned embedding space. Approximate the shared radial generator with a small fractional-power basis, allowing the head to model heavy-tailed class geometry that an affine QDA logit cannot represent while remaining much smaller than a generic nonlinear head.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Regularize an encoder so that feature vectors from every substantial local data region occupy a well-conditioned, high-dimensional linear span. Instead of only maximizing global covariance rank, penalize low effective rank in many local batches or neighborhoods, approximating the paper's worst-positive-measure-set definition of separation capacity.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Replace a dense weight matrix by a cross approximation built from selected rows and columns rather than by a conventional truncated SVD. Periodically refresh the selected indices using residual leverage scores, warm-starting from the previous factorization so that the compressed layer can track weight changes during fine-tuning.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Build a state-space layer whose latent dynamics use a fixed cyclic schedule of learned generators instead of a single generator. Penalize pairwise commutator norms so that the true ordered cycle remains close to the averaged flow, while periodically checking a quadratic Lyapunov contraction condition on the exact cycle transition.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Regularize the end-to-end Jacobian singular-value distribution of a deep network toward the explicit free small-loss law generated by independently mixed projection-like layers. The target controls several gradient-spectrum moments, including the predicted fraction of nearly preserved directions, instead of controlling only the average gradient norm.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Insert an active-set reduction step into a binary energy layer or Hopfield-style discrete optimizer. Coordinates whose signs are stable and whose local fields have a rigorous margin are frozen, while their interactions are folded into an induced bias and only the unresolved tail is updated. This preserves the exact conditional quadratic objective and can reduce dense interaction cost substantially when the state becomes polarized.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Regularize a learned state-space transfer function so its matrix response has positive real part on sampled points in the unit disk and its associated reproducing-kernel Gram matrix is positive semidefinite. This provides a frequency-domain stability signal that complements rollout-based penalties and spectral-radius clipping.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace a generic recurrent transition with two coupled unitary transitions that share one block column and differ by a sign on the other block column. Each transition preserves hidden-state norm exactly, while the structured difference gives a controlled two-path recurrent architecture for long-context modeling.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Add global directed-curvature features to every node in a graph neural network or directed graph transformer. The features distinguish how a node functions as a source versus a destination in the graph's asymmetric metric, potentially exposing bottlenecks, hubs, sinks, and structurally central nodes that local message passing cannot identify.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Extract a small set of stable exponential modes from an observed neural sequence and use them to initialize a diagonal or block-diagonal state-space model. Hankel-pencil eigenvalues propose the modes, while persistence across shifts and contour margins reject modes caused by noise or a short-lived background.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Represent every mesh interface degree of freedom by one feature copy per incident cell, and apply local neural blocks directly to these cell tensors. Enforce inter-cell consistency with valence-weighted averaging only after selected layers or hierarchy transitions, avoiding repeated construction of a global sparse graph or assembled feature vector. This is suited to adaptive quadtrees, octrees, and finite-element neural operators.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Apply the paper's orthogonal-sketch idea to a trainable low-rank weight update or low-rank optimizer state. After every optimizer step, use a row sketch and Cholesky QR to recondition the factor basis, then compute the update with the standard tangent-space projector rather than an oblique sketched projector.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace the standard plug-in KSD V-statistic with the positive-part square root of the unbiased pairwise U-statistic when evaluating or training a sampler against a fixed target score. The estimator uses off-diagonal cancellation and should approach the Hilbert–Schmidt fluctuation scale instead of the larger trace scale paid by the diagonal-including V-statistic.
Useful6/10
Difficulty4/10
Novelty5/10
Unverified
2026
Replace repeated full-curvature factorizations when evaluating many Bayesian neural-network hyperparameter settings with one shared low-rank approximation of the data-induced precision update. Reuse the same curvature subspace while changing prior precision, observation-noise precision, or layerwise regularization, evaluating each candidate through a small rank-r matrix and Woodbury solves.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Reduce the SDP dimension by removing ReLU neurons that are provably inactive, always active, or incapable of changing the current worst-case margin. The verifier keeps exact affine substitutions for fixed-sign neurons and retains only genuinely unstable neurons whose activation can cross zero under the perturbation set. A stronger optional rule removes an unstable neuron when its certified maximum possible contribution is below a user-controlled tolerance, with an exact mode that prunes only…
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Model the scalar feedback route in a recurrent layer as a rank-one perturbation of its open-loop transition. Regularize the frequency response of that route so that no mode reaches unit loop gain, directly targeting oscillatory and slowly decaying instabilities rather than relying only on gradient clipping.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Replace cross-entropy or ordinary Renyi loss between a target distribution and a model distribution with the paper's r-deformed alpha-z divergence. The deformation parameter r provides a controllable power-law alternative to the logarithm, allowing experiments that emphasize hard, low-probability target events differently from standard log losses.
Useful6/10
Difficulty3/10
Novelty6/10
Unverified
2026
Use the expander decoder as a structured sparse-coding dictionary and replace dense OMP correlation steps with edge-wise gather-and-reduce operations. This is useful when codes must be inferred iteratively, including interpretable feature extraction, sparse retrieval, or an inference-time latent selector that cannot rely entirely on an amortized encoder.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Replace a dense channel or token-mixing matrix with a product of positive bidiagonal factors, so information propagates through a controlled sequence of local couplings rather than arbitrary signed interactions. Initialize the factors from the paper's barycentric-subdivision factorization, then learn positive diagonal and off-diagonal parameters; the resulting map is structured, parameter-efficient, and constrained to remain totally positive.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Add a conservative correction after low-rank tensor compression so selected linear moments of an activation or learned state are exactly preserved. This can reduce tensor rank and memory without allowing compression error to accumulate in physically meaningful global quantities.
Useful6/10
Difficulty6/10
Novelty7/10