Unverified
2026
Replace a standard preconditioned gradient update by a scalar-auxiliary-variable update that evolves both the parameters and a scalar representing the nonlinear part of the loss. The discrete-gradient/SAV construction gives an exact decrease of a modified training energy for each deterministic batch, preventing overshoot and long transient energy growth while requiring only a diagonal or block-diagonal linear solve.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace a dense Gaussian or learned projection from dimension N to m with a normalized partial circulant projection generated by a single Gaussian vector. For K-sparse hidden states, the restricted-isometry guarantee predicts approximate norm preservation while reducing stored projection parameters from O(mN) to O(N). The projection can be evaluated with an FFT and should be combined with explicit top-k gating so that the sparse-input assumption is enforced.
Useful6/10
Difficulty4/10
Novelty5/10
Unverified
2026
Build a refined Freudenthal-Kuhn simplicial graph over mesh vertices or geometric samples and inject its piecewise-linear metric into attention logits. Refinement is increased until the explicit distortion target is met, making attention scores less sensitive to arbitrary mesh resolution, triangulation, or local curvature.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace a conventional momentum update by a second-order optimization state with an adaptive robust correction. An online disturbance observer estimates the difference between intended gradient-driven dynamics and observed optimizer dynamics, while an adaptive sliding gain compensates for the remaining bounded disturbance. This is intended for minibatch noise, stale gradients, curvature variation, or gradient compression that produces intermittent optimizer instability.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace Euclidean momentum updates on simplex-valued neural variables with entropy mirror descent when the variable dimension is large and the loss is naturally smooth relative to negative entropy. The lower bound predicts that Nesterov-style acceleration cannot guarantee an asymptotic improvement in this geometry, while the geometry-matched update preserves positivity and can reduce boundary instability.
Useful6/10
Difficulty4/10
Novelty4/10
Unverified
2026
Train a recurrent or state-space neural model with an information regularizer that uses trajectory-dependent predictive information at low observation noise but switches toward instantaneous mutual information as sensor noise increases. The switch is driven by an online estimate of the relative reliability of transfer entropy and instantaneous dependence, rather than by a fixed hyperparameter. This should prevent noisy histories from forcing the latent state to memorize unreliable temporal…
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Apply the paper's mechanism-contrast idea to ReLU decoders by requiring each piecewise-affine branch to produce a detectable and distinctive change across at least one activation boundary. Penalize branches with vanishing Jacobian jumps or nearly identical boundary signatures, discouraging observationally interchangeable decoder mechanisms.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Parameterize a large linear layer as a sum of binary tensor products, W = Σ_l A_l ⊗ B_l, and regularize a factor-level upper bound on its top-k singular-value sums. The bound controls all Ky Fan norms of W while requiring SVDs only of the small factors, making it suitable for tensorized MLP or attention projections.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Use the paper's derivative-dispersion mechanism as a neural regularizer: the input-dependent forcing should produce different derivatives in different hidden directions. Penalize collapse of the Jacobian of the forcing map while retaining a contracting recurrent transition, so hidden states do not converge to a low-dimensional manifold caused by nearly parallel inputs.
Useful6/10
Difficulty4/10
Novelty8/10
Unverified
2026
Replace unconstrained output coordinates with a neural parameterization whose outputs are valid monotone profiles by construction, analogous to representing a Young diagram through nonnegative ordered row increments. Train the network against an explicit energy or negative log-probability while preserving the feasible geometry, rather than relying on penalties that permit invalid intermediate states.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Use attractor separation and noise-induced basin coalescence as a robustness test for recurrent networks with multiple learned memories or modes. Estimate the smallest perturbation amplitude at which initially distinct hidden-state attractors become geometrically indistinguishable, then train or operate below that threshold with a safety margin.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Replace a single recurrent transition with a finite bank of candidate positive linear transitions and use a minimax controller to choose the feedback action at every time step. The controller evaluates candidate successors, selects the action whose worst-case predicted cost is smallest, and clips the action to preserve nonnegative hidden states. This should make an SSM or RNN less sensitive to transition-matrix mismatch and long-horizon disturbances.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Construct a nonreversible optimizer whose parameter drift contains an antisymmetric mobility component, while its stochastic diffusion and preconditioner remain symmetric positive semidefinite. The paper predicts that adding or removing an antisymmetric diffusion representation cannot change any finite-time joint statistic of scalar state-dependent observables, whereas antisymmetric mobility can change relaxation and response because it enters the drift.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
When the Schrödinger generator is learned, regularize its spectrum and eigenvectors so that the magnitude trajectory remains well-conditioned for recovering hidden complex states. Penalize small singular values of the squared-eigenvector matrix and near-colliding eigenvalue pair sums, preventing a learned dynamical layer from becoming spectrally invisible or phase-ambiguous.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Represent graph-node or token states as points and tangent velocities on a Riemannian latent manifold, and couple neighboring states using parallel-transported velocity discrepancies rather than subtracting coordinates in a chart. Add a bonding barrier that keeps connected states inside a prescribed radius below the injectivity radius, making the transport map unique and preventing chart or geodesic branch failures.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Add a latent factor map that is approximately 1-Lipschitz and require it to preserve important scalar 1-Lipschitz observables of the data distribution. Approximate the universal quantifier with an adversarial bank of neural probes, rewarding the encoder for retaining distributionally stable information while discarding high-frequency or sample-specific detail.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Add a degree-conditioned neighborhood-profile penalty to a GNN so that its effective message-passing graph has a controlled hub-neighborhood trend. The regularizer can either target a rank-one null profile, where neighbor degree is approximately independent of root degree, or deliberately target a learned/reference logarithmic trend when preferential-attachment-like structure is useful.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace a constant learning rate by an adaptive prescribed-time gain calibrated to a user-specified deadline. Apply the mechanism to a nonnegative training Lyapunov error such as the loss under a local Polyak-Lojasiewicz condition, or to disagreement errors in distributed training, so that the error reaches a target tolerance by time T without using a singular learning rate.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Regularize a learned self-adjoint contraction so that its eigenvalues move toward 0 or 1 rather than accumulating in the transition interval. This suppresses ambiguous mixing modes and can enable a smaller binary spectral approximation at inference.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Replace one spatial convolution block by a recurrent Fourier-domain layer that couples every mode k to its opposite mode -k and gives the strongest amplification to a nonzero selected wave number k*. The layer crosses a controlled Turing-like instability at k* and uses cubic saturation to produce bounded structured features instead of unbounded activation growth.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Represent every predicted displacement and velocity as the sum of a prescribed boundary lift and a learned residual that is identically zero on the Dirichlet boundary. Feed the boundary velocity into the model through an explicit distributed-port feature and train an energy-balance residual so that the learned interior dynamics cannot inject arbitrary energy at the constrained boundary. This should eliminate boundary drift and reduce the burden on penalties or projection layers.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Augment standard pairwise attention composition with a shared ternary correction m_3(a,b,c), so two different parenthesizations of a three-token or three-edge composition need not agree exactly but are forced to differ by a learned bounded correction. This gives the network a structured way to represent context-dependent compositionality without replacing efficient quadratic attention with unrestricted third-order attention.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace a collection of overlapping sliding-window features with approximately orthogonal incremental features: the length-m feature contains information not predictable from shorter consecutive windows. Use the paper's transition-operator Toeplitz precision matrix to decorrelate the resulting sequence of window features before attention, suppressing duplicated local evidence and improving conditioning.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Augment a stable diffusive state-space model with pair states formed from products of slow latent modes. Single modes represent ordinary long-wavelength diffusion, while pair modes represent the interacting hydrodynamic operators responsible for late-time tails in quartic observables. Use the pair states only for selected readout channels or a low-rank subset of mode pairs, preserving near-linear inference cost.
Useful6/10
Difficulty6/10
Novelty7/10