Unverified
2026
Add a recurrent associative matrix to each selected transformer layer so recent key-value relationships can be retrieved without retaining every past token or performing gradient updates. The matrix uses input-dependent retention and write gates, but retrieval is always performed from the pre-write state, preventing the current target from leaking into its own prediction. Frobenius-norm clipping makes the recurrent memory bounded and provides a direct stability control.
Useful6/10
Difficulty4/10
Novelty4/10
Unverified
2026
Regularize the state-transition or input-output Jacobian of a recurrent, state-space, or implicit neural network so that its complex eigenvalue cloud belongs to a selected non-Hermitian symmetry class and has the corresponding unfolded pair statistics. Combine this statistical-shape constraint with an explicit spectral-abscissa or spectral-radius margin, preventing the network from obtaining good average singular values while remaining highly non-normal and transiently unstable.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace an unconstrained hidden-to-hidden interaction in an MLP or transformer feed-forward block by two gauge-related branches. Split channels with an orthogonal involution Θ, constrain the learned interaction K to anticommute with Θ, and use opposite signs of K in paired branches. This creates a testable inductive bias in which the learned interaction only transfers information between the two channel subspaces.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Replace pointwise high-order derivative residuals in an eigenvalue PINN by an assembled dynamic-stiffness residual \(\mathbf W(\omega)q_\theta\), where each element matrix is obtained from homogeneous PDE solutions. The network predicts nodal degrees of freedom or element boundary traces, while the exact frequency-domain operator enforces the physics without differentiating the network multiple times with respect to coordinates.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace an unconstrained recurrent or residual linear transition with a matrix generated through the paper's twisted Cayley chart and exact exponential flow. The layer evolves a constrained operator analytically rather than learning arbitrary weights, while retaining trainable symmetric chart coordinates and a continuous time-scale parameter.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Partition a neural network into heterogeneous parameter blocks or maintain several worker replicas, and model each block's optimizer state as a constrained linearized dynamical agent. At every synchronization interval, jointly optimize a finite sequence of parameter updates and a feasible common terminal parameter target, while enforcing consensus through distributed primal-dual iterations. Unlike ordinary gradient descent toward a fixed or implicit target, the target is selected together with…
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace the noisy Hutchinson estimate of a neural-network Hessian trace with a variance-reduced Hutch++ estimate computed only from Hessian-vector products. Use the estimated normalized curvature to cap or rescale the optimizer step, so learning-rate reductions occur when the loss landscape becomes globally sharp rather than when an individual minibatch gradient happens to be large.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Use two bounded self-adjoint transition operators in a recurrent or state-space block and penalize their normalized Hilbert--Schmidt commutator. When the penalty is small, the paper guarantees that the pair is close to exactly commuting operators, suggesting a controlled path to a shared eigenbasis and cheaper coordinate-wise dynamics. Add an optional numerical repair step that projects the learned pair toward a simultaneously diagonalizable pair.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Construct a generative or recurrent neural architecture with several contractive or mildly expanding branches, and explicitly control the geometric complexity of its invariant set using the sub-additive singular-value pressure of branch-Jacobian products. Instead of regularizing only the operator norm, the model can preserve anisotropic directions while targeting a desired attractor dimension, potentially improving coverage of structured data without uncontrolled folding or collapse.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Replace an explicit recurrent transition with a learned descriptor relation in latent space, allowing some latent coordinates to satisfy algebraic constraints rather than being numerically integrated. Fit the relation using total-least-squares or iterative PCA on the jointly observed trajectory, so noise in every channel is treated symmetrically and the model can discover whether the latent system is index-0 or index-1.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace the recurrent transition or state-space mixer with a reversible transport followed by complementary relaxation of symmetric and antisymmetric feature components. The construction preserves a weighted energy and damps both parity sectors, giving bounded long-horizon powers without requiring the learned transition matrix itself to be symmetric. A numerical-range ellipse can be used as a cheap training-time certificate against transient growth.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Constrain the learned coefficients of a high-order linear recurrent or state-space layer using the block Hurwitz matrix associated with its matrix characteristic polynomial. Penalize near-singular Hurwitz blocks and, for degrees two and three, optionally enforce positive leading Hurwitz determinants; use companion-matrix eigenvalues as the definitive stability check rather than trusting determinant positivity at degree four or above.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Initialize or regularize recurrent matrices so that each unit receives an approximately cancelling sum of positive and negative weights, while keeping the global variance and spectral radius fixed. Sweep a continuous balance parameter instead of imposing balance blindly, because the paper predicts qualitatively different behavior for saturating, sub-linear, and odd nonlinearities.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Train a neural state-space model whose one-step dynamics are linear in a fixed analytic feature vector, and use the empirical feature Gram matrix to detect whether passive trajectories identify the dynamics. Add data collection or replay only when the Gram matrix is poorly conditioned; the analytic-feature assumption predicts that persistent excitation should emerge without deliberately visiting every operating mode.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace an unconstrained recurrent transition matrix with a J-selfadjoint matrix A, where J is a fixed diagonal signature matrix with only a small number of negative entries. Add a sampled Kreiss-resolvent penalty to suppress transient amplification while preserving the expressive dimension of the hidden state. The paper's bound predicts that worst finite-time amplification depends on the smaller inertia index rather than the full hidden dimension.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Construct a neural state-space model with an explicit first-order input-to-output path instead of forcing every output to depend only on deeply propagated hidden states. Penalize or reject learned linearizations whose transfer matrix has relative degree greater than one, then train a storage-function certificate for the remaining passive dynamics. This preserves the paper's relative-degree compatibility condition while allowing high-order internal memory.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Use two points with approximately equal minibatch loss to construct an ellipcenter: the intersection of the normal lines through the two points, where the normals are their gradients. The resulting update uses local curvature information in the span of two gradients and can be relaxed toward the current parameters or combined with momentum.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Build actuator or parameter constraints directly into the neural controller using a differentiable hard-saturation map rather than penalizing violations after the fact. This makes the Lyapunov certificate apply to the actual bounded controller and prevents training from exploiting unrealistically large actions.
Useful6/10
Difficulty3/10
Novelty4/10
Unverified
2026
Replace an Erlang delay or exponential smoothing cascade in a recurrent or state-space layer by a positive rational kernel of the form \(\kappa(u)=C e^{-a u}p(u)^2\). Choose the degree-\(m\) polynomial by deleting the adjacent pair of Laguerre zeros with smallest relative gap from \(L_{m+2}\), then rescale the resulting density to unit mean. This preserves a nonnegative impulse response while reducing temporal jitter relative to Erlang filters.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Add a deliberately nonconservative, antisymmetric parameter-space force to ordinary gradient descent, with its amplitude controlled by an empirically estimated stability margin. The force should move parameters around elongated loss valleys instead of repeatedly descending and stopping along the same local gradient direction, while damping preserves convergence. The method directly tests whether nonzero circulation can improve traversal of flat or ill-conditioned regions without destabilizing…
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Use the change in the policy-induced reachable set as a trust-region constraint, rather than limiting only parameter distance or KL divergence. A policy update is accepted when its predicted finite-horizon zonotope remains sufficiently close to the previous reachable tube and does not cross the safety boundary, yielding a dynamics-aware step-size ceiling.
Useful6/10
Difficulty7/10
Novelty8/10
Unverified
2026
For a neural stochastic state-space model or discrete diffusion sampler, monitor whether learned transition logits admit a global scalar potential on the active latent manifold. Penalize residual cycle affinities in the conditional sector, but leave reset cycles unpenalized so the model can retain useful dissipative mixing. The distinctive prediction is a linear decrease of integrability error with residual cycle current and a quadratic decrease of entropy production near autonomous…
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Add a local Jacobian spectral regularizer and an initialization sweep to steer a looped transformer away from uncontrolled near-unit dynamics. The goal is to prevent examples from entering a fold-critical regime with very long relaxation times, or alternatively to deliberately target a controlled critical regime when adaptive test-time compute is useful.
Useful6/10
Difficulty6/10
Novelty5/10
Unverified
2026
Add a small dynamical state on the transformer module graph and use it to control adaptive computation, but reject controller parameters whose discrete-time update has latent roots outside the unit disk. The state can modulate halting thresholds, residual-block gains, and memory gates; the certificate applies to the controller integrator and prevents unstable oscillations or exploding internal control signals during long adaptive-depth rollouts.
Useful6/10
Difficulty6/10
Novelty6/10