Unverified
2026
Replace part of a sequence or spatiotemporal model's unconstrained recurrence with a bank of stable second-order filters whose poles are a frequency-shifted precession pole and a diffusion pole. The chemical-potential parameter produces oscillatory memory, while the diffusion parameter produces scale-dependent decay; a learned residual branch preserves expressivity when the prior is imperfect.
Useful5/10
Difficulty5/10
Novelty5/10
Unverified
2026
Replace an eigendecomposition-based spectral controller in a small recurrent or state-space transition layer with explicit polynomial projectors. Each hidden state is split into invariant modes, and each mode receives a separately constrained recurrent multiplier, enabling direct suppression of unstable modes or selective retention of long-memory modes using only matrix-polynomial evaluations.
Useful5/10
Difficulty6/10
Novelty6/10
Unverified
2026
Replace unconstrained pairwise token-routing interactions with a structured two-token router derived from an involutive set-theoretical Yang–Baxter solution. The pair operator is a convex interpolation between identity and a permutation of discrete routing states, so it cannot amplify probability mass or logits when applied to routing distributions. The Yang–Baxter relation provides a falsifiable test for whether three-token routing updates are insensitive to the two admissible…
Useful5/10
Difficulty6/10
Novelty8/10
Unverified
2026
Introduce an auxiliary matrix-valued optimizer state whose update is a Lie–Poisson flow discretized by similarity transforms rather than additive Euler steps. Because similarity transforms preserve $\operatorname{tr}(Z^k)$ and the full eigenvalue multiset, long training runs avoid spectral drift in the optimizer state; the state can then generate a preconditioned update for ordinary neural-network parameters.
Useful5/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace or supplement spectral-norm and Frobenius penalties on neural-network weight matrices with the Hardy-type norm given by the geometric mean of their gains over uniformly sampled unit directions. This penalizes typical multiplicative amplification through a logarithmic average, while the paper's theorem guarantees that the resulting quantity is a true norm rather than an ad hoc nonconvex statistic.
Useful5/10
Difficulty3/10
Novelty6/10
Unverified
2026
Replace an ordinary graph diffusion or message-passing operator with a positive-semidefinite Laplacian whose kernel contains a prescribed node-wise subspace. The layer smooths only feature components orthogonal to that subspace, preserving global constants, positional modes, or other structural signals even when graph edges are dynamically added or removed.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Construct positional features from a self-similar digit system whose Fourier characters are orthogonal under a prescribed nonuniform measure, rather than sampling frequencies independently. Use several admissible multiplier values to create frequency bands while preserving the underlying Hadamard structure, giving a deterministic multiscale encoding with a better-conditioned feature Gram matrix on fractal or highly clustered coordinates.
Useful5/10
Difficulty4/10
Novelty5/10
Unverified
2026
Build a linear state-space or recurrent layer in a learned pseudo-unitary coordinate frame $\Theta(t)$, and penalize the covariant coefficient $P_{m,\Theta}$ instead of penalizing $\Theta'(t)$ or transition-matrix norms directly. The regularizer is sensitive to meaningful variation of the represented Hamiltonian but is invariant to redundant gauge representations, potentially reducing unstable latent modes without forcing every parameter matrix to be small.
Useful5/10
Difficulty6/10
Novelty7/10
Unverified
2026
Construct a recurrent or state-space block with two learned transition matrices A and B representing two commuting update directions. Besides penalizing noncommutation and deviation from isometry, penalize the negative spectrum of the paper's core operator H(A,B), encouraging a structured overlap of one-step and two-step ranges. Compare this against an orthogonal-RNN baseline and against commutation-only regularization on long-horizon sequence tasks.
Useful5/10
Difficulty6/10
Novelty7/10
Unverified
2026
For a learned phase-space layer, estimate its symplectic Fourier bandwidth R and divide its output gain by the theorem's support-dependent factor R raised to an exponent determined by the Schatten index p. This creates a resolution-aware normalization: layers with larger phase-space bandwidth are automatically damped when p is not equal to 2, while the Hilbert-Schmidt case p = 2 remains unscaled.
Useful5/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace an unconstrained linear map on matrix-valued features by an exact operator-norm isometry assembled from parallel copies of X and its transpose. Contractive compression matrices and unitary basis changes allow a wider family than ordinary orthogonal layers, while a contractive remainder can increase output width without increasing the layer's spectral norm.
Useful5/10
Difficulty6/10
Novelty7/10
Unverified
2026
Add a bounded phase variable and a bank of local affine transport maps to an RNN or state-space model. The phase follows an irrational rotation, while the hidden state is transported through cells whose widths determine local gains, giving a controllable memory mechanism with analytically known distortion rather than an unconstrained recurrent Jacobian.
Useful5/10
Difficulty6/10
Novelty8/10
Unverified
2026
Construct a sparse message-passing graph from a tree backbone by subdividing every backbone edge and attaching leaves so that 2d_T1(x_i)+f_i is constant across backbone vertices. Use this graph as a fixed communication skeleton, with propagation weights calibrated by the predicted spectral radius. The same construction can be compressed into an effective backbone operator by eliminating subdivision and leaf nodes.
Useful5/10
Difficulty5/10
Novelty6/10
Unverified
2026
Construct the latent transition from a nondegenerate bilinear form phi and a form-compatible operator instead of from an unconstrained dense matrix. The resulting SSM has an exact orthogonal or symplectic algebraic structure, reducing transition parameter redundancy and testing whether preservation of a latent pairing improves extrapolation on reversible, parity-sensitive, or Hamiltonian-like sequence tasks.
Useful5/10
Difficulty5/10
Novelty5/10
Unverified
2026
Use a barycentric rational activation or filter whose interpolation nodes are periodically zoomed into the range of preactivations or eigenvalues actually encountered by the network. Protect the layer from catastrophic poles by monitoring the associated generalized eigenproblem and penalizing poles close to the active input interval. This targets rational networks whose expressivity comes from localized poles but whose training is destabilized by denominator zeros.
Useful5/10
Difficulty5/10
Novelty6/10
Unverified
2026
Apply consensus-based derivative-free optimization independently in parameter blocks that are expected to contribute additively to the objective, using noise projected into each block rather than isotropic noise over all parameters. The method is most suitable for low-dimensional trainable objects such as LoRA adapters, soft prompts, calibration vectors, or neural architecture hyperparameters, where maintaining a small population of particles is feasible.
Useful5/10
Difficulty6/10
Novelty7/10
Unverified
2026
Constrain a learned binary graph or sparse attention-routing graph so that every node neighborhood has no independent set of size k. This local anti-star condition gives an explicit upper bound on the graph Laplacian spectral radius, allowing a larger but certified stable diffusion step or residual propagation coefficient.
Useful5/10
Difficulty6/10
Novelty6/10
Unverified
2026
For a recurrent, state-space, implicit, or complex-valued neural network, partition the local input-output Jacobian into amplitude and phase channels and penalize excessive sensitivity in either channel. This transfers the paper's voltage-source stiffness mechanism to feature magnitude and phase, producing a stability monitor that can distinguish harmless amplitude sensitivity from destructive phase rotation.
Useful5/10
Difficulty5/10
Novelty6/10
Unverified
2026
Build an implicit layer from a piecewise-linear maximal monotone operator on visible variables z_* and auxiliary variables z_**, then eliminate the auxiliary block rather than exposing it in the network output. Compute the layer through a fixed point of the eliminated component of a nonexpansive resolvent, with damping when the auxiliary map is not strictly contractive.
Useful5/10
Difficulty6/10
Novelty6/10
Unverified
2026
Factor a neural linear layer as W = M A, where A is randomized at initialization and M is a deterministic channel mixer or learned feature transform. Regularize M toward low inverse-Hilbert–Schmidt norm under a scale constraint, because the paper's theorem predicts that this raises the high-probability lower bound on s_min(W) and reduces near-singular initialization events.
Useful5/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace a standard two-layer multiplicative interaction block with auxiliary positive features X whose neighboring products generate two coupled feature grids x and y. Add the Y-diamond recurrence as either a hard recurrent update or a differentiable consistency loss, forcing local interactions to obey the same compatibility structure as an SL2/Y-frieze.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Augment pairwise attention on a set of n tokens with a rigidity operator derived from normalized pairwise directions. The operator couples infinitesimal node displacements through changes in pairwise distances, while the complete-graph theorem provides a geometry-independent eigenvalue target n/2 after spherical centering and normalization.
Useful5/10
Difficulty6/10
Novelty7/10
Unverified
2026
Use the logarithmic exhaustion as a geometry for bounded hidden representations rather than only as a parameter constraint. A representation approaching the boundary receives an increasingly large metric, making ordinary Euclidean motion expensive and discouraging brittle saturation while preserving a bounded intrinsic gradient for the boundary coordinate.
Useful5/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace ordinary summation of several matrix-valued residual branches by a concave spectral aggregation: form the branch sum, take its absolute value, and apply a nonnegative concave function to singular values. The paper's transfer theorem predicts that the sharp Schatten-norm amplification constant is no worse than the corresponding linear Lee-type constant, while square-root, logarithmic, and capped maps suppress dominant singular directions.
Useful5/10
Difficulty6/10
Novelty8/10