Unverified
2026
Replace or augment a residual neural layer with a Fourier-domain scale-selective flow containing a learned second-order term and a fourth-order stabilizer. The block permits controlled low-frequency amplification, as required by the KS infrared mechanism, while damping high-frequency feature noise and preventing unbounded spectral growth.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Insert a learnable semigroup layer that evolves features according to a positive operator combining frequency damping and spatially varying confinement. Unlike isotropic Gaussian smoothing, the layer can damp selected frequencies differently along different axes and can suppress activations in learned spatial regions, while the positive-semigroup construction prevents amplification.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace the unsigned adjacency used by a deep message-passing network with a signing selected from an affine family that makes designated short even cycles unbalanced. Search this family for a small even-power trace, which acts as a proxy for a smaller spectral radius and suppresses explosive long-range propagation. The signing can be fixed before training, so the method adds no per-example inference cost.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace ordinary Frobenius or spectral-norm control of a tensorized multilinear layer by a sampled approximation to its oriented Schatten profile, the maximum Schatten norm of every input-output flattening. Regularizing this profile should control Gaussian or randomized polynomial activations uniformly over hidden width and tensor contraction pattern, reducing exploding activations and making higher-order layers easier to scale.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace the usual inverse-eigenvalue weights in a low-rank feature-covariance preconditioner by inverse weights with an estimated isotropic floor subtracted. Retain only the top r eigendirections and require every corrected denominator to exceed a margin, preventing the shifted inverse from approaching a pole. This should undo systematic under-updating of predictive directions when many weak feature directions inflate the empirical covariance.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace ordinary row-degree or symmetric normalization in a directed graph neural network with a nonlinear Dyson scaling. For a nonnegative directed adjacency matrix A, solve a positive vector equation and propagate with B = D A D, where D is the diagonal matrix of the solution. The resulting operator has row sums strictly below one, giving an explicit bound against exploding directed message propagation while retaining asymmetric edge information.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Partition parallel neural-network replicas, experts, or parameter blocks into clusters and communicate their parameters through a directed nonnegative weight matrix whose dominant eigenvector is constant within each cluster. The optimizer contracts within-cluster disagreement while retaining separate cluster-level parameter states, providing controlled specialization instead of destructive global averaging.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Regularize a neural attention or routing distribution according to how quickly it mixes toward a specified graph-dependent target, instead of penalizing only entropy or one-hop variation. The regularizer discourages pathological concentration on isolated graph regions while still allowing meaningful local structure, because concentration is judged after several graph-constrained Metropolis-Hastings steps.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Compress a trained graph-attention model's edge-dependent logits or gates in the line-graph Fourier domain. Smooth edge values become concentrated in low-frequency coefficients, allowing low-frequency coefficients to retain more precision while high-frequency residuals use fewer bits or are discarded.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Replace one independently learned vector per graph edge with a truncated spectral expansion on the line graph. The model learns coefficients for low-frequency edge modes and reconstructs edge features before message passing, reducing parameters while imposing an inductive bias that incident edges should have correlated behavior.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace a generic recurrent transition by an exactly periodic unitary base transition plus a learnable weak Hermitian perturbation. The resulting \(\tau\)-step macro-dynamics approximates a continuous-time unitary flow, allowing the model to preserve signal norms while learning slowly varying long-range transformations.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Augment a recurrent or state-space neural network with an explicit delayed hidden-state channel and monitor the linearized delay spectrum around the zero or operating-point state. Use the paper's antiperiodic resonance equations to predict when oscillatory hidden modes should appear, then either avoid those parameter regions for stable sequence prediction or deliberately target them for periodic-memory tasks.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Build a sparse graph by thresholding normalized token or item inner products, then use the leading eigenvectors of its centered adjacency matrix as geometric features or a low-rank attention-logit bias. The graph avoids storing all pairwise similarities, while the paper's spectral bound supplies a concrete signal-to-noise test for deciding whether the resulting embedding is trustworthy.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Treat each neural-network block as a local strength system and measure how perturbations in its input channels affect multiple output observables, rather than using a single gradient norm. Use the estimated maximum directional gain to cap residual updates or assign a layerwise learning-rate multiplier, preventing weak high-gain layers from destabilizing training while allowing strong layers to move faster.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace a dense learned linear operator on continuous or image features by a truncated Hermite projection expansion whose coefficients are directly regularized in a Schatten-p norm. The layer becomes a structured low-rank operator, while the radial Hermite-Laguerre correspondence provides an analytically tractable parameterization and an exact spectral penalty.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace expensive global spectral diagnostics of a cyclic or block-circulant neural layer by exact small Fourier-block calculations. Add a scale-normalized fourth-moment penalty, or directly cap the largest eigenvalue of each frequency block, to suppress frequency-specific amplification and reduce unstable training in long cyclic convolutions and structured attention.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Construct a Lanczos chain for the neural-network vector field or hidden-state evolution, separately within bins of approximately constant loss, energy, or activation norm. Use the resulting Krylov complexity and Lanczos-coefficient growth as an early-warning signal for unstable training or long-horizon hidden-state amplification, then reduce the learning rate or recurrent integration step only in the unstable shells.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace a dense spatial parameter field in a neural field or convolutional adapter by a truncated squared-exponential KL expansion with analytic Gaussian-Hermite modes. The amplitude and correlation length remain trainable, but changing them only rescales coefficients and basis parameters instead of triggering a numerical eigensolve.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Use nested parameter-confidence sets to control how far a neural optimizer may move when its local loss dynamics are uncertain. Estimate a local linear model of parameter or gradient evolution, propagate a homothetic tube for possible next iterates, and impose a trust-region radius that shrinks when the estimated contraction margin is insufficient. This gives a model-based alternative to heuristic gradient clipping and predicts a sharp learning-rate boundary tied to the largest uncertain…
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Add a response-sensitive regularizer to networks whose outputs should react predictably to a control input, using the stationary Markov sensitivity equation as a certificate. Instead of only penalizing large neural gradients, the method attributes amplification to the generator resolvent and can distinguish amplification caused by a nearly slow latent mode from amplification caused by uncontrolled parameter growth.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Represent a recurrent transition using finite Jacobi coefficients with strictly positive off-diagonal entries, and regularize exponential moments of the associated spectral measures. This transfers the Toda lattice's exact phase-space condition into a practical certificate for recurrent dynamics. The exact global-well-posedness theorem applies to the autonomous Toda flow, while the neural-network version is a falsifiable regularization hypothesis for learned recurrent perturbations.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Use multilevel sensitivity of the global interaction margin to identify which neural block, connection, or parameter group is responsible for instability. This provides a targeted alternative to uniformly shrinking the learning rate or regularizing every layer.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Replace an unconstrained repeated averaging or message-passing operator by an average of positive isometric group actions whose mixing distribution satisfies the paper's bounded angular ratio condition. The resulting operator is Ritt, giving a mathematically certified bound on successive iterates and convergence of repeated application. This can stabilize deep equivariant stacks and reduce oscillatory feature dynamics.
Useful6/10
Difficulty4/10
Novelty7/10
Unverified
2026
Replace activation-magnitude-based adaptive computation halting with a criterion based on the actual recurrent update and a local stability margin. The loop halts when the state change is small relative to state scale for several consecutive steps, avoiding pathological decisions when LayerNorm-driven dynamics cause the activation norm to collapse.
Useful6/10
Difficulty5/10
Novelty6/10