Unverified
2026
Replace ordinary Frobenius or spectral-norm control of a tensorized multilinear layer by a sampled approximation to its oriented Schatten profile, the maximum Schatten norm of every input-output flattening. Regularizing this profile should control Gaussian or randomized polynomial activations uniformly over hidden width and tensor contraction pattern, reducing exploding activations and making higher-order layers easier to scale.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Use the external field H as a slowly swept control variable for a neural module, loss coefficient, or optimizer gain, and deliberately retain the resulting branch memory instead of replacing it with an instantaneous equilibrium update. Forward and backward sweeps produce a hysteresis loop whose shape diagnoses first-order-like training transitions, while controlled disorder changes the loop area and can suppress harmful branch dependence. This supplies a continuation-based curriculum or…
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
For a neural ODE or recurrent state update, learn a positive-definite degree-two homogeneous Lyapunov function that is only C1, rather than restricting the certificate to polynomials or analytic neural networks. Parameterize its angular dependence with a positive spline or softplus mixture, and train it to decrease along the learned vector field; this can certify stable dynamics that polynomial Lyapunov searches systematically miss.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Augment a recurrent or state-space layer with a bounded synaptic-depression variable that multiplicatively reduces recurrent transmission after activity. During training, estimate the layer's impulse-response transform and penalize characteristic roots approaching the unstable half-plane. This directly targets slow oscillations and exploding recurrent feedback rather than relying only on gradient clipping.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Regularize a neural embedding so that two augmented views of the same point cloud or graph induce homologous cycles whenever their embedded vertices move by at most δ. Instead of requiring identical topology at exactly the same distance threshold, compare homology at ε for one view with homology at ε+δ for the other, matching the paper's mathematically justified scale slack. This should discourage brittle holes and connected-component changes caused purely by augmentation noise while…
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Add a Born–Infeld/Minkowski-gradient barrier to a coordinate MLP so that its spatial gradient remains below a prescribed speed limit, rather than using an ordinary quadratic smoothness penalty. Couple the barrier with a forcing or task loss; under strong forcing, the resulting field should preferentially approach a distance-to-boundary-like profile while avoiding exploding derivatives and oscillatory solutions.
Useful6/10
Difficulty4/10
Novelty5/10
Unverified
2026
Construct a barrier metric between neural-network checkpoints or low-loss states using transition rates on a sparse neighbor graph, and use its induced single-linkage hierarchy to restrict updates within the current basin before permitting cross-basin moves. In the large barrier-spread regime, the metric is controlled by the largest barrier along the best path, producing an ultrametric hierarchy that can replace unreliable Euclidean distance for trust-region and replay decisions.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Replace an unconstrained relative-position attention-bias table by a learnable two-dimensional Fourier representation, or regularize the bias toward a small Fourier ratio. The ratio favors coefficient concentration without depending on the absolute scale of the bias, allowing the trained bias to be reconstructed from a small number of dominant frequencies.
Useful6/10
Difficulty4/10
Novelty7/10
Unverified
2026
Represent a small vector of neural control variables as a two-objective max-affine feasibility problem, such as clean-loss budget versus corruption-loss budget or task-performance budget versus activation-range budget. Rather than launching many independent weighted-sum optimizations, construct the active linear boundary and jump from breakpoint to breakpoint with the paper's Newton continuation step. This is intended for frozen-backbone calibration, LoRA gain tuning, activation clipping, or…
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Use fresh unlabeled covariates to train a frozen-teacher student against pseudo-labels, then form an affine combination of teacher and student predictions. Estimate the combination weight on a small independent labeled calibration set, requiring no access to the teacher training data and no additional teacher or student fitting.
Useful6/10
Difficulty3/10
Novelty5/10
Unverified
2026
Partition parallel neural-network replicas, experts, or parameter blocks into clusters and communicate their parameters through a directed nonnegative weight matrix whose dominant eigenvector is constant within each cluster. The optimizer contracts within-cluster disagreement while retaining separate cluster-level parameter states, providing controlled specialization instead of destructive global averaging.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Add a width- and degree-aware regularizer that prevents hidden polynomial neurons from collapsing to the same pivot. The paper's critical-point analysis says that non-global local minima and nontrivial saddles for cubic activation occur only when all pivots coincide, while global representations require at least d distinct active and visible pivots; the barrier directly targets this degeneracy.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Inject Stratonovich transport noise into intermediate spatial feature maps instead of adding independent elementwise Gaussian noise. Choose divergence-free vector fields whose covariance is approximately isotropic, so the corresponding Itô correction acts like a tunable Laplacian and preferentially suppresses unstable high-frequency feature components.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Regularize a neural attention or routing distribution according to how quickly it mixes toward a specified graph-dependent target, instead of penalizing only entropy or one-hop variation. The regularizer discourages pathological concentration on isolated graph regions while still allowing meaningful local structure, because concentration is judged after several graph-constrained Metropolis-Hastings steps.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Replace fixed degree normalization or unconstrained edge attention in a graph neural network by a positive edge metric initialized toward constant Lin–Lu–Yau curvature. On cycle-plus-leaf motifs, use the paper's closed-form regular-sun solution to set the relative strength of cycle edges and pendant edges, then optionally train a weak residual around this initialization. The hypothesis is that equalizing local transport curvature reduces anisotropic message propagation and improves…
Useful6/10
Difficulty4/10
Novelty7/10
Unverified
2026
Augment a recurrent or state-space neural network with an explicit delayed hidden-state channel and monitor the linearized delay spectrum around the zero or operating-point state. Use the paper's antiperiodic resonance equations to predict when oscillatory hidden modes should appear, then either avoid those parameter regions for stable sequence prediction or deliberately target them for periodic-memory tasks.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace the unconstrained final classifier with equal-norm regular-simplex class directions and train it under explicit isotropic Gaussian feature noise. At fixed signal energy and equal class priors, the paper's Gaussian-max theorem predicts that this geometry maximizes finite-noise maximum-likelihood decoding probability, making it a concrete candidate for robust classification heads.
Useful6/10
Difficulty4/10
Novelty4/10
Unverified
2026
Treat each neural-network block as a local strength system and measure how perturbations in its input channels affect multiple output observables, rather than using a single gradient norm. Use the estimated maximum directional gain to cap residual updates or assign a layerwise learning-rate multiplier, preventing weak high-gain layers from destabilizing training while allowing strong layers to move faster.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace a dense learned linear operator on continuous or image features by a truncated Hermite projection expansion whose coefficients are directly regularized in a Schatten-p norm. The layer becomes a structured low-rank operator, while the radial Hermite-Laguerre correspondence provides an analytically tractable parameterization and an exact spectral penalty.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Use the paper's norm-regularized conic dualization to impose PSD or SOS-style certificate constraints during neural-network training without forming Schur-complement or second-order-cone liftings. A neural dynamics model can be trained jointly with a polynomial Lyapunov or energy certificate, while the certificate subproblem is solved through accelerated updates in equality-constraint dual variables.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace expensive global spectral diagnostics of a cyclic or block-circulant neural layer by exact small Fourier-block calculations. Add a scale-normalized fourth-moment penalty, or directly cap the largest eigenvalue of each frequency block, to suppress frequency-specific amplification and reduce unstable training in long cyclic convolutions and structured attention.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Add a regularizer to a recurrent or state-space transition that makes its expansion along a learned one-dimensional direction approximately constant across hidden states. A learned potential can absorb state-dependent terms, implementing the paper's cohomology mechanism rather than forcing the raw Jacobian to be constant.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Add an entropy-Lyapunov consistency term to a recurrent or state-space model whose learned dynamics are intended to reproduce a chaotic invariant distribution. The regularizer targets the equality condition h_mu(f) = sum_i max(lambda_i, 0), while a dominated-splitting diagnostic determines whether the theorem assumptions are approximately plausible instead of blindly forcing equality.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Replace the memoryless parameter update with a discrete generalized Langevin update whose friction kernel is a positive mixture of decaying modes generated or scheduled by a Loewner driving process. Inject correlated gradient noise using the same kernel, implementing the paper's fluctuation-dissipation mechanism instead of choosing momentum and noise independently. The method is intended for noisy minibatch training, where controlled colored noise can preserve exploration while suppressing…
Useful6/10
Difficulty6/10
Novelty6/10