✗ Failed on benchmark
2026
Replace selected residual, recurrent, or state-space blocks by modules whose input-output Jacobians satisfy an IODP inequality throughout a prescribed activation domain. The constraint controls incremental amplification between two trajectories without requiring either trajectory to remain near one fixed equilibrium, so it should improve robustness to changing contexts and prevent exploding long-horizon sensitivities.
Useful8/10
Difficulty6/10
Novelty6/10
✗ Failed on benchmark
2026
Add an observability objective to an RNN so that a finite trajectory of selected hidden coordinates preserves information about the initial hidden state. The regularizer maximizes the smallest singular value or log determinant of the finite-horizon observation Jacobian, counteracting ReLU activation masks that erase hidden-state directions.
Useful8/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Use an online estimate of the positive feedback gain among logits, routing probabilities, and representations to adjust the softmax temperature. Increase temperature when the estimated cyclic gain approaches the instability regime, preventing exponential amplification and router collapse without globally weakening all layers.
Useful8/10
Difficulty6/10
Novelty6/10
✗ Failed on benchmark
2026
Replace uniform minibatch sampling by a fixed-size determinantal point process whose similarity matrix is a diffusion kernel on the training-data k-NN graph. The sampler repels nearby or redundant examples while preserving multiple diffusion modes, so a small batch should cover intrinsic data geometry and provide lower-variance estimates of losses and gradients.
Useful8/10
Difficulty6/10
Novelty5/10
✗ Failed on benchmark
2026
Replace a deterministic graph propagation layer by a stable stochastic linearized latent dynamics whose frequency-resolved covariance matrix defines spectral bands. Train or initialize the graph operator so that a selected covariance band has a nonzero Chern number and remains separated by a measurable spectral gap, producing representations that are robust to local perturbations and can support boundary-localized responses.
Useful7/10
Difficulty7/10
Novelty8/10
✗ Failed on benchmark
2026
Initialize each row of a neural weight matrix as a stationary correlated Gaussian process instead of using independent entries, but constrain its correlation tail to remain on the finite-fourth-moment side of the transition. This creates controllable structured spectra while avoiding the heavy-edge regime predicted for correlations slower than \(t^{-1/2}\).
Useful7/10
Difficulty4/10
Novelty7/10
✗ Failed on benchmark
2026
Constrain a recurrent or state-space neural network to keep its hidden state inside an ellipsoid that is robustly invariant under bounded feature inputs, hidden-state perturbations, and model mismatch estimated from offline trajectories. The ellipsoid and a stabilizing recurrent gain are fitted from data through an SDP-inspired certificate, then used either as a training regularizer or as a projection layer at inference time.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Treat the input- or minibatch-dependent Jacobians of a recurrent or state-space network as a random derivative cocycle, and regularize its second Lyapunov exponent away from the first while independently placing the top exponent in a target stable range. This transfers the paper's equivalence between quasi-irreducibility, projective contraction, and a vertical spectral gap into a measurable training objective and a long-horizon stability monitor.
Useful7/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Replace unconstrained parameter or hidden-state noise by Brownian perturbations generated by symmetry-preserving directions, then monitor the effective replica generator on k copies of the hidden representation. The smallest nonzero eigenvalue of this generator is a measurable relaxation gap: maintain it above a target to avoid frozen symmetry sectors, while reducing noise when the gap collapses. This transfers the paper's symmetry-controlled low-energy geometry into an optimizer and…
Useful7/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Replace an unconstrained recurrent transition with a positive linear state-space core whose equilibrium has a prescribed composition vector. Fit or project its interaction matrix using a quadratic program with sign, sparsity, diagonal-dominance, and equilibrium constraints, then use the resulting stable dynamics as the hidden-state update.
Useful7/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Replace an ordinary contracting recurrent state with two spatially coupled competing latent populations whose nonlinear interaction admits a stable finite-amplitude coexistence state even when the infinitesimal invasion eigenvalue is negative. This creates hysteretic, robust memory: a representation survives small perturbations and weak evidence, but can be switched by a sufficiently large input pulse.
Useful7/10
Difficulty6/10
Novelty8/10
✗ Failed on benchmark
2026
Use the evolving singular spectrum of the represented matrix W_t=U_tV_t^{\top} to modulate one common, gauge-equivariant learning rate. Slow the shared update when spectral mass accumulates outside the intended low-rank subspace, preventing adaptive dynamics from amplifying nuisance tail directions while retaining the shared-rate structure needed for low-rank recovery.
Useful7/10
Difficulty5/10
Novelty8/10
✗ Failed on benchmark
2026
Constrain a recurrent transition so that its dynamically relevant invariant subspaces have no eigenvalues near the unit circle, separating contracting memory directions from expanding prediction directions. Add a pseudo-orbit consistency loss so that trajectories generated with bounded transition perturbations remain close to clean trajectories, as expected from hyperbolic shadowing.
Useful7/10
Difficulty6/10
Novelty6/10
✗ Failed on benchmark
2026
Modify a recurrent message-passing GNN so that every propagation step adds fresh independent Gaussian noise to every node and feature channel. Unlike dropout or a one-time perturbation, the noise remains active throughout the recurrence and creates a nonzero stationary graph-frequency energy floor, preventing long-horizon node representations from converging to the constant-node subspace.
Useful7/10
Difficulty4/10
Novelty5/10
✗ Failed on benchmark
2026
Add a fractional Laplacian penalty to neural functions over binary inputs so that high-order coordinate interactions are damped according to \(|S|^\alpha\), rather than treating all Fourier degrees equally. The penalty is estimated with random continuous-time bit-flip perturbations, requiring only extra forward passes and no explicit Fourier transform. It is especially suited to models that overfit through high-order Boolean interactions while retaining useful low-order structure.
Useful7/10
Difficulty4/10
Novelty8/10
✗ Failed on benchmark
2026
Regularize the end-to-end Jacobian singular-value distribution of a deep network toward the explicit free small-loss law generated by independently mixed projection-like layers. The target controls several gradient-spectrum moments, including the predicted fraction of nearly preserved directions, instead of controlling only the average gradient norm.
Useful6/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Add a pseudo-determinant-based connectivity objective to a neural model that predicts graph edge weights, attention adjacency, or sparse routing links. Maximizing the Laplacian pseudo-determinant rewards many globally distributed spanning trees, discouraging disconnected or bottlenecked learned graphs without requiring a discrete connectivity constraint.
Useful6/10
Difficulty5/10
Novelty5/10