✗ Failed on benchmark
2026
Augment an optimizer with a periodic phase and deliberately use a cyclic learning-rate or momentum forcing whose averaged dynamics have an attracting low-dimensional set. Treat the resulting periodic parameter orbit as an invariant torus and tune the schedule so transverse contraction dominates tangential sensitivity and minibatch perturbations. The goal is a robust, phase-locked training orbit that explores parameter space without losing attraction toward a useful solution manifold.
Useful7/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Add a graph-structural anti-oscillation constraint to binary or thresholded recurrent message-passing networks. The paper shows that a partition with sufficiently many cross-partition neighbors creates an exact period-two orbit, so training can explicitly penalize such high cross-degree bipartite cores or choose the threshold above their strength.
Useful7/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Replace an unconstrained neural transition model with a hybrid sparse dynamics model: retain analytically known first-order relaxation or control terms and learn only a sparse set of candidate interactions from a physics-guided library. Fit the library coefficients using a robust TLS-plus-RANSAC procedure, then use the identified model as the transition function or as a residual correction to a neural state-space model.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Keep the empirically effective post-LMO sign update, but reject it whenever a fresh minibatch estimates that it is poorly aligned with the gradient. Fall back to the gradient-side error-feedback candidate in those cases. This converts the paper's constructive divergence warning into an inexpensive runtime safeguard rather than assuming that any sign placement is universally safe.
Useful7/10
Difficulty4/10
Novelty7/10
✗ Failed on benchmark
2026
Replace ordinary graph message passing by diffusion over a simplicial complex or hypergraph, using incidence matrices to propagate information through nodes, edges, and higher-order faces. Mix the local higher-order walk with a teleportation operator so that the layer remains globally connected and avoids the slow mixing or oversmoothing caused by poorly connected complexes.
Useful7/10
Difficulty5/10
Novelty6/10
✗ Failed on benchmark
2026
Train an admission or MoE routing gate not only to reduce its immediate workload, but also to preserve the ordering between a controlled trajectory and a baseline trajectory under the same request stream. Penalize counterfactual events in which the controlled system, after initially rejecting work, later exceeds the baseline workload because its changed state causes a large job to be admitted.
Useful7/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Split a recurrent or state-space model into a coarse quotient state \(z_t\) and a leaf or fibre state \(y_t\), where the quotient evolves autonomously and the fibre is driven conditionally by the quotient. Constrain the two transition operators to have independently measurable contraction or correlation rates, then allocate capacity and regularization to the slower branch. This is intended for sequence tasks containing both slowly evolving global variables and rapidly mixing local variables.
Useful7/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Use the disorder-controlled stability boundary as a training schedule. Start with strong damping so optimization is well behaved, then reduce the damping margin toward zero to create long-lived oscillatory state memory after the network has learned useful representations.
Useful7/10
Difficulty4/10
Novelty7/10
✗ Failed on benchmark
2026
Replace a neural sequence model's unconstrained multi-step latent rollout with a data-driven LPV predictor acting on a learned latent state. Build the predictor from Hankel matrices of past latent observations, inputs, and scheduling features, then use an LQ factorization to project the large data coefficient matrix into a fixed-dimensional coordinate system. The model preserves scheduling-conditioned dynamics while making rollout cost independent of the number of training trajectories.
Useful7/10
Difficulty6/10
Novelty6/10
✗ Failed on benchmark
2026
Design distributed training workers so checkpoint service is anonymous: every active writer receives a throughput determined only by the current number of active writers, not by worker identity, age, or phase. For identical compute periods and checkpoint durations shorter than the period, this removes pairwise phase attraction and prevents deterministic checkpoint synchronization; controlled timing jitter can then be added when rapid phase mixing is desired.
Useful7/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Attach a small robust quadratic-program layer to a neural controller. The network proposes an action, and the QP returns the closest action satisfying an ISS Lyapunov decrease constraint and a robust safety-barrier constraint under bounded model disturbances. This should preserve the network's behavior away from constraint boundaries while preventing unstable or unsafe actions near those boundaries.
Useful7/10
Difficulty5/10
Novelty5/10
✗ Failed on benchmark
2026
Modify a recurrent message-passing GNN so that every propagation step adds fresh independent Gaussian noise to every node and feature channel. Unlike dropout or a one-time perturbation, the noise remains active throughout the recurrence and creates a nonzero stationary graph-frequency energy floor, preventing long-horizon node representations from converging to the constant-node subspace.
Useful7/10
Difficulty4/10
Novelty5/10
✗ Failed on benchmark
2026
Replace unconstrained neural-network updates by updates projected toward directions supported by a recent, regularized gradient or feature subspace. This transfers PRPC's errors-in-variables correction: directions that are weakly identified by noisy or rank-deficient minibatches receive stronger shrinkage, preventing large updates caused by accidental correlations. The method is especially suitable for recurrent, world-model, and small-data fine-tuning problems where minibatch covariance is…
Useful7/10
Difficulty6/10
Novelty6/10
✗ Failed on benchmark
2026
Replace a static batch size with a schedule optimized for a prescribed learning-rate schedule and a fixed total number of processed examples. Steps whose stochastic-gradient noise has a large effect on the paper's loss bound receive larger batches, with the weighting determined by the future learning-rate tail rather than by a hand-designed warmup or cooldown rule.
Useful7/10
Difficulty5/10
Novelty5/10
✗ Failed on benchmark
2026
Construct the sparse transition matrix and input projection of a recurrent or state-space layer so that every hidden-state row is covered by a matching in the controllability core. This prevents hidden directions from becoming unreachable from the input sequence, especially in multi-input systems and across a distribution of transition matrices or task conditions.
Useful7/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Represent a hybrid trajectory with one neural module per known dynamical phase rather than a single network spanning all phases. Feed the predicted terminal state of phase r directly as the initial state of phase r+1, so continuity is satisfied by construction instead of by a soft interface penalty. This should improve learning near abrupt changes and remove an otherwise poorly conditioned loss-weight tradeoff.
Useful7/10
Difficulty5/10
Novelty6/10
✗ Failed on benchmark
2026
Replace the unresolved small jumps of an infinite-activity stable Levy noise source in a neural SDE or stochastic optimizer with one Gaussian increment whose variance equals the discarded jump variance. Simulate only jumps above the cutoff exactly or by Poisson sampling, retaining the large-jump distribution while obtaining the paper's O(\varepsilon) Wasserstein error instead of the naive O(\varepsilon^{1-\alpha/2}) error.
Useful7/10
Difficulty5/10
Novelty8/10
✗ Failed on benchmark
2026
Construct a recurrent or state-space neural module whose latent dynamics are initialized from a mechanistic approximation of the target system rather than from an isotropic random matrix. For traffic-like interacting systems, use a graph reservoir with car-following-inspired relative-position and relative-velocity terms, drive it with undersensed observations, and train a linear or low-rank readout. The mechanism preserves nonlinear state encoding while enforcing an echo-state contraction…
Useful7/10
Difficulty6/10
Novelty6/10
✗ Failed on benchmark
2026
Replace an unconstrained image denoiser or refinement block by a gradient step on an input-convex neural potential. The resulting map has a verifiable nonexpansiveness guarantee when the potential is convex and its gradient is sufficiently smooth, reducing error amplification across repeated applications and making the module safer under distribution shift.
Useful7/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Attach a probabilistic reachable-set head to a neural world model so that long-horizon predictions produce both a mean trajectory and an uncertainty envelope. Train or calibrate the model using the probability that the predicted envelope intersects an unsafe region, allowing early-warning losses to penalize risk before an actual violation appears. The transferable signature is a predictable monotone increase in warning probability as the reachable set approaches or intersects a forbidden set.
Useful7/10
Difficulty6/10
Novelty5/10
✗ Failed on benchmark
2026
Encode a continuous or sampled multivariate time series as degree-N log-signatures on m local intervals, choosing (m,N) to minimize the number of stored scalars under an explicit linear-CDE approximation budget. Unlike fixed-size temporal patches, the representation increases temporal resolution when the path is oscillatory and increases algebraic degree when the path is smooth but strongly nonlinear.
Useful7/10
Difficulty5/10
Novelty6/10
✗ Failed on benchmark
2026
Replace a Markovian recurrent update with an MPS-valued temporal influence state that couples adjacent pairs of memory sites, mimicking the paper's CDU3 two-column construction. The hidden state retains structured correlations across multiple past time steps while computation remains linear in sequence length and polynomial in the bond dimension, rather than exponential in the memory horizon.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Attach a model-free critical-slowing-down monitor to hidden states, actions, residuals, or losses generated by a recurrent neural controller or state-space model. When the monitored dynamics show increasing variance and lag-one autocorrelation, reduce the controller gain or optimizer learning rate, increase damping, shorten the rollout horizon, or switch to a fallback policy before the neural system reaches an unstable regime.
Useful7/10
Difficulty4/10
Novelty7/10
✗ Failed on benchmark
2026
Replace ordinary graph convolution with a Markov diffusion whose edge transition probability is proportional to a geometric distance weight d(v,u)^(n−2), following the paper's Delaunay discretization theorem. Use graph Dirichlet capacity on expanding node shells to detect whether information escapes through the graph or repeatedly returns to local neighborhoods, and use this signal to select propagation depth or add a regularizer.
Useful7/10
Difficulty6/10
Novelty7/10