✗ Failed on benchmark
2026
Add a non-autoregressive continuation layer to an RNN, SSM, or world model that predicts a future trajectory by solving for coefficients of a library of past trajectory windows and reusing those coefficients on the corresponding future windows. Unlike nearest-neighbor retrieval, the coefficients interpolate across multiple behaviors and can generalize to unseen systems whose output-visible eigenvalues are represented in the library.
Useful8/10
Difficulty5/10
Novelty6/10
✗ Failed on benchmark
2026
Attach a streaming contraction monitor to a recurrent, state-space, or neural-ODE model and permit long-horizon rollout or autonomous deployment only when a conservative estimated contraction certificate is positive. The monitor estimates local Jacobian growth from recent state-transition observations and subtracts an uncertainty radius, preventing operation in regimes where apparent stability is caused by insufficient or noisy data.
Useful8/10
Difficulty5/10
Novelty6/10
✗ Failed on benchmark
2026
Replace unconstrained residual updates with blocks whose Jacobian is monitored through a Davis–Wielandt shell. The shell simultaneously measures directional dissipation and non-normal amplification, yielding a per-block step-size or residual-scale bound that is stronger than checking only the largest eigenvalue or spectral norm.
Useful8/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Train a neural ODE or continuous-time recurrent model directly against STL robustness, while requiring the resulting trajectory tube to satisfy the specification for every initial hidden state in a bounded set. Differentiable robustness provides an optimization objective, and interval, zonotope, or other set-based reachability provides a post-update certificate that prevents success caused by a narrow nominal trajectory.
Useful8/10
Difficulty6/10
Novelty8/10
✗ Failed on benchmark
2026
Replace the standard CFG guidance multiplier in each DDIM step by a coefficient obtained from the terminal guided exponent. Given unconditional and conditional denoiser-derived states D_u and D_c, use r^{1+w}-r instead of w(r-1) on the guidance direction D_u-D_c; this preserves the same two denoiser calls and costs no additional NFE while suppressing low-noise residual blow-up at high guidance.
Useful8/10
Difficulty3/10
Novelty8/10
✗ Failed on benchmark
2026
Replace uniform minibatch sampling by a fixed-size determinantal point process whose similarity matrix is a diffusion kernel on the training-data k-NN graph. The sampler repels nearby or redundant examples while preserving multiple diffusion modes, so a small batch should cover intrinsic data geometry and provide lower-variance estimates of losses and gradients.
Useful8/10
Difficulty6/10
Novelty5/10
✗ Failed on benchmark
2026
Replace an unconstrained recurrent or state-space update with a block whose state Jacobian is contractive and whose input Jacobian has a controlled gain. This should make hidden-state discrepancies caused by initialization, quantization, or input noise decay geometrically rather than explode, while retaining a finite and predictable response to persistent input perturbations.
Useful8/10
Difficulty5/10
Novelty5/10
✗ Failed on benchmark
2026
Compress each hidden layer by retaining directions that are simultaneously reachable from the observed input distribution and observable at the network output. Unlike PCA or SVD, the retained subspace is weighted by downstream task sensitivity, so high-variance but output-irrelevant directions can be removed while low-variance predictive directions are preserved.
Useful8/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Augment a flow-matching or diffusion sampler with a dual variable for each equality constraint and integrate the sample and dual variables as one coupled ODE. The learned generative velocity is corrected in the constraint-normal direction using the transpose Jacobian of the constraint, while the dual state accumulates residual violations; this replaces per-step projection or nonlinear optimization.
Useful8/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Compress a trained wide analytic-activation MLP by fitting a narrow same-depth student to the teacher's function values and input derivatives, rather than matching only outputs on a calibration dataset. Choose the student width from the input dimension and target error, with a target scaling m = O((log(1/epsilon))^d_in), and use sequential layer fitting plus channel reweighting to limit error accumulation through depth.
Useful8/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Use the paper's certified-well geometry to turn continuous localization into a cheap grid proposal stage followed by fixed-step refinement. Threshold the projection-residual score on a coarse grid, then run a bandwidth-calibrated gradient map only from accepted points and merge converged duplicates. This avoids dense optimization from every possible coordinate and is suitable for neural slot or source heads that must return a variable number of continuous locations.
Useful7/10
Difficulty4/10
Novelty8/10
✗ Failed on benchmark
2026
Use the paper's explicit compact factor of a symplectic state-transition matrix to measure aggregate rotation speed in hidden-state dynamics. Penalize excessive or rapidly varying angular velocity rather than penalizing the full recurrent matrix, preserving nontrivial Hamiltonian rotations while suppressing phase drift that can destabilize long sequences.
Useful7/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Replace an unconstrained token mixer or feed-forward residual map with a feature-conditioned rational operator whose transfer matrix is positive real on the positive orthant. Apply it through a resolvent, rather than an additive residual, so that the accretivity certificate yields a nonexpansive implicit update and suppresses activation explosions.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Replace independent residual-block parameters by a stationary correlated sequence and set the residual multiplier according to the sequence's long-memory exponent and Hermite rank. This preserves a nontrivial O(1) input-output transformation as depth grows, while avoiding activation explosion or identity collapse caused by inappropriate residual scaling.
Useful7/10
Difficulty6/10
Novelty8/10
✗ Failed on benchmark
2026
Train a low-dimensional projection of embeddings against centered pairwise geometry instead of only using raw-distance preservation or a JL-style guarantee. The loss removes the population or minibatch distance baseline before comparing distances, forcing the bottleneck to retain the fluctuations that carry ranking and task information.
Useful7/10
Difficulty4/10
Novelty6/10
✗ Failed on benchmark
2026
Train a recurrent neural network or state-space model using a Poincare-style event loss: identify two consecutive latent alignment events and require the latent position and velocity at the second event to equal a transformed version of the first. Evaluate the Jacobian of this return map and penalize unstable non-neutral Floquet multipliers, producing long-horizon trajectories that are both periodic or symmetry-periodic and locally stable.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Use explicitly stochastic latent dynamics to detect hidden-state changes that are invisible in the observed output spectrum. Near the integral-memory regime, constrain or monitor cross diffusion with a forward-versus-reverse path statistic, preventing output-equivalent latent models from developing physically implausible irreversible dynamics.
Useful7/10
Difficulty6/10
Novelty8/10
✗ Failed on benchmark
2026
Replace ordinary row-softmax attention with a doubly stochastic Sinkhorn attention plan W, and periodically recover a gauge-fixed pairwise cost from W using the exact double-centering identity. Use this recovered cost to initialize or regularize a structured attention score, making the attention geometry identifiable despite arbitrary query and key row and column offsets.
Useful7/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Replace a fixed gradient-clipping threshold or fixed optimizer trust region by a dynamic envelope that expands when proposed parameter updates are repeatedly clipped, contracts after clipping disappears, and tightens further during sustained unsaturated convergence. This transfers the paper's bidirectional modification mechanism to training while retaining an explicit safety cap on the actual parameter update.
Useful7/10
Difficulty4/10
Novelty6/10
✗ Failed on benchmark
2026
Replace random Fourier or random NTK features by a weighted deterministic quadrature rule for the kernel's feature integral. The resulting feature map uses the same linear-model interface as random features but can approximate the leading Gram-matrix eigenvalues substantially better at the same feature count, improving conditioning and reducing the width required for a target kernel approximation.
Useful7/10
Difficulty4/10
Novelty5/10
✗ Failed on benchmark
2026
Use a spectral eigenvalue-counting function to bracket each target mode before neural optimization. The network then solves only within an interval containing exactly one eigenfrequency, preventing optimization from repeatedly collapsing to the lowest mode or jumping between modes.
Useful7/10
Difficulty5/10
Novelty8/10
✗ Failed on benchmark
2026
Turn a latent recurrent model into an observer that continuously corrects its hidden state from noisy or partial observations while certifying both estimation-error convergence and disturbance attenuation. The bounded-real operator inequality becomes a trainable regularizer for a neural correction gain, providing a principled alternative to unconstrained teacher forcing or ad hoc residual correction.
Useful7/10
Difficulty7/10
Novelty7/10
✗ Failed on benchmark
2026
Augment a 1D neural operator or transformer with explicit tokens for detected discontinuities. Advance each front analytically using the local Rankine–Hugoniot speed and train the network only to reconstruct smooth regions and the residual caused by source terms and grid resolution.
Useful7/10
Difficulty6/10
Novelty6/10
✗ Failed on benchmark
2026
Represent an image or spatial latent state in an orthogonal multiresolution wavelet basis and learn the conditional distribution of detail coefficients at each scale given all coarser coefficients. At inference time, sample coarse coefficients first and recursively sample finer coefficients, using a small conditional network or a few local Langevin steps at each level instead of running a long pixel-space Markov chain. The mechanism should remove critical slowing down caused by long-range…
Useful7/10
Difficulty6/10
Novelty6/10