△ Mechanism confirmed, baseline not beaten
2026
Equip a neural policy or learned world model with an MPPI-style rollout planner whose perturbation covariance is conditioned on a discretized latent-state cell and updated from observed transition residuals. Apply spatial diffusion to neighboring covariance estimates using a kernel matched to the empirical visitation distribution, so covariance adaptation is smoothing rather than an unstable independent estimate at every state.
Useful7/10
Difficulty6/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Measure how validation forecast error grows with prediction horizon and fit exponential and Mittag-Leffler models. When the Mittag-Leffler fit is decisively better, activate a fractional-memory SSM or long-memory residual branch and use its fitted effective order to set the branch's kernel decay and horizon-loss weights; otherwise retain a conventional recurrent or finite-memory branch.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Treat optimizer configurations as elements of a finite intervention poset and decompose validation loss or training traces into pure causal effects rather than raw ablation differences. The recovered second- and higher-order effects reveal whether, for example, momentum and adaptive preconditioning are complementary, redundant, or destabilizing, and can be used to select a smaller optimizer or construct a better configuration.
Useful7/10
Difficulty4/10
Novelty7/10
✓✓ Beats tuned baseline
2026
Replace ordinary randomized coordinate descent inside a least-squares neural subproblem with RPLSS's projected direction update. Each sampled parameter coordinate generates a Jacobian column, while the stored matrix P removes components already covered by previous updates; this should reduce redundant coordinate steps and improve convergence for linear heads, LoRA modules, and locally linearized fine-tuning.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Replace an opaque adaptive-optimizer state update with a small controller variable obtained by minimizing a strongly convex energy jointly associated with the proposed parameter motion. The controller is allowed to relax toward the current gradient before the parameter update, while the visible update uses the reduced energy and its envelope gradient. This creates an optimizer whose hidden geometry is optimized rather than inherited from a fixed exponential-moving-average recurrence.
Useful7/10
Difficulty6/10
Novelty6/10
△ Mechanism confirmed, baseline not beaten
2026
Generate a family of multi-objective neural-network solutions by continuation rather than training each scalarization from scratch. Starting from one converged model, predict parameter changes as the constraint threshold moves, then apply a small number of Newton or quasi-Newton correction steps to recover a nearby Pareto-optimal model.
Useful7/10
Difficulty7/10
Novelty7/10
✓✓ Beats tuned baseline
2026
Use the differentiable covariance chart to construct a Fisher-information preconditioner for the edge and innovation parameters of a linear-Gaussian neural module. Instead of applying an isotropic Euclidean update, whiten parameter steps according to how strongly they change the predicted Gaussian distribution. This targets ill-conditioning caused by redundant paths, correlated latent nodes, and badly scaled innovation covariances.
Useful7/10
Difficulty6/10
Novelty5/10
✗ Failed on benchmark
2026
Use the paper's parameterized invariant-torus residual and pseudo-arclength Newton correction to train a neural ODE across a continuous family of latent dynamical regimes. The continuation constraint allows the solver to pass through saddle-node folds, where stepping a physical control parameter alone would fail or jump to a different branch.
Useful7/10
Difficulty7/10
Novelty8/10
✗ Mechanism failed
2026
Use an online estimate of the target distribution's remaining coordinate dependence to choose diffusion step sizes instead of using a uniform timestep grid. Take large jumps when the current state is nearly coordinate-factorized and shorten the step when the denoiser detects strong cross-coordinate dependence, targeting the paper's dependence-adaptive discretization scaling.
Useful7/10
Difficulty4/10
Novelty8/10
Audited (legacy)
2026
Replace independent per-action distributional value heads with a critic whose shared latent particle produces a vector of return samples for all actions simultaneously. Train the predicted joint return vector against a Bellman target vector formed from coupled counterfactual reward-transition samples, using a sliced Wasserstein loss. The greedy action is selected by the mean of the corresponding marginal particles, while shared particles retain cross-action dependence for learning and…
Useful7/10
Difficulty6/10
Novelty7/10
✗ Mechanism failed
2026
Represent Q-values using latent coefficients and a convex reconstruction operator rather than an unconstrained linear head. Enforce that reconstruction and compression are sup-norm nonexpansive, so the approximate Bellman operator remains a gamma-contraction and cannot exhibit the usual linear-function-approximation divergence.
Useful7/10
Difficulty5/10
Novelty7/10
Unverified
2026
Use the paper's multiplicative spectral law to initialize a recurrent or state-space transition matrix as a deterministic operator multiplied by a unitarily invariant random factor, then choose the factor scale so the predicted complex eigenvalue support lies near a target stability annulus. This directly targets long-horizon gradient preservation instead of relying only on singular-value normalization.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Build a recurrent or state-space layer with fixed, spatially heterogeneous relaxation rates and measure its steady response to positive versus negative input offsets. Unlike a homogeneous linear state-space model, an individual heterogeneous realization can generate a controlled even response, allowing directional transport, asymmetric temporal context, or hysteresis-like sequence transformations without inserting an explicit quadratic input feature.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Add a separately identified constant or slowly varying force channel to a neural dynamics model, analogous to the paper's online gravity-trim and mass adaptation. This isolates persistent low-frequency prediction bias from state-dependent dynamics, reducing repeated corrective action by the planner and avoiding expensive network retraining after a systematic shift.
Useful6/10
Difficulty3/10
Novelty5/10
Unverified
2026
Attach a small, online-adapted Taylor-polynomial residual model to a neural dynamics model instead of adapting all network weights. Construct the dictionary from the local Taylor structure, remove monomials forbidden by known joint-odd symmetry, and update its coefficients with recursive least squares. This yields fast adaptation with an interpretable parameter count and a direct test of whether the assumed symmetry is valid.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Replace isotropic optimizer noise with a bounded, state-dependent temperature field along a scalar progress or basin-transition coordinate. Inject more noise when the update must climb an estimated loss barrier and less noise while descending toward a promising basin, transferring the paper's hot-uphill and cold-downhill efficiency optimum into stochastic neural optimization.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Add an explicit memory field to a recurrent or state-space model and make the memory feedback act through a discrete biharmonic operator, producing the paper’s characteristic \(z=4\) long-wavelength relaxation. This should preserve slowly varying sequence structure while damping high-frequency hidden-state noise, potentially improving long-horizon prediction without requiring a very large recurrent state.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Run an ensemble of noisy optimization trajectories and regard trajectories that return to the same loss basin as competing dynamical phases. Estimate a complex return generating function from their path costs; a near-zero of this function signals cancellation between trajectory families and predicts an abrupt change in basin occupancy. Use the signal to reduce learning rate or optimizer noise near a transition, or increase noise when one phase dominates too early.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Replace a standard recurrent or neural-CDE Euler transition with a second-order rough transition that receives both first-order increments of the input path and learned second-order branched increments. Unlike a geometric signature block, the second-order coefficients are independent learned maps rather than being forced to equal derivatives or shuffle-symmetric combinations of first-order vector fields, allowing the model to represent order-sensitive and non-geometric interactions in irregular…
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Treat discrete training events such as gradient-norm spikes, curvature changes, rejected steps, or minibatch outliers as jump channels and apply an event-specific parameter update map. The optimizer should be evaluated using both progress and the information cost of selecting the feedback map, because feedback may reduce loss fluctuations or improve adaptation without changing the average update magnitude.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Add a recurrent associative matrix to each selected transformer layer so recent key-value relationships can be retrieved without retaining every past token or performing gradient updates. The matrix uses input-dependent retention and write gates, but retrieval is always performed from the pre-write state, preventing the current target from leaking into its own prediction. Frobenius-norm clipping makes the recurrent memory bounded and provides a direct stability control.
Useful6/10
Difficulty4/10
Novelty4/10
Unverified
2026
Replace an explicit recurrent transition with a learned descriptor relation in latent space, allowing some latent coordinates to satisfy algebraic constraints rather than being numerically integrated. Fit the relation using total-least-squares or iterative PCA on the jointly observed trajectory, so noise in every channel is treated symmetrically and the model can discover whether the latent system is index-0 or index-1.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Train a neural state-space model whose one-step dynamics are linear in a fixed analytic feature vector, and use the empirical feature Gram matrix to detect whether passive trajectories identify the dynamics. Add data collection or replay only when the Gram matrix is poorly conditioned; the analytic-feature assumption predicts that persistent excitation should emerge without deliberately visiting every operating mode.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Use a decaying Tikhonov term to make inner training dynamics select a stable outer-preferred solution, and evaluate the regularized operator at a look-ahead point before updating parameters. This is intended for convex heads, adapters, equilibrium layers, or locally monotone inner objectives rather than unrestricted nonconvex end-to-end training.
Useful6/10
Difficulty5/10
Novelty6/10