✗ Mechanism failed
2026
Treat a recurrent or state-space network as a locally linear dynamical system and select a small set of hidden-state or module coordinates that have unusually high leverage on a target output through a dominant unstable or weakly damped eigenmode. Use the ranking both for red-team targeted perturbations and for defense: penalize, prune, or damp selected coordinates so that target amplification is reduced without uniformly shrinking all recurrent dynamics.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Mechanism failed
2026
Require Lyapunov decrease not only under the nominal learned transition, but throughout a bounded uncertainty set around that transition. The policy is therefore optimized against identification error and distribution shift rather than trusting a potentially overconfident world model.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Mechanism failed
2026
Add a bounded colored exploration force to an optimizer by filtering a sum of independent two-state telegraph signals through a stable linear relaxation equation. Unlike Gaussian momentum noise, the perturbation has a strict amplitude bound and a tunable finite correlation time, reducing rare destructive parameter excursions while retaining structured exploration.
Useful7/10
Difficulty4/10
Novelty7/10
✗ Mechanism failed
2026
Add a state-dependent stochastic reset to a neural-network parameter vector, optimizer state, or recurrent hidden state. The reset hazard is weak at large displacement but has the marginal inverse-square scaling that produces a predicted power-law excursion distribution and a sharp transition between localized training and runaway parameter drift.
Useful7/10
Difficulty5/10
Novelty8/10
✗ Mechanism failed
2026
Constrain a set of learnable or batch-produced unit-norm embeddings by matching their spherical-harmonic power spectrum to a target spectrum rather than relying only on pairwise Euclidean repulsion. This creates an explicit, tunable mechanism for suppressing low-frequency density fluctuations or enhancing a selected angular frequency, which can improve uniformity and reduce representation collapse on hyperspherical embeddings.
Useful7/10
Difficulty5/10
Novelty7/10
✗ Mechanism failed
2026
Build a recurrent or state-space network from heterogeneous dynamical modules and characterize each module through sampled frequency-response passivity and Davis–Wielandt shell bounds. Constrain inter-module coupling so that the composed frequency response retains a positive passivity margin, providing a model-based alternative to blindly shrinking all recurrent weights.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Mechanism failed
2026
Replace AdamW's single exponentially decaying second-moment accumulator with a small bank of accumulators whose combined impulse response approximates fractional relaxation. The resulting preconditioner remembers rare or old gradient directions with a power-law rather than geometric decay, which may improve optimization on nonstationary, sparse-gradient, or long-horizon problems.
Useful7/10
Difficulty4/10
Novelty6/10
✗ Mechanism failed
2026
Treat stochastic optimization with a time-dependent learning-rate, momentum, weight-decay, or data-mixture schedule as a nonautonomous Markov process. Estimate the entropy production of each parameter trajectory by comparing its forward transition likelihood with the likelihood under a separately simulated optimizer driven by the reversed schedule, then use this estimate to adapt the learning rate or injected gradient noise. The controller is designed to remain in a low-dissipation regime…
Useful7/10
Difficulty6/10
Novelty8/10
✗ Mechanism failed
2026
Use a convex uncertainty region over latent item scores to select the next ranked-list query, rather than training separate pairwise preference predictors. Sort the centroid of the current region to obtain a proper ranking; every returned pairwise counterexample intersects the region with a halfspace and removes a constant fraction of its volume under the centroid-cut guarantee. This provides an active-learning procedure for preference models, reward models, or ranking heads that remains…
Useful7/10
Difficulty6/10
Novelty7/10
✗ Mechanism failed
2026
Replace Euclidean momentum for selected neural parameters with a mirror or Bregman update, while using the paper's accelerated Newton direction for the objective step. Entropy geometry is especially suitable for softmax MoE routers, while Euclidean or log-barrier geometries can be used for unconstrained or positive parameters.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Mechanism failed
2026
Build a recurrent or state-space model with a base state carrying task-relevant dynamics and an explicitly contracting auxiliary state. If the training loss or energy depends on the auxiliary state, replace it by a quotient loss plus an analytically known telescoping correction; long-run optimization and invariant averages are then unchanged, while transient fiber effects decay geometrically.
Useful7/10
Difficulty5/10
Novelty8/10
✗ Mechanism failed
2026
Attach a Gaussian condition discriminator to an intermediate neural representation and train it adversarially against the fault classifier. The discriminator predicts both the mean and uncertainty of a continuous operating condition, forcing the encoder to remove condition-dependent variation without treating the condition as a small set of artificial domains.
Useful7/10
Difficulty4/10
Novelty5/10
✗ Mechanism failed
2026
Replace a fixed-noise Langevin optimizer with one that estimates the response of a training observable to a matched perturbation of the optimizer drift and noise, then adjusts damping and temperature to satisfy the finite-time fluctuation-response relation. The observable can be minibatch loss, validation loss, or a gradient projection, while the perturbation is a small controlled change in the corresponding update drift. This provides an online noise schedule and a falsifiable calibration…
Useful7/10
Difficulty6/10
Novelty7/10
✗ Mechanism failed
2026
Apply the paper's distance-to-stabilization concept to the Jacobian of a recurrent or state-space neural layer. Estimate the smallest channel-wise diagonal perturbation that makes the local hidden-state dynamics contractive, then penalize models whose estimated radius is below a target margin.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Mechanism failed
2026
Replace fixed random Fourier features in a coordinate network or PINN with a small complex Fourier dictionary whose propagation directions are learned from a weighted residual. Given directions, solve the linear feature coefficients exactly or by ridge regression, and optimize only the directions in the outer loop. This should represent low-directional-complexity fields with fewer features and avoid wasting gradient updates on coefficients that can be fitted analytically.
Useful7/10
Difficulty5/10
Novelty6/10
✗ Mechanism failed
2026
Attach a deterministic supervisory automaton to a neural policy or sequence model and mask every event disabled by the current supervisor state. Use a short receding-horizon planner over admissible events to resolve conflicts between neural preferences and shared-resource constraints. The network scores useful actions, while the automaton supplies an exact safety layer.
Useful7/10
Difficulty5/10
Novelty6/10
✗ Mechanism failed
2026
Choose the neural operator's input-history length from the measured correlation time of the unresolved closure signal produced by coarse-graining. This avoids under-memory, which causes systematic closure error, and over-memory, which increases attention cost and can destabilize training. The same diagnostic can drive adaptive memory truncation across physical regimes.
Useful7/10
Difficulty4/10
Novelty7/10
✗ Mechanism failed
2026
Add a numerical-health monitor that distinguishes genuine contraction or chaos from finite-precision periodicization. It tracks hidden-state recurrence, effective cycle length, and the divergence between single-rollout and independent-restart Lyapunov estimates, then triggers precision escalation, rollout truncation, perturbation, or training early stopping when the diagnostic enters the recurrence-collapse regime.
Useful7/10
Difficulty5/10
Novelty8/10
✗ Mechanism failed
2026
Train a neural controller or latent dynamics model together with a finite abstraction whose cells and successor relations are optimized using a smooth reverse-simulation surrogate. Penalizing concrete-to-abstract mismatch should suppress locally inconsistent or overly expansive latent transitions, while a separate reachability containment check preserves soundness. This creates a verification-aware training signal that targets spurious branching rather than only one-step prediction error.
Useful7/10
Difficulty6/10
Novelty8/10
✗ Mechanism failed
2026
Use the paper's self-normalized martingale bound to monitor cumulative stochastic gradient noise in covariance-whitened coordinates. Convert its time-uniform confidence boundary into a trust-region multiplier: retain the normal optimizer update while the observed noise is within the boundary, and shrink or clip the update after an exceedance.
Useful7/10
Difficulty5/10
Novelty6/10
✗ Mechanism failed
2026
Make a neural network predict a vector potential rather than a magnetic or velocity field, then obtain the physical vector field with a fixed differentiable discrete curl. The reconstructed field satisfies the discrete divergence-free constraint exactly, eliminating divergence-penalty tuning and preventing constraint drift during long rollouts.
Useful7/10
Difficulty4/10
Novelty5/10
✗ Mechanism failed
2026
Add an auxiliary prescribed-performance observer to a recurrent or state-space neural network so that latent prediction errors are estimated from observable output residuals rather than relying only on backpropagation through long histories. The observer uses a transformed normalized innovation and gains that change with the desired error envelope, allowing fast early correction without permanently using a large unstable gain. It can operate online during inference or provide an auxiliary…
Useful7/10
Difficulty5/10
Novelty7/10
✗ Mechanism failed
2026
Use critical-slowing-down statistics from the delayed dynamical system to detect when training approaches an oscillatory instability. Rising lag-one autocorrelation and variance, together with a recovery-rate estimate approaching zero, trigger a learning-rate or momentum reduction before loss divergence occurs.
Useful7/10
Difficulty3/10
Novelty5/10
✗ Mechanism failed
2026
Distill a teacher's attention into a student by matching sink mass and the normalized content distribution as separate targets rather than applying one KL divergence to the entire attention row. Use the Aitchison distance on the content composition, which compares relative token allocation and prevents a large common sink probability from overwhelming differences between content tokens.
Useful7/10
Difficulty3/10
Novelty7/10