Unverified
2026
Replace an Erlang delay or exponential smoothing cascade in a recurrent or state-space layer by a positive rational kernel of the form \(\kappa(u)=C e^{-a u}p(u)^2\). Choose the degree-\(m\) polynomial by deleting the adjacent pair of Laguerre zeros with smallest relative gap from \(L_{m+2}\), then rescale the resulting density to unit mean. This preserves a nonnegative impulse response while reducing temporal jitter relative to Erlang filters.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Build a recurrent or state-space network with time-dependent transition parameters, but train it to forget perturbations at a common exponential rate across all admissible parameter schedules. The model should retain task-relevant long-term signals while suppressing dependence on arbitrary initial hidden states, reducing instability under changing inputs, curricula, or deployment-time dynamics.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Add a deliberately nonconservative, antisymmetric parameter-space force to ordinary gradient descent, with its amplitude controlled by an empirically estimated stability margin. The force should move parameters around elongated loss valleys instead of repeatedly descending and stopping along the same local gradient direction, while damping preserves convergence. The method directly tests whether nonzero circulation can improve traversal of flat or ill-conditioned regions without destabilizing…
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Replace the assumption that strong convexity keeps optimization inside a valid parameter chart with an explicit viability condition on the chart boundary. For Lie-group neural-network parameters or bounded latent coordinates, modify each update so its velocity has nonpositive outward radial component, using either a radial barrier or projection onto the tangent cone.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Use a fixed learned energy or score network but search over inference protocols with different mobility, temperature, and duration. Select the shortest protocol that reaches a target accuracy without exceeding a prescribed entropy-production budget, exploiting the paper's observation that computational accuracy does not uniquely determine the thermodynamic path.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Partition trainable parameter blocks into specialists that receive a fixed task or data-domain assignment and generalists that stochastically sample tasks at every update. Estimate local ruggedness from the correlation between losses at nearby parameter perturbations, then increase the generalist fraction when this correlation is low and increase specialization when the landscape is smooth. The mechanism mirrors the paper's permanent-specialist versus stochastic-generalist allocation while…
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Use the change in the policy-induced reachable set as a trust-region constraint, rather than limiting only parameter distance or KL divergence. A policy update is accepted when its predicted finite-horizon zonotope remains sufficiently close to the previous reachable tube and does not cross the safety boundary, yielding a dynamics-aware step-size ceiling.
Useful6/10
Difficulty7/10
Novelty8/10
Unverified
2026
Replace constant friction and optimizer noise with a velocity-dependent friction gamma(u) and noise amplitude tied by a fluctuation-dissipation relation. High-speed momentum states can be damped and randomized differently from low-speed states, creating controlled transient exploration while preserving a known equilibrium momentum distribution.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
For a neural stochastic state-space model or discrete diffusion sampler, monitor whether learned transition logits admit a global scalar potential on the active latent manifold. Penalize residual cycle affinities in the conditional sector, but leave reset cycles unpenalized so the model can retain useful dissipative mixing. The distinctive prediction is a linear decrease of integrability error with residual cycle current and a quadratic decrease of entropy production near autonomous…
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Add a local Jacobian spectral regularizer and an initialization sweep to steer a looped transformer away from uncontrolled near-unit dynamics. The goal is to prevent examples from entering a fold-critical regime with very long relaxation times, or alternatively to deliberately target a controlled critical regime when adaptive test-time compute is useful.
Useful6/10
Difficulty6/10
Novelty5/10
Unverified
2026
Treat a slowly varying block of neural-network parameters as a coarse-grained stochastic process and continuously estimate both its covariance spectrum and its linear response to small artificial perturbations. Use the fluctuation–response mismatch as a feedback signal to tune injected parameter noise or minibatch size; the thermal Einstein relation is imposed only when a calibrated equilibrium-like regime is desired, while antisymmetric response components are retained as admissible…
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace a conventional optimizer step by a three-phase cyclic update in which successive parameter blocks or gradient components are exposed to two low-noise phases and one high-noise, chemically driven phase. Treat the loss decrease as mechanical work, phase-dependent gradient-noise scales as reservoir temperatures, and an auxiliary drive as chemical free energy. Adapt the drive toward a target positive cycle affinity rather than increasing the learning rate indefinitely, creating a measurable…
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Replace a purely smooth momentum update by a second-order parameter dynamics with short, explicitly scheduled impulses at the beginning of each training window. The impulse is chosen to produce the required parameter displacement while the smooth gradient force handles local relaxation; this directly transfers the paper's linear-versus-quadratic short-time work mechanism.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace the usual momentum state in an optimizer with a persistent Ornstein-Uhlenbeck-driven velocity subject to a dry-friction threshold. Correlated forcing can help traverse shallow noisy regions, while the friction term suppresses parameter motion when the effective force is small, potentially reducing update noise and improving late-stage stability.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Add a small dynamical state on the transformer module graph and use it to control adaptive computation, but reject controller parameters whose discrete-time update has latent roots outside the unit disk. The state can modulate halting thresholds, residual-block gains, and memory gates; the certificate applies to the controller integrator and prevents unstable oscillations or exploding internal control signals during long adaptive-depth rollouts.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Augment an optimizer with two slowly and periodically modulated controls, such as learning rate and momentum or learning rate and gradient-noise scale. The optimizer state then traces a loop in control space; nonzero curvature can create a net parameter displacement that depends on loop orientation, even when the controls return to their initial values. Use curvature estimates to select loops that produce useful descent while penalizing loops with excessive dissipation.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Replace an unconstrained recurrent hidden-state channel with a two-dimensional oscillator constrained to the supercritical Hopf normal form. A learned control parameter can place the channel below threshold for decaying dynamics or above threshold for sustained periodic dynamics, while the cubic term bounds the amplitude and prevents recurrent-state explosion.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Treat groups of neural-network states or experts as metastable sectors and estimate both sector imbalance and inter-sector connectivity from minibatch routing or trajectory transitions. At balanced sector usage, the effective two-sector spectral splitting becomes a direct estimate of connectivity: a large splitting indicates that the sectors are still strongly communicating, whereas a small splitting indicates genuine specialization or incipient collapse into disconnected modes.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Add a temperature-response constraint to stochastic neural predictors so that changes in inverse temperature cannot produce disproportionately large changes in expected loss or energy. This converts the nonequilibrium fluctuation-response inequality into a measurable robustness monitor and a regularizer for beta-conditioned stochastic representations.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace a static MoE load-balancing penalty with a two-stage capacity allocator. First compute each expert's technically feasible token capacity from latency, memory, and overflow constraints; then redistribute capacity using cumulative proportional fairness so experts that were repeatedly under-served receive more capacity later. Constrain the redistribution by an explicit efficiency budget, so fairness cannot silently cause an uncontrolled increase in routing loss or expert compute.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Augment SGD or Adam with a short-window estimate of optimizer trajectory entropy production obtained from forward and reverse minibatch or noise paths. Reduce the learning rate when estimated dissipation rises sharply, and increase it only when dissipation remains controlled, avoiding the rare-event sensitivity of exponential work estimators.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Use the paper's product-matched uniform cycle as a tractable spectral envelope for a cyclic recurrent or state-space layer. Instead of estimating the full nonnormal generator spectrum at every update, compute its forward and backward rate products and constrain each complex eigenmode to remain inside the corresponding comparison-cycle frequency bound.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Replace a uniformly time-stepped neural ODE or state-space layer with a finite set of neural dynamical modes and an event scheduler. The hidden state follows the smooth flow of the current mode until a learned guard function crosses zero, at which point the solver evaluates the state at the event, switches mode, and continues with the new dynamics; this avoids numerical smearing of hard routing, thresholding, and switching behavior.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Add a persistent two-state force to a locally stable optimizer while retaining Gaussian minibatch or Langevin noise. In a locally quadratic basin, the parameter-error distribution should be the convolution of a compact-support run-and-tumble stationary law and an Ornstein-Uhlenbeck Gaussian. This supplies an explicit persistence and noise calibration rule instead of treating all optimizer noise as white and Gaussian.
Useful6/10
Difficulty5/10
Novelty7/10