Unverified
2026
Inject Stratonovich transport noise into intermediate spatial feature maps instead of adding independent elementwise Gaussian noise. Choose divergence-free vector fields whose covariance is approximately isotropic, so the corresponding Itô correction acts like a tunable Laplacian and preferentially suppresses unstable high-frequency feature components.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Regularize a neural attention or routing distribution according to how quickly it mixes toward a specified graph-dependent target, instead of penalizing only entropy or one-hop variation. The regularizer discourages pathological concentration on isolated graph regions while still allowing meaningful local structure, because concentration is judged after several graph-constrained Metropolis-Hastings steps.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Replace mean-only readout from a noisy recurrent or Langevin reservoir by concatenating empirical first, second, and fourth raw moments of each hidden coordinate. The second and fourth moments retain input-dependent width and tail information generated by nonlinear confinement, while multiple independently initialized reservoirs can be concatenated before the final linear classifier to preserve complementary features.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace a single recurrent state with two coupled one-dimensional latent chains whose relative alignment is periodically shifted during inference. Ferromagnetic coupling preserves locally coherent patterns, while controlled sliding produces a nonequilibrium friction effect that can make global magnetization substantially longer-lived than in a static noisy chain. The shift velocity acts as a measurable memory-control parameter rather than an unconstrained architectural hyperparameter.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Replace an unconstrained recurrent memory with a truncated path-signature state that is updated continuously from the input control path. Feed this structured state to a learned vector field, allowing the model to represent path-dependent dynamics through iterated integrals of the entire history rather than only the latest hidden state.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Replace a fixed or heuristic noise-annealing schedule with one constrained by the FPU freeze-out scaling. In stochastic gradient Langevin dynamics, reduce the injected temperature slowly enough that residual parameter fluctuations remain below a target floor; if cooling is too fast, the optimizer should retain a measurable nonequilibrium variance analogous to the FPU residual energy.
Useful6/10
Difficulty4/10
Novelty7/10
Unverified
2026
Use deadline objectives to train or control a router that explicitly trades off completion probability against completed work by a fixed horizon. Begin with fair allocation for robust exploration, then anneal toward a feedback-greedy rule once per-item difficulty estimates have sufficient evidence.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace the memoryless parameter update with a discrete generalized Langevin update whose friction kernel is a positive mixture of decaying modes generated or scheduled by a Loewner driving process. Inject correlated gradient noise using the same kernel, implementing the paper's fluctuation-dissipation mechanism instead of choosing momentum and noise independently. The method is intended for noisy minibatch training, where controlled colored noise can preserve exploration while suppressing…
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Equip multiple recurrent agents with a shared spatial or token-level trail field whose influence is a bounded function of accumulated visitation, rather than an unbounded additive memory. Use the paper's simultaneous/sequential invariance as a falsifiable design target: parallel and randomly ordered asynchronous agent updates should produce nearly identical predictions when trail occupancy is saturated, while deliberately nonsaturating controls should show order dependence. This can enable…
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Split a recurrent or state-space model into a persistent slow state and a fast internal state. Every r recurrent steps, preserve the slow state but reset or contract the fast state toward a learned reference, reproducing selective restart rather than a destructive global reset. The expected benefit is suppression of long-range oscillatory and error correlations while retaining trajectory-level information.
Useful6/10
Difficulty4/10
Novelty7/10
Unverified
2026
Add a response-sensitive regularizer to networks whose outputs should react predictably to a control input, using the stationary Markov sensitivity equation as a certificate. Instead of only penalizing large neural gradients, the method attributes amplification to the generator resolvent and can distinguish amplification caused by a nearly slow latent mode from amplification caused by uncontrolled parameter growth.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Turn a sparse expert layer into a stochastic birth-death population. Each expert receives a bounded fitness score from recent routed-token performance; at each update, a candidate expert is activated with probability p, while one expert is removed with probability q = 1 - p, preferentially removing the lowest-fitness expert. The paper's critical threshold f_c = q/p predicts which fitness levels can maintain a growing surviving population, providing a principled control knob for expert turnover.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Distill a large or accurate latent transition model into a smaller discrete-state recurrent model while penalizing both its one-step transition mismatch and its lack of contraction. The filtering perturbation bound predicts that reducing the Dobrushin coefficient prevents errors from accumulating over long sequences, while reducing the transition discrepancy lowers the irreducible steady-state error.
Useful6/10
Difficulty4/10
Novelty7/10
Unverified
2026
Treat a stochastic optimizer as a Markov transition kernel and monitor its contraction on mean-zero observables using singular values, which remains meaningful for non-reversible momentum dynamics. Adapt optimizer hyperparameters online to maximize an empirical singular-value gap, suppressing oscillatory modes that can have small eigenvalue gap but poor transient relaxation.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Use the paper's singular stopping-gain term to explicitly measure how much learned feature covariance crosses a max or routing boundary. Penalize excessive covariance in the normal direction to the switching surface, rather than pretending that the max operation has an ordinary Hessian.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace independent uncertainty heads in a branching neural network with a structured variational posterior whose non-root node distributions condition on jointly sampled latent states of all parents. This allows collider evidence to explain away upstream uncertainty: evidence at a child can alter the posterior over several parent branches instead of leaving their uncertainties artificially independent. The approach can be implemented as a stochastic DAG network and trained with an evidence…
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Model a finite training run as a driven stochastic process whose control parameter is the learning rate or another scheduled hyperparameter. Compare the distribution of parameter perturbations, activations, logits, or losses after a finite-rate update to a reference distribution generated by a much slower approximately adiabatic schedule; reduce the learning rate when the estimated relative entropy exceeds a calibrated threshold.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Replace a conventional leaky recurrent update with a population of stochastic membrane potentials that evolve only while subthreshold, emit an event at threshold, undergo a delayed reset, and receive feedback from a filtered population firing rate. Add a shared noise source alongside independent neuron noise to regularize the layer while preserving coordinated population-level dynamics.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Build the diffusion drift as a contractive linear term plus a spectrally controlled residual, so trajectories are pulled toward a state-dependent center while retaining nonlinear expressivity. This directly targets the paper's sharper one-sided dissipative regime rather than hoping that ordinary weight decay produces dissipativity.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Attach a quantitative upper bound to the probability that noisy parameter updates enter a predefined unsafe region during training. Use the bound to select a minimum burn-in time or reduce Langevin noise once the transient term is small, preventing the failure mode in which the final stationary distribution is safe but the training trajectory temporarily swells into the unsafe set.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Represent a rare transition in a neural latent space by a controlled path whose drift is optimized directly, instead of obtaining it by reversing the relaxation dynamics. Learn a state-dependent mobility or diffusion matrix so that the sampler allocates noise and control effort according to the local stochastic geometry. This should improve generation of low-probability transitions in nonequilibrium world models and reduce the number of failed trajectories.
Useful6/10
Difficulty6/10
Novelty5/10
Unverified
2026
Augment a neural router with the age of its current expert or latent regime and use an age-dependent hazard to determine when switching is likely. Unlike ordinary token-wise softmax routing, the router can learn non-geometric residence times, suppressing unstable expert oscillations while still allowing rapid transitions when the current regime becomes inappropriate.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace iid dropout or iid activation noise on spatial tokens with fluctuations generated by a conserved diffusing density. Each token receives a positive mass variable whose total mass is preserved, while Poissonian stochastic flux produces correlated perturbations that explore coherent local patterns rather than independently corrupting every feature. The density is autonomous and detached from autograd, so the regularizer adds little computational overhead.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Use the paper's mean and variance dynamics to control exploration in a population of neural-network adapters. Estimate local reward curvature from the current candidates, then choose mutation strength so selection contracts diversity only when the reward landscape is locally reliable. Increase diffusion when reward noise or selection causes population collapse.
Useful6/10
Difficulty6/10
Novelty7/10