Unverified
2026
Replace a standard softmax MoE router with a thermodynamic router whose expert occupations maximize entropy subject to a prescribed total routing mass and mean routing energy. At high temperature, traffic is distributed across many experts; as temperature decreases or the energy budget tightens, traffic undergoes a predictable condensation transition in which excess load moves to the lowest-energy expert or expert group. This supplies an explicit control knob for adaptive specialization instead…
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace a hand-tuned reward penalty in black-box policy optimization with the paper's clipped augmented Lagrangian, using separate adaptive multipliers and penalty coefficients for safety, robustness, and performance constraints. This is especially suitable for neural policies optimized with evolutionary strategies when simulator gradients are unavailable or unreliable.
Useful6/10
Difficulty4/10
Novelty4/10
Unverified
2026
Wrap a nominal gradient-based optimizer with a diagonal sign matrix that flips updates independently for parameter blocks, while a scheduler tests candidate sign configurations using short-horizon decrease of a Lyapunov-like training energy. The wrapper never changes the magnitude of the nominal update, and when the effective sign pattern is constant, it should recover the behavior of the correctly oriented nominal optimizer after a finite search period.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Replace a generic recurrent transition by an exactly periodic unitary base transition plus a learnable weak Hermitian perturbation. The resulting \(\tau\)-step macro-dynamics approximates a continuous-time unitary flow, allowing the model to preserve signal norms while learning slowly varying long-range transformations.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Assign separate sharpness or temperature parameters to two nonlinear subnetworks and anneal them according to a directional chart instead of driving both to their singular limits at the same rate. The optimizer explicitly tracks the ratio of the two scales and changes the schedule when the local Jacobian approaches a stability or bifurcation boundary. This tests whether the order and relative rate of sharpening, rather than only the final activation shape, controls optimization stability and…
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Augment a recurrent or state-space neural network with an explicit delayed hidden-state channel and monitor the linearized delay spectrum around the zero or operating-point state. Use the paper's antiperiodic resonance equations to predict when oscillatory hidden modes should appear, then either avoid those parameter regions for stable sequence prediction or deliberately target them for periodic-memory tasks.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace mean-only readout from a noisy recurrent or Langevin reservoir by concatenating empirical first, second, and fourth raw moments of each hidden coordinate. The second and fourth moments retain input-dependent width and tail information generated by nonlinear confinement, while multiple independently initialized reservoirs can be concatenated before the final linear classifier to preserve complementary features.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace a fixed Adam update by an embedded Bogacki–Shampine RK3(2) proposal with a genuine accept/reject controller. Measure error between the two actual Adam parameter maps, rather than only between raw gradient estimates, and charge every gradient evaluation against the training compute budget.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Replace a single recurrent state with two coupled one-dimensional latent chains whose relative alignment is periodically shifted during inference. Ferromagnetic coupling preserves locally coherent patterns, while controlled sliding produces a nonequilibrium friction effect that can make global magnetization substantially longer-lived than in a static noisy chain. The shift velocity acts as a measurable memory-control parameter rather than an unconstrained architectural hyperparameter.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Replace the plain fixed-point iteration of an implicit neural layer with nonlinear GMRES residual minimization over a short history of iterates. Use the measured residual reduction from each least-squares problem to increase depth when acceleration is effective, and restart or reduce depth when the predicted gain disappears.
Useful6/10
Difficulty5/10
Novelty4/10
Unverified
2026
When a network learns coordinates q on a homogeneous space from symmetry-generated vector fields, enforce that the predicted Jacobian is compatible with all generator equations using augmented-matrix consistency residuals. This turns the paper's rank and minor criterion into a differentiable regularizer that prevents locally contradictory coordinate derivatives and can produce more stable equivariant representations.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Replace the single arbitrary autodiff derivative at a piecewise-smooth interface with a sampled conservative-field gradient envelope. For each minibatch and parameter point, collect gradients from locally reachable branches, average them as a convex combination, and use the resulting direction in a stochastic update. This is intended for architectures with routing, clipping, hard masks, or custom continuous branching where ordinary autodiff can select an unstable branch.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Treat each neural-network block as a local strength system and measure how perturbations in its input channels affect multiple output observables, rather than using a single gradient norm. Use the estimated maximum directional gain to cap residual updates or assign a layerwise learning-rate multiplier, preventing weak high-gain layers from destabilizing training while allowing strong layers to move faster.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace an unconstrained recurrent memory with a truncated path-signature state that is updated continuously from the input control path. Feed this structured state to a learned vector field, allowing the model to represent path-dependent dynamics through iterated integrals of the entire history rather than only the latest hidden state.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Replace a fixed or heuristic noise-annealing schedule with one constrained by the FPU freeze-out scaling. In stochastic gradient Langevin dynamics, reduce the injected temperature slowly enough that residual parameter fluctuations remain below a target floor; if cooling is too fast, the optimizer should retain a measurable nonequilibrium variance analogous to the FPU residual energy.
Useful6/10
Difficulty4/10
Novelty7/10
Unverified
2026
Constrain the transition matrix of an RNN or linear state-space model to the paper's class Cρ instead of controlling only its spectral radius or spectral norm. The resulting transition has an explicit dilation certificate and satisfies ∥T^n∥ ≤ ρ for every time horizon, preventing exploding hidden states while retaining nonnormal dynamics that ordinary spectral normalization may remove.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Add an entropy-Lyapunov consistency term to a recurrent or state-space model whose learned dynamics are intended to reproduce a chaotic invariant distribution. The regularizer targets the equality condition h_mu(f) = sum_i max(lambda_i, 0), while a dominated-splitting diagnostic determines whether the theorem assumptions are approximately plausible instead of blindly forcing equality.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Replace the memoryless parameter update with a discrete generalized Langevin update whose friction kernel is a positive mixture of decaying modes generated or scheduled by a Loewner driving process. Inject correlated gradient noise using the same kernel, implementing the paper's fluctuation-dissipation mechanism instead of choosing momentum and noise independently. The method is intended for noisy minibatch training, where controlled colored noise can preserve exploration while suppressing…
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Replace or augment an RNN or state-space model hidden state with coordinates on a bounded 3-step nilpotent group. The first layer stores ordinary features, the second layer stores pairwise commutator memory, and the third layer stores nested commutators that can preserve three-time dependencies invisible to first- and second-order summaries. Layered reduction keeps the state bounded while retaining the algebraic interaction structure.
Useful6/10
Difficulty7/10
Novelty8/10
Unverified
2026
Treat consecutive optimizer updates as a discrete dynamical system and monitor the dominant local multiplier of the parameter-update map. When an estimated real multiplier approaches -1, apply damping or reduce the learning rate, because the paper's mechanism predicts the onset of an alternating period-2 orbit before ordinary divergence is visible.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace a dense token-mixing matrix in a sequence model with a fixed or learnable SBP derivative operator D=P^{-1}Q. The discrete integration-by-parts identity makes the interior mixing energy-neutral or boundary-dissipative, reducing exploding activations in deep residual stacks while preserving directional information along the sequence.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Equip multiple recurrent agents with a shared spatial or token-level trail field whose influence is a bounded function of accumulated visitation, rather than an unbounded additive memory. Use the paper's simultaneous/sequential invariance as a falsifiable design target: parallel and randomly ordered asynchronous agent updates should produce nearly identical predictions when trail occupancy is saturated, while deliberately nonsaturating controls should show order dependence. This can enable…
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
When a chosen sparse support is geometrically incompatible with exact orthogonality, temporarily optimize on a nearby off-diagonally perturbed Stiefel constraint rather than forcing a singular Newton system. Anneal the perturbation to zero after the active support has stabilized, using the paper's O(||Delta||_F) KKT guarantee to control the residual of the original orthogonality-constrained problem.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Split a recurrent or state-space model into a persistent slow state and a fast internal state. Every r recurrent steps, preserve the slow state but reset or contract the fast state toward a learned reference, reproducing selective restart rather than a destructive global reset. The expected benefit is suppression of long-range oscillatory and error correlations while retaining trajectory-level information.
Useful6/10
Difficulty4/10
Novelty7/10