Unverified
2026
Construct a mixture-of-experts layer whose experts compete for a normalized routing resource, and regularize the router so that every expert can grow when introduced at low abundance into the equilibrium dominated by any other expert. The ecological mutual-invasibility criterion becomes a quantitative anti-collapse condition: if expert B has positive invasion growth against expert A's equilibrium and A has positive invasion growth against B, neither single-expert state is locally stable against…
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Use multilevel sensitivity of the global interaction margin to identify which neural block, connection, or parameter group is responsible for instability. This provides a targeted alternative to uniformly shrinking the learning rate or regularizing every layer.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Build a latent dynamical model from learned vector-field generators and scalar state-dependent gates, while explicitly preserving the derivation and Lie-bracket identities of a Lie-Rinehart algebra. The model should be tested both with exact automatic differentiation and with a separately predicted tangent/JVP head; in the latter case, the identities become useful training constraints rather than tautologies.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace an unconstrained repeated averaging or message-passing operator by an average of positive isometric group actions whose mixing distribution satisfies the paper's bounded angular ratio condition. The resulting operator is Ritt, giving a mathematically certified bound on successive iterates and convergence of repeated application. This can stabilize deep equivariant stacks and reduce oscillatory feature dynamics.
Useful6/10
Difficulty4/10
Novelty7/10
Unverified
2026
Train the output layer on a fast timescale and the hidden feature layer on a slow timescale, so output coefficients first fit the components representable by the current features before hidden directions move. Use residual plateaus to detect when the fast subsystem has approximately equilibrated, then increase the hidden-layer learning rate to begin the next feature-learning stage.
Useful6/10
Difficulty4/10
Novelty5/10
Unverified
2026
Treat a stochastic optimizer as a Markov transition kernel and monitor its contraction on mean-zero observables using singular values, which remains meaningful for non-reversible momentum dynamics. Adapt optimizer hyperparameters online to maximize an empirical singular-value gap, suppressing oscillatory modes that can have small eigenvalue gap but poor transient relaxation.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Use multiple independently initialized training replicas to detect discontinuous transitions in the learned state as a hyperparameter changes. A saddle-node event is identified when two locally stable or unstable solution branches collide, producing an abrupt jump in a validation-relevant order parameter; pseudo-arclength continuation can map this event and choose a hyperparameter path that avoids catastrophic branch loss.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Replace activation-magnitude-based adaptive computation halting with a criterion based on the actual recurrent update and a local stability margin. The loop halts when the state change is small relative to state scale for several consecutive steps, avoiding pathological decisions when LayerNorm-driven dynamics cause the activation norm to collapse.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Add a functional-calculus regularizer to the transition operator of an RNN, linear state-space model, or deep-equilibrium layer. The regularizer uses polynomial probes to detect non-normal transient amplification that ordinary eigenvalue-radius penalties can miss.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Construct a hybrid neural ODE from several smooth vector-field branches and select the active branch using a learned Hamiltonian-like score. Track a positive-definite matrix representing local tangent sensitivity and force its discrete evolution to be positive semidefinite, adapting the paper's monotone Jacobi-curve condition to neural dynamics.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Turn a recurrent or state-space memory into a constrained hereditary state: the latent state remains in a learned convex domain, and only input motion that reaches the boundary changes the plastic component. This creates a nonexpansive, rate-independent memory that should suppress unstable state growth and make the representation depend on meaningful cumulative changes rather than arbitrary update frequency.
Useful6/10
Difficulty4/10
Novelty5/10
Unverified
2026
Use midpoint or running ergodic averages of adversarial iterates for evaluation and checkpointing instead of exposing a single phase-dependent iterate. The mathematical attenuation factor suppresses rotational error, especially for modes with large step-size-times-frequency product.
Useful6/10
Difficulty2/10
Novelty4/10
Unverified
2026
Augment each token or graph node with a periodic latent position x_i and phase θ_i, then evolve these variables before attention or message passing. Tokens with similar phase attract in x, while tokens with similar position synchronize in θ, producing self-organized groups without an externally specified clustering objective. The coupling strengths J and K provide interpretable controls for aggregation and synchronization, and their sweep should expose the paper's four collective regimes and…
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Replace the unconstrained parameter update of a selected neural layer by a tangent update generated by a rank-two skew-symmetric operator. A Cayley transform then applies this operator while exactly preserving a quadratic parameter energy, preventing exploding or vanishing layer norms without projecting after every step. Add a separately trained scalar gain if fixed norm would otherwise reduce expressivity.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Model a finite training run as a driven stochastic process whose control parameter is the learning rate or another scheduled hyperparameter. Compare the distribution of parameter perturbations, activations, logits, or losses after a finite-rate update to a reference distribution generated by a much slower approximately adiabatic schedule; reduce the learning rate when the estimated relative entropy exceeds a calibrated threshold.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Replace a conventional leaky recurrent update with a population of stochastic membrane potentials that evolve only while subthreshold, emit an event at threshold, undergo a delayed reset, and receive feedback from a filtered population firing rate. Add a shared noise source alongside independent neuron noise to regularize the layer while preserving coordinated population-level dynamics.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Use a symplectic Hamiltonian update as a recurrent or state-space neural block, preserving a learned modified energy across many layers or time steps. This targets residual and recurrent architectures where ordinary Euler updates accumulate drift during long rollouts.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Augment neural-network parameters with momentum variables and update the pair using a symplectic map generated by a Hamiltonian. The optimizer approximately preserves a modified Hamiltonian, reducing systematic energy drift and potentially making long unrolled optimization more stable.
Useful6/10
Difficulty4/10
Novelty4/10
Unverified
2026
For risk-sensitive or recursive objectives, add a separate network that predicts the conditional certainty equivalent of the next-state continuation value, rather than forcing the value network to approximate a nested nonlinear expectation directly. Train the value, policy, and certainty-equivalent heads with Bellman and first-order residuals jointly.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Modify learning-rate or annealing schedules so that local improvement is not mistaken for convergence when different parameter blocks occupy incompatible global modes. Measure a local-consistency score and a global-coherence score separately; slow training whenever local consistency is high but global coherence remains low, allowing competing parameter domains to merge before cooling further.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Insert a differentiable intersection-body-inspired map on positive spherical feature fields. The map contracts high-order angular variation while leaving degree-two ellipsoidal structure neutral, providing a principled alternative to generic smoothing that does not erase global anisotropy.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Use the M phase-aligned parameterizations produced by cyclic reformulation as an empirical ensemble of neural dynamics rather than selecting one phase or averaging only predictions. Their centroid supplies a nominal model, while their convex hull defines a low-dimensional uncertainty set used for robust rollout training and uncertainty-aware inference.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Add a slow latent two-state gate to a recurrent, state-space, or world-model network so that separate experts represent two qualitatively different dynamical regimes. Train the gate using the paper's two-state population and fluctuation mechanism rather than allowing an unconstrained softmax to average incompatible regimes. The model should allocate extra capacity near the gate's susceptibility peak, where regime uncertainty and forecast variance are predicted to be largest.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Use sign choices over redundant gradient or adapter proposals to keep the accumulated residual update small in the coordinatewise maximum norm. Constrain the sign controller to preserve a positive projection onto the desired descent direction, so it suppresses coordinate spikes without completely canceling optimization progress.
Useful6/10
Difficulty6/10
Novelty7/10