Unverified
2026
Replace a fixed-temperature softmax router over experts, adapters, or candidate optimizers with an exponential-weights distribution whose temperature is selected to satisfy an explicit cumulative information budget. The router reacts strongly when observed expert losses are predictable, but automatically cools down when outcomes create a large cumulant-information gap, avoiding variance-based heuristics that can be badly miscalibrated. A prior distribution over experts supplies a principled…
Useful6/10
Difficulty5/10
Novelty4/10
Unverified
2026
Approximate anisotropic diffusion in a neural operator by composing several ordered local propagation steps rather than learning one unrestricted dense attention matrix. Each directional step uses its own ordering function and bandwidth, and symmetric composition reduces the leading splitting error.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Use the localization theorem to turn a detected pointwise simulator error into a guaranteed region that must contain similarly large error, then place verification samples inside that region instead of sampling uniformly. The same bound can guide a training regularizer: errors with large amplitude and large local Lipschitz constants are penalized because they create planner-exploitable disagreement regions.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Use a window of observed neural-network update trajectories to identify the set of local quadratic objectives and preconditioners that are consistent with the observed optimizer behavior. Rather than selecting one arbitrary curvature model, retain the nullspace of compatible parameters and use its dimension or smallest singular value as an identifiability and stability diagnostic.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Apply a set-oriented graph analysis to the latent state dynamics of an RNN, SSM, or world model. Partition latent trajectories into compact cells, estimate the multivalued transition graph and its Markov matrix, then regularize the model so that recurrent latent modes form coherent strongly connected components with controlled transition entropy rather than spurious unstable wandering. This preserves meaningful metastable modes while preventing long-horizon rollout statistics from drifting away…
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace alternating descent/ascent with a single primal-dual Newton update for a constrained min-max neural-network objective. The optimizer maintains primal variables, equality multipliers, inequality slacks, and a barrier parameter, so the adversary remains feasible in the limit without hard projection and the coupled dependence of constraints on both players is represented in one linear system.
Useful6/10
Difficulty7/10
Novelty7/10
Unverified
2026
Use predictive-model uncertainty to adversarially reweight losses over nearby outcomes, with the adversarial neighborhood determined by belief entropy. The loss emphasizes geometrically plausible high-loss outcomes when the model is uncertain and automatically weakens this penalty once ensemble heads agree.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Represent an iterative neural computation as a controlled dynamical system and learn sparse residual corrections that are active only for a finite prefix of iterations. Estimate local stable and anti-stable subspaces of the hidden-state Jacobian, increase the correction horizon only while the anti-stable component exceeds a tolerance, and force later controls to zero. This produces adaptive-depth inference with a quantitative stopping criterion.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Use SPINE's nested entropy profile on the singular values of each trainable weight matrix to discover spectral bands online, rather than choosing a fixed rank or a fixed number of learning-rate groups. Assign smaller step sizes or stronger decay to dominant singular-value bands and larger step sizes to weak bands, while updating the grouping only when the entropy-boundary signal is persistent.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Introduce a binary mask over candidate neural connections or graph interactions and constrain the active subgraph to be a forest, mimicking the tree-packing configurations of the FA K=2 model. Anneal a chemical-potential parameter controlling the number of active edges; near a critical value, the mask may spontaneously favor one of two graph parities or channel groups, creating structured specialization rather than unstructured pruning.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace unconstrained latent or neural-ODE dynamics with a strict-feedback cascade whose virtual controls are generated recursively by nonadaptive backstepping. Add a fixed internal-model oscillator when the desired output contains known-frequency periodic components, so the network tracks persistent targets without learning an unstable long-memory representation. The controller is designed to tolerate bounded neural-model mismatch and disturbances through an input-to-state stability margin.
Useful6/10
Difficulty7/10
Novelty7/10
Unverified
2026
Replace the usual first-order parameter update with controlled position-velocity dynamics. The loss is the potential energy, momentum is the velocity, and a one-step rolling-horizon control minimizes the predicted next-step energy plus a control penalty, producing an explicitly dissipative correction that can be applied only through a low-rank or blockwise control operator.
Useful6/10
Difficulty5/10
Novelty4/10
Unverified
2026
Replace a learned dense recurrent transition with a truncated lowest-weight \(\mathrm{su}(1,1)\) ladder acting on hidden coordinates indexed by \(n=0,\ldots,N-1\). The ladder coefficients create a nonuniform, analytically specified coupling that grows with state index, while a negative \(J_0\) term supplies controllable dissipation and the skew combination \(J_+-J_-\) supplies conservative mixing.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace a conventional momentum update by a damped second-order trajectory with a configuration-dependent dense kinetic metric. Evolve two phase-space copies using symmetric split orderings, project both copies exactly back to their averaged physical state, and apply exact friction half-steps so momentum decay remains stable at large step sizes.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Attach two oscillator channels to each recurrent, state-space, or graph hidden unit and convert them into a phase field over nodes or spatial positions. Encode every overlapping triple of neighboring phases as one of the 13 weak ordinal patterns, including seven near-tie patterns, then use the resulting normalized entropy and pattern frequencies to detect hidden-state collapse, coherent clustering, or transient regime changes. During training, either use the entropy only as a controller for…
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Construct a contractive multi-branch recurrent or generative network whose branches define an iterated-function system, and regularize it so that branch entropy is high relative to average contraction while compositions remain exponentially separated. The target is a measurable attractor-dimension law rather than only a benchmark improvement: the invariant measure dimension should approach min(d, H divided by chi), where d is state dimension.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace an unconstrained message-passing or recurrent propagation matrix by a directed-edge operator with non-backtracking connectivity and orientation-dependent turning phases, inspired by the Kac–Ward construction. During training, monitor and control the zero-momentum spectral gap of \(\mathcal A(0)=I-K(0)\), keeping the model near but on the stable side of the critical surface to obtain long memory without uncontrolled amplification.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Augment a neural-network update with an auxiliary, damped stochastic branch that acts like the paper's floating dissipative reservoir. A trainable mixing phase \(\phi\) combines the task-gradient branch and auxiliary branch; \(\phi\) is adapted to make the auxiliary response to a chosen control perturbation nearly zero while retaining a finite task-gradient response. The intended benefit is selective insensitivity to nuisance hyperparameters or perturbations, with a measurable response peak…
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Train a threshold-reset recurrent network to suppress dependence on unresolved excitatory/inhibitory arrival order. Penalize states that fall in the paper's order-sensitive firing interval, or augment training with excitatory-first and inhibitory-first counterfactuals and enforce consistent outputs.
Useful6/10
Difficulty4/10
Novelty8/10
Unverified
2026
Treat a small activation, gradient, or parameter perturbation as a seed and measure the number of newly affected downstream units or layers. Use the estimated branching ratio to control the optimizer step size or residual gains, keeping training in a subcritical regime where perturbation cascades have finite expected size instead of amplifying through the whole network.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Construct a neural residual block as a composition of positive-time flows from two learned vector fields, rather than one unconstrained residual update. Add a learned Lie-bracket correction channel so that the block can cancel leading noncommutative splitting errors without using negative coefficients. The resulting block has a tunable effective integration order while preserving forward-time behavior for dissipative dynamics.
Useful6/10
Difficulty7/10
Novelty7/10
Unverified
2026
Replace unconstrained or entropy-regularized MoE routing with a minimally disruptive update that preserves a lower bound on the log-determinant of the experts' weighted output span. The router still tracks the desired mixture, but a projection prevents the active experts from becoming linearly redundant or collapsing onto a low-rank subset.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Treat parameter optimization as a controlled dynamical system with a known nominal update and an unknown residual caused by minibatch noise, changing curvature, and optimizer-state mismatch. Fit a Gaussian process to the observed residual acceleration and subtract its posterior mean from the next update, with a confidence gate that suppresses compensation when posterior variance is large.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Use Halpern iteration to solve a non-expansive neural equilibrium layer from temporally correlated samples, and estimate its stochastic operator with a PAGE-style refresh/difference estimator. The anchor supplies a vanishing but explicit stabilizing force, while same-state differences reuse consecutive Markov samples and should reduce the number of full oracle evaluations required for a target fixed-point residual.
Useful6/10
Difficulty6/10
Novelty7/10