Unverified
2026
Replace a dense token or state-mixing matrix with an inverse-capacitance operator whose couplings decay with graph distance, while introducing trainable heterogeneous diagonal capacitances to break spatial symmetries. The layer is cheap because the capacitance matrix is sparse and banded, but its inverse produces global responses with controllable locality.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Replace fixed sparse masks with a stochastic birth-death process for neural connections or spatial units. A diffusing morphogen-like utility field controls where connections are added or removed, while a local simple-point test rejects removals or additions that would disconnect a layer or alter a prescribed computational topology. This creates an adaptive sparse architecture with a tunable compact-to-branched transition rather than unconstrained magnitude pruning.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Replace the usual independently normalized MoE router scores with a small system of tropical inequalities controlling expert load, score margins, and capacity slack. Each inequality induces a local max-plus policy selecting its currently dominant expert or constraint; policy improvement detects positive-weight cycles that would cause oscillatory routing and applies the smallest bias correction that removes them. This provides a non-differentiable but cheap controller around the router…
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Use the paper's mode decomposition to choose between ordinary DIGing and augmented ATC-DIGing/AugDGM according to the communication spectrum and curvature. The augmented scheme changes the disagreement feedback gain mode by mode, which can reduce the dominant pole radius on well-connected graphs without changing the neural-network architecture.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Condition a temporal neural network on a tempo or dilation ratio through a homomorphism from multiplicative positive scales to additive latent shifts. A ratio composed from several scale changes then produces the sum of their learned effects, allowing interpolation and extrapolation to rates absent from training instead of using an independent embedding per rate.
Useful6/10
Difficulty4/10
Novelty5/10
Unverified
2026
Replace one-shot softmax expert routing with a small number of synchronous routing rounds in which each token resamples an expert with probability proportional to that expert's current load raised to a power \(\alpha>1\). The resulting positive feedback rapidly creates a dominant routing basin, potentially reducing the number of active experts and communication groups at inference while retaining a controllable exploration phase through the initial round or a token-specific score factor.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Train identical Q-networks on multiple agents using local TD statistics and communicate only through periodic multi-step consensus. Within each epoch, agents perform local updates and then apply L mixing rounds to the vector of Q-values, TD targets, or parameter deltas; choose L so that the residual disagreement is below the stochastic estimation error. The method targets communication reduction at fixed sample efficiency, especially when N agents collect experience in parallel.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Use a symmetric positive-definite, non-diagonal mobility matrix to couple updates of parameter groups, analogous to drag-modified Onsager mobility coupling ionic species. Estimate local block curvature and select the learning rate from the generalized spectrum of mobility times curvature, targeting rapid loss decay without the instability of aggressively scaled diagonal optimizers.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Construct a sparse routing or graph-neural architecture whose activation gates satisfy a hard-core constraint: neighboring sites, experts, or token groups cannot be active simultaneously. Compare the same local routing rule on bipartite and random regular interaction graphs; the graph structure should change the maximum usable activation dimension and may also change optimization stability.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace ordinary graph propagation, which repeatedly revisits the edge it just traversed, with a directed-edge non-backtracking operator. Normalize its learned gain using an estimate of the Hashimoto spectral radius so that feature magnitudes neither explode on high-growth graphs nor vanish on sparse graphs.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Give each query-token pair a positive adaptive edge weight that evolves by a multiplicative rule instead of relying only on instantaneous dot-product attention logits. Edges whose aggregate interaction is useful can grow, while overloaded or incompatible neighborhoods can shrink. Sparse initialization is preserved because an edge initialized at zero remains zero under the multiplicative dynamics.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace independent binary early-exit or token-pruning decisions with a monotone randomized survival process for each token or expert route. A token can lose survival mass at each layer but cannot become active again; the model is trained with a reflected obstacle-style penalty that activates when the predicted value of continuing computation is below the value of stopping plus the compute cost. Mean-field statistics are computed over currently surviving tokens, making routing less sensitive to…
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Replace a conventional softmax router or fixed halting score with a scalar confidence state that evolves as a bounded martingale diffusion. The state starts at the network's prior confidence, receives evidence-dependent stochastic increments, and is absorbed at 0 or 1; absorption selects an MoE expert or halts additional transformer blocks. State-dependent volatility lets the model explore aggressively when uncertain and commit rapidly when confident, while the martingale constraint prevents…
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Compose independently parameterized neural dynamical modules through power-preserving skew coupling instead of equality penalties or projected constraints. This creates a modular graph or world model in which information exchanged between modules is antisymmetric, so internal coupling cannot create or destroy total latent energy.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Replace deterministic or softmax-only mixture-of-experts routing with a Dirichlet-distributed routing vector and train two independently sampled routing replicas for each token. Penalize excessive replica collision, or adapt the Dirichlet concentration so that routing diversity remains in a prescribed regime. The mechanism comes from the random-environment result that the second moment of a path probability is controlled by the collision local time of two independent replicas.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Augment every graph or set token with a positive learned mass M_i that controls how strongly it contributes to other nodes and evolves through a growth-minus-inhibition equation. Use separate learned interaction kernels for state transport and mass inhibition, while retaining a directed interaction matrix so the layer is not forced to be permutation-symmetric or conservative.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Treat periodic update bursts from distributed training workers or parameter blocks as oscillator phases, and use a shared adaptive compute or learning-rate cap to create deliberately phase-repulsive coupling. When aggregate demand is high, throttle workers currently near their compute peak and preferentially release workers in low-demand phases, spreading communication and gradient-update bursts instead of allowing them to lock together. The controller should be disabled or retuned when its…
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace an O(N^2) kernel-density interaction in a particle neural SDE or diffusion sampler with a clipped, randomly shifted histogram density estimate. Feed the local estimated density into the particle drift as a multiplicative gain, preserving density-dependent dynamics while evaluating all particles through occupied-cell hashing in expected O(N) time for fixed dimension and number of shifts.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
Use the paper's prediction-relaxation decomposition to build a pipelined optimizer in which workers compute local proximal or gradient predictions as soon as parent messages arrive, then apply independently tunable relaxation to primal and dual states. This provides a controlled alternative to undamped stale updates and can overlap communication with local computation.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace or augment a residual neural layer with a Fourier-domain scale-selective flow containing a learned second-order term and a fourth-order stabilizer. The block permits controlled low-frequency amplification, as required by the KS infrared mechanism, while damping high-frequency feature noise and preventing unbounded spectral growth.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace purely instantaneous routing in a balanced hierarchical MoE or adaptive-computation tree with a sublinear visit-count reinforcement term. Small reinforcement produces broad exploration of experts, whereas reinforcement above the condensation threshold deliberately creates a persistent core of frequently used experts while retaining slow discovery of new experts.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace ordinary row-degree or symmetric normalization in a directed graph neural network with a nonlinear Dyson scaling. For a nonnegative directed adjacency matrix A, solve a positive vector equation and propagate with B = D A D, where D is the diagonal matrix of the solution. The resulting operator has row sums strictly below one, giving an explicit bound against exploding directed message propagation while retaining asymmetric edge information.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace a standard softmax MoE router with a thermodynamic router whose expert occupations maximize entropy subject to a prescribed total routing mass and mean routing energy. At high temperature, traffic is distributed across many experts; as temperature decreases or the energy budget tightens, traffic undergoes a predictable condensation transition in which excess load moves to the lowest-energy expert or expert group. This supplies an explicit control knob for adaptive specialization instead…
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace a parameter-heavy recurrent transition, or use this as a fallback, with a two-parameter nearest-neighbor successor blend in latent space. Given a query latent state, retrieve the closest state from an in-context trajectory and combine the query, the retrieved state, and its observed successor; this gives a zero-shot dynamical forecast with almost no trainable transition parameters.
Useful6/10
Difficulty4/10
Novelty5/10