△ Mechanism confirmed, baseline not beaten
2026
Insert channelwise normalization whose mean and variance are pooled over the full sequence, allowing a small-receptive-field convolutional labeler to access global sequence statistics without adding dilated convolutions or attention. Use this only for tasks where labels occur in long runs or depend on coarse global composition; retain per-position normalization for tasks requiring strict locality.
Useful7/10
Difficulty3/10
Novelty5/10
△ Mechanism confirmed, baseline not beaten
2026
Train one prompt-conditioned controller to solve a distribution of stochastic control tasks directly from the control objective, instead of generating an optimal trajectory dataset for every task. Use the probability-flow velocity to evolve particles deterministically, evaluate running and terminal costs on those particles, and backpropagate through the rollout to learn a reusable operator.
Useful7/10
Difficulty6/10
Novelty6/10
✗ Mechanism failed
2026
Choose the neural operator's input-history length from the measured correlation time of the unresolved closure signal produced by coarse-graining. This avoids under-memory, which causes systematic closure error, and over-memory, which increases attention cost and can destabilize training. The same diagnostic can drive adaptive memory truncation across physical regimes.
Useful7/10
Difficulty4/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Approximate the exact event-by-event lifted sampler by drawing independent Poisson jump counts over a short interval and applying compatible discrete moves in parallel. This converts sequential neighbor events into batched GPU-friendly updates while retaining the Hamiltonian rate structure; the step size controls the error-versus-throughput tradeoff.
Useful7/10
Difficulty5/10
Novelty8/10
✗ Failed on benchmark
2026
Replace independent categorical proposals or reversible Metropolis updates for discrete latent variables with a lifted sampler carrying persistent continuous edge momenta. Neighbor transitions are biased by the momentum and use a symmetric energy factor, so momentum reversal gives the required balance relation for the target Gibbs distribution while ordinary dynamics remain non-reversible. This should reduce random-walk behavior when sampling multimodal categorical latents or token sequences.
Useful7/10
Difficulty6/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Replace simultaneous parameter updates with sequential block updates whose order is selected using estimated cross-block sensitivity. The paper shows that sequential policy updates can have a substantially smaller local contraction factor than decoupled or differently ordered updates; the neural analogue is to order attention, normalization, backbone, and head blocks according to the spectral radius of their composed update map.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Replace a dense Haar or Gaussian random projection with a streamed product of random two-coordinate rotations followed by coordinate subsampling. The transform is exactly orthogonal before subsampling, requires only a list of rotation triples, and the paper's pseudo-mixing result predicts that degree-two statistics relevant to norm preservation and Johnson–Lindenstrauss embeddings become Haar-like after only O(n polylog(n)) rotations.
Useful7/10
Difficulty4/10
Novelty5/10
✗ Failed on benchmark
2026
Replace the Euclidean Polyak step in an optimizer with a mirror-descent step whose length is chosen by projecting onto the current affine lower-bound halfspace in Bregman geometry. This permits entropy geometry for simplex-valued router probabilities, log geometry for positive parameters, and other mirror maps without reducing the method to a norm-based learning-rate rule.
Useful7/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Replace the raw gradient step for a neural-network parameter block with a proximal quasi-Newton step, using the proximal operator to enforce nonsmooth constraints or structured regularization and an adaptive linesearch that enlarges the stepsize after several successful iterations. The method should permit much larger steps than conservative monotone backtracking while retaining a residual-decrease safeguard near unstable regions.
Useful7/10
Difficulty5/10
Novelty6/10
△ Mechanism confirmed, baseline not beaten
2026
Use the estimated distance to a saddle-node ghost as an inference-time controller for recurrent or neural-ODE computation. Far from a fold, take large integration steps or update only the fast state; near the fold, reduce the step size or allocate extra recurrent evaluations because the state is expected to linger and become sensitive to small parameter changes.
Useful7/10
Difficulty5/10
Novelty8/10
△ Mechanism confirmed, baseline not beaten
2026
Construct a nonuniform diffusion timestep grid from an empirical local discretization-error density instead of using uniform time spacing or a fixed hand-designed schedule. The optimal allocation places shorter intervals where the score or posterior mean varies rapidly and longer intervals in regions where the reverse vector field is smooth.
Useful7/10
Difficulty4/10
Novelty6/10
✗ Failed on benchmark
2026
Replace explicit zero-padding before FFT convolution by the paper's mixed-radix decomposition, which injects zeros through bounded tile sums and never allocates the padded input. The resulting transform is mathematically identical to the length-M transform of the explicitly padded signal, while reducing temporary storage and potentially memory bandwidth.
Useful7/10
Difficulty7/10
Novelty6/10
✗ Mechanism failed
2026
Replace fixed-parameter unrolled Douglas–Rachford iterations in a differentiable convex optimization layer with a causal controller that adapts relaxation and objective-drive strength from the current residuals. The controller should accelerate early progress while enforcing admissible parameter ranges, so every individual block remains a stable relaxed splitting map rather than an unconstrained learned optimizer.
Useful7/10
Difficulty5/10
Novelty6/10
✓✓ Beats tuned baseline
2026
Introduce a periodic modulation of the local linearized training or inference dynamics and choose its frequency and amplitude using spectral stability measurements. In the slow regime, stability should be predicted by the time average of the instantaneous rightmost eigenvalue; in the fast regime, periodic modulation may suppress growth through a noncommuting, high-frequency Floquet correction even when individual instantaneous Jacobians are unstable.
Useful7/10
Difficulty6/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Use the paper's structure-exploiting primal-dual active-set strategy to solve barrier-constrained neural updates without invoking a generic quadratic-program solver at every step. The active constraints identify which layers or state statistics are actually close to instability, while warm-started multipliers and active sets should make the safety correction nearly constant-cost when the training trajectory changes smoothly.
Useful7/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Insert a linear Johnson–Lindenstrauss bottleneck around a set of jointly processed representations, choosing its width from the sharp finite-set dimension bound rather than from the model's nominal hidden size. The projection should preserve pairwise distances between tokens, patches, or retrieved items, allowing a downstream attention or MLP block to operate at lower width while retaining the geometry relevant to similarity computations.
Useful7/10
Difficulty5/10
Novelty5/10
✗ Mechanism failed
2026
Replace a dense random projection used before retrieval, classification, or expert routing with a publicly reproducible matrix generated by a Pisot beta-transformation orbit. Search over a small public seed and sampling gap to select one matrix that preserves the calibration set's pairwise distances, then freeze it for training and inference. The projection removes random-matrix storage and makes the same embedding transform exactly reproducible across servers or proof systems.
Useful7/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Use trajectory sensitivities to remove neural units or parameter groups whose effects are redundant over the available data support. A parameter group is pruned when its Fisher contribution is small or its sensitivity is nearly collinear with other groups, producing a compact neural ODE without relying only on parameter magnitude.
Useful7/10
Difficulty5/10
Novelty8/10
△ Mechanism confirmed, baseline not beaten
2026
Treat a neural-network training run as a time-dependent dynamical system and define scalar late-time features that distinguish convergent, oscillatory, noisy, and divergent regimes. Instead of exhaustively sweeping a two-dimensional hyperparameter grid, continue the threshold curve of a feature in the learning-rate/weight-decay or learning-rate/noise plane using a secant predictor and one-dimensional correction sweep. This produces an automatically updated stability map and can be used to keep…
Useful7/10
Difficulty4/10
Novelty7/10
✗ Mechanism failed
2026
Use the distance-matrix filtration of a sequence embedding as a cheap proxy for state-space persistent homology, and map its persistent recurrence cycles into explicit latent-space loops. Train a recurrent, state-space, or Transformer encoder so that important recurrence cycles have geometrically coherent trajectory paths rather than being artifacts of isolated pairwise returns. This avoids building a Vietoris-Rips complex over every latent window while retaining a mathematically controlled…
Useful7/10
Difficulty5/10
Novelty7/10
✗ Mechanism failed
2026
Replace many independently equilibrated SGLD runs at different hyperparameters with one controlled sweep in which an auxiliary drift transports particles through the stationary distributions indexed by the swept parameter. Estimate the response of loss, predictions, uncertainty, or weight observables using covariance with the stationary generalized-potential derivative instead of finite differences between separate runs.
Useful7/10
Difficulty7/10
Novelty7/10
✗ Mechanism failed
2026
Replace dense cross-attention weights with a balanced transport plan whose nonzero query-key edges are maintained by a multiscale active-set procedure. Solve the coarse token-group problem first, lift its support to the fine token grid, add only edges indicated by local cost or marginal residuals, and warm-start the fine problem from the lifted plan. This should provide a principled sparse attention pattern rather than fixing a global top-k pattern before seeing the transport solution.
Useful7/10
Difficulty7/10
Novelty6/10
△ Mechanism confirmed, baseline not beaten
2026
Replace multiplicative query-key attention scores with an affinity based on the l1 distance between first-spike latency vectors. For each query token and key token, small latency differences produce large affinity and distant timings decay exponentially, yielding a locality-sensitive attention pattern naturally compatible with leaky spiking neurons.
Useful7/10
Difficulty5/10
Novelty7/10
△ Mechanism confirmed, baseline not beaten
2026
Build a neural operator around explicit input and output measurement spaces rather than forcing the network to consume and emit a fixed grid. The same learned latent surrogate can be reused on alternative sensor layouts or query meshes through reconstruction and re-encoding maps, with a consistency loss enforcing agreement between measurement pipelines.
Useful7/10
Difficulty6/10
Novelty5/10