✗ Failed on benchmark
2026
Use the Gaussian mass of the local inward tangent cone to construct an analytic score target for noisy points lying within O(\sigma) of a support boundary or corner. This prevents a score network from learning an incorrect full-manifold or Euclidean approximation in the region where diffusion sampling is most sensitive to support truncation.
Useful7/10
Difficulty6/10
Novelty6/10
△ Mechanism confirmed, baseline not beaten
2026
Add conformal prediction sets for every action of a contextual policy, then select the action maximizing its worst-case utility over the corresponding set. Calibrate the sets using the outcome generated by this same max-min policy, rather than calibrating each action independently; this directly targets reliable utility under deployment decisions.
Useful7/10
Difficulty5/10
Novelty7/10
✓ Mechanism works
2026
Search for a compact symbolic optimizer instead of selecting among fixed AdamW-like formulas. Encode optimizer programs as token sequences, learn a continuous variational representation of those sequences, and use a Gaussian-process Bayesian optimizer to propose promising update rules based on short neural-network training rollouts.
Useful7/10
Difficulty6/10
Novelty6/10
✗ Failed on benchmark
2026
Add a fractional Laplacian penalty to neural functions over binary inputs so that high-order coordinate interactions are damped according to \(|S|^\alpha\), rather than treating all Fourier degrees equally. The penalty is estimated with random continuous-time bit-flip perturbations, requiring only extra forward passes and no explicit Fourier transform. It is especially suited to models that overfit through high-order Boolean interactions while retaining useful low-order structure.
Useful7/10
Difficulty4/10
Novelty8/10
✗ Mechanism failed
2026
Construct a sparse attention layer by sampling backward token histories as a continuous-time branching process rather than allowing every query to attend to every key. Each active ancestor either dies or branches into a bounded number of candidate ancestors, with branching probability controlled by a small parameter. The branch-out penalty predicts exponentially small probability of long, highly branching histories, providing a direct knob for receptive-field size and attention FLOPs.
Useful7/10
Difficulty5/10
Novelty7/10
✗ Mechanism failed
2026
Train a conditional generator or set-valued predictor so that stochastic target refinements preserve the barycentric representation required by the source while allowing valid target-side diversity. The regularizer discourages collapse of multiple legitimate outcomes to one point without treating mean-preserving spread as semantic misalignment.
Useful7/10
Difficulty4/10
Novelty7/10
Audited (legacy)
2026
Replace independent per-action distributional value heads with a critic whose shared latent particle produces a vector of return samples for all actions simultaneously. Train the predicted joint return vector against a Bellman target vector formed from coupled counterfactual reward-transition samples, using a sliced Wasserstein loss. The greedy action is selected by the mean of the corresponding marginal particles, while shared particles retain cross-action dependence for learning and…
Useful7/10
Difficulty6/10
Novelty7/10
✓ Mechanism works
2026
Replace an unconstrained nonlinearity on hyperbolic pairwise similarities with a function from the paper's exact Lorentz–Gram preserver family. The transformed similarity matrix remains realizable as Lorentz inner products of future-directed unit timelike vectors, allowing a network to sharpen or smooth hyperbolic neighborhoods without introducing geometrically impossible pairwise relations.
Useful7/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace an unconstrained attention or MoE routing matrix with a row-stochastic matrix that preserves a learned Gibbs-like distribution over groups. Anneal its temperature so that the router converges to a block-upper-triangular operator: mixing remains flexible within equal-energy groups, while cross-group traffic becomes directional rather than oscillating or collapsing. This creates a hierarchy-aware inductive bias and can reduce the number of active expert or attention connections.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Use the paper's multiplicative spectral law to initialize a recurrent or state-space transition matrix as a deterministic operator multiplied by a unitarily invariant random factor, then choose the factor scale so the predicted complex eigenvalue support lies near a target stability annulus. This directly targets long-horizon gradient preservation instead of relying only on singular-value normalization.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Replace a Gaussian regression likelihood with a chart-pulled exponential-family head. The network predicts a natural parameter eta, while each target y is mapped to a bounded probability coordinate u=G(y). Because the sufficient statistic T(u) is bounded, extreme targets cannot create arbitrarily large parameter gradients. The chart determines the tail class, while eta controls the distribution in probability space.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Replace a single-coordinate GP surrogate used for expensive neural-network hyperparameter trials with a finite bank of input-warped kernels. Each trial may select whichever warp currently gives the most promising upper-confidence acquisition, including after observing all previous results, while confidence parameters are enlarged to account for the finite library. This should recover the benefits of log-scaled or localized geometries without committing to one hand-designed parameterization.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Treat the correlation decay exponent and Hermite rank as explicit hyperparameters controlling the roughness of the depth-wise residual trajectory. Use smoother long-memory drivers for stable deep propagation and less correlated drivers when optimization needs more layer-wise diversity, while retaining critical scaling so the network does not collapse to the identity.
Useful6/10
Difficulty5/10
Novelty8/10
Unverified
2026
For bandlimited or progressively higher-frequency targets, construct a nested random Fourier layer whose frequency window grows according to the paper's bandwidth laws instead of sampling all frequencies from one fixed range. Train with a low-bandwidth subset first, then activate additional frequency blocks. This creates a mathematically motivated spectral curriculum and may reduce early optimization difficulty while preserving high-frequency accuracy.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace a scalarized multi-task loss with an adaptive projected update that chooses a regularized convex combination of task gradients at every step. The combination is conservative when task gradients conflict, while the regularization is adapted from the actual projected step length rather than from loss values or a line search.
Useful6/10
Difficulty5/10
Novelty5/10
Unverified
2026
Add a regularizer that rewards balanced farthest-prototype cells in an embedding space. For each query and random triple of prototypes, compute which prototype is farthest, estimate the three label probabilities over queries, and maximize their Shannon entropy to discourage prototype domination and representation collapse toward a radial direction.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Replace instantaneous confidence-based routing with a temporal conjunction: enable a learned policy only if its probability and recoverability estimates satisfy their thresholds at every one of the last \(K\) observations. This suppresses brief optimistic critic errors and can wrap RL actions, diffusion trajectories, or MoE expert selection.
Useful6/10
Difficulty3/10
Novelty5/10
Unverified
2026
Replace a dense Gaussian random-feature layer by a sparse Poisson-chaos layer with the same learned kernel, and penalize the layer's normalized fourth add-one energy. The penalty suppresses rare single-atom jumps, so the sparse layer approaches the Gaussian same-kernel representation in Wasserstein distance while preserving computational advantages from sparse Poisson sampling.
Useful6/10
Difficulty6/10
Novelty8/10
Unverified
2026
Replace independent softmax routing or attention normalization with a differentiable approximate distribution over one-to-one assignments, using the Bethe permanent as the partition-function surrogate. Constrain the allowed token-to-expert or query-to-key support graph to have high girth, which gives an explicit bound on the approximation error and reduces short-cycle-induced correlations.
Useful6/10
Difficulty6/10
Novelty6/10
Unverified
2026
Replace direct optimization of noisy simplex-valued mixture or MoE gate weights with a fixed number of EM responsibility updates. The finite iteration count acts as an implicit reverse-KL regularizer toward the uniform gate distribution, preserving low-frequency experts without selecting an arbitrary entropy coefficient.
Useful6/10
Difficulty4/10
Novelty4/10
Unverified
2026
Replace one global gradient-clipping threshold with an example- or parameter-block-specific threshold derived from the local metric complexity of its stochastic gradient process. High-complexity examples receive stronger clipping or downweighting, while locally simple examples retain more of their useful gradient signal.
Useful6/10
Difficulty6/10
Novelty5/10
Unverified
2026
Replace the fixed delay in a temporal layer with a distribution of physically structured delays induced by uncertain transport velocity. The layer aggregates features arriving at several travel times and can use the deterministic mean-velocity path during most training steps, periodically correcting it with stochastic samples.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Treat the empirical hidden-state distribution of a recurrent or state-space model as a Wasserstein-space state and estimate the linearized pushforward operator on perturbation vector fields. Penalize tangent modes whose estimated transfer gains exceed one, while retaining near-unit fixed modes that represent robust invariant distributional structure.
Useful6/10
Difficulty6/10
Novelty7/10
Unverified
2026
Equip a neural tracker with an explicit discrete posterior over candidate latent states, or approximate that posterior with particles or an ensemble, and monitor both its spread and its distance from the target or delayed supervision signal. Under likelihood-temperature misspecification, use the paper's two failure modes as a controller: flatten an overconfident posterior that is localized at the wrong state, while increasing observation trust when the posterior is diffuse but evidence is…
Useful6/10
Difficulty5/10
Novelty7/10