△ Mechanism confirmed, baseline not beaten
2026
Add a cheap spectral gate to a state-space model or recurrent event detector that decides whether multi-step lookahead can change the threshold decision. If the learned threshold readout is approximately a nonnegative left eigenvector of the transition matrix, use the current state only; otherwise activate predictive heads and search over a small horizon. This avoids unnecessary rollout computation while preserving early-warning behavior in oscillatory or rotating dynamics.
Useful6/10
Difficulty5/10
Novelty8/10
✗ Mechanism failed
2026
Represent candidate two-dimensional attention windows as dyadic rectangles and penalize local regions where many deeply embedded windows overlap. Use complementary horizontal and vertical depth exponents rather than independently penalizing one coordinate. The resulting router should reduce pathological concentration of sparse attention computation while preserving access to multiscale context.
Useful6/10
Difficulty6/10
Novelty7/10
✗ Mechanism failed
2026
Treat a recurrent or state-space layer as a finite-state Markov cocycle and constrain optimizer steps using the paper's inverse-logarithmic sensitivity of Lyapunov exponents near a zero exponent gap. Instead of enforcing a crude spectral-norm bound, allow updates that are harmless for long-run growth while shrinking steps that could substantially change the recurrent stability profile.
Useful6/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Replace the usual hand-designed expert-load penalty with a heterogeneous survival penalty derived from a susceptibility distribution. Each expert receives an availability factor q_e=G(A_e), where A_e is its cumulative recent routing pressure and G_e is a learned or fixed mixture of exponentials; highly used experts are suppressed smoothly, while heterogeneous experts can have different resistance to pressure. The mixture produces adaptive curvature and long-tailed penalties that may reduce…
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Replace a dense weak pairwise interaction over tokens or graph nodes by an analytically resummed Gaussian quadratic term plus explicitly evaluated corrections containing only subsets of size at most R. Choose R from the target approximation error and interaction scale instead of fixing the interaction order heuristically. This is intended for dense global attention, graph interactions, or latent-variable energy models with individually small couplings.
Useful5/10
Difficulty7/10
Novelty8/10
Unverified
2026
Add asynchronous nonlinear consensus steps between local-SGD updates in a federated or decentralized system. Instead of averaging a participating client with all peers, replace one client parameter vector by the coordinatewise p-mean of neighboring replicas, allowing sparse communication and reduced sensitivity to atypical client models.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace a raw pairwise repulsion or similarity penalty on neural embeddings by a centered mean-field energy plus a Carleman–Fredholm determinant correction for finite-batch quadratic fluctuations. The correction uses the spectrum of a centered learned kernel, retaining the effect of important fluctuation directions while removing the first-order mean-field component. A Nyström or landmark approximation makes the method practical without forming a large batch-by-batch determinant.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace ad hoc Gaussian or Laplace noise injection with a Laplace majorant calibrated to the observed finite-range sub-Gamma parameters of a neural perturbation. For convex perturbation losses, the calibration guarantees that the expected loss under the scaled Laplace noise upper-bounds the expected loss under every centered random perturbation satisfying the same Bernstein-type MGF constraint.
Useful5/10
Difficulty6/10
Novelty6/10
Unverified
2026
Replace a learned linear operator by Monte Carlo averages of unitary-conjugated copies, where the conjugators are discrete time-frequency shifts sampled from a narrow phase-space distribution. The conjugation preserves the singular spectrum of each sampled operator, while the expectation penalizes sensitivity to small translations and modulations without directly shrinking the operator norm.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Replace independently random unit-normalized prototypes in a spherical classifier, vector-quantizer, or prototype contrastive head with prototypes selected to cover the sphere evenly. The method directly targets the paper's finding that weak-signal spherical K-means preserves initialization-induced Voronoi structure, reducing redundant prototypes and making early assignments less dependent on random seed.
Useful5/10
Difficulty4/10
Novelty5/10
Unverified
2026
Use the reciprocal arrangement as a probe of whether a learned representation has the intended angular response, and penalize deviations from the paper's universal beta distribution. This converts the theorem into a distribution-level regularizer rather than assuming that the reciprocal layer itself improves task loss.
Useful5/10
Difficulty4/10
Novelty7/10
Unverified
2026
Replace a static top-k MoE capacity rule with a router whose expert allocation evolves through a finite-domain coverage process. Experts with larger current occupancy can either receive more future capacity, intentionally amplifying specialization, or receive less capacity by reversing the size dependence, allowing a controlled test of the paper's asymmetry-amplification mechanism.
Useful5/10
Difficulty6/10
Novelty6/10
Unverified
2026
Represent a neural model's particle ensemble, latent samples, or routing prototypes as an empirical probability measure and penalize its Wasserstein total variation across training or inference steps. Discrete resampling and particle replacement remain allowed, but their mass-distance cost is made explicit so the model cannot obtain a cheap distributional change through untracked teleportation. A weak continuity-equation residual can be added as an auxiliary loss or used as a diagnostic.
Useful5/10
Difficulty6/10
Novelty6/10
Unverified
2026
Partition activations into dyadic magnitude bands and allocate sparse connectivity separately to heavy and diffuse coordinates. Protect high-magnitude coordinates with more reliable connections while using randomized flat connectivity for the many small coordinates, keeping the total number of nonzeros fixed.
Useful5/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace a one-step recurrent update with a causal convolution over past affine innovations using an exponential-fractional kernel. Add mean reversion and calibrate the innovation amplitude so that activation mean and variance remain approximately invariant across sequence position while retaining long-range, power-law-like memory.
Useful5/10
Difficulty6/10
Novelty5/10
Unverified
2026
Use the Gaussian approximation of a high-dimensional maximum to set a simultaneous coordinate-clipping threshold for minibatch gradients or activations. The threshold is sampled from a correlated Gaussian with the observed batch covariance, rather than treating coordinates as independent or estimating an unstable extreme quantile directly.
Useful5/10
Difficulty6/10
Novelty7/10
Unverified
2026
Add coefficient-spreading and moment-calibration mechanisms to binary or sign-noised linear layers. For each output neuron, normalize its real-valued weights and penalize large normalized coordinates, so its signed preactivation obeys the paper's quadratic Gaussian approximation rather than the weaker linear bound. This should make activation scales more predictable and reduce training instability caused by highly concentrated binary projections.
Useful5/10
Difficulty3/10
Novelty4/10
Unverified
2026
Represent each neural prediction as a finite probability distribution and project it, under an optimal-transport cost, onto the set of distributions dominated by a teacher or target distribution in convex order. This enforces a global spread and risk relationship across all convex observables rather than adding separate variance, tail, and calibration penalties. Use a periodically refreshed projection during training and test whether it improves uncertainty calibration and robustness at equal…
Useful5/10
Difficulty6/10
Novelty7/10
Unverified
2026
Construct positional or relative-position features as a nonnegative mixture of lattice cosine functions instead of independently signed sinusoidal features. The resulting bias is the Fourier transform of a positive discrete measure with explicitly bounded spectral support, while the mesh and degree can be initialized in the paper's dense-but-controlled frequency regime.
Useful5/10
Difficulty4/10
Novelty7/10
Unverified
2026
Add a regularizer that rewards each neuron's expected absolute response to random sign perturbations, normalized by the neuron's l2 norm so ordinary weight scaling cannot trivially increase the objective. Use the paper's distance-sensitive Khintchine lower bound to penalize filters close to the two-coordinate extremal set, promoting distributed and perturbation-stable feature extraction.
Useful5/10
Difficulty3/10
Novelty8/10
Unverified
2026
Replace a fixed discrete augmentation distribution over a finite symmetry group by a continuous-time random walk driven by learnable symmetric Poisson jump rates. Use the resulting transformed-example distribution as a symmetry regularizer, with an even ℓ^{2m} distance to uniformity whose behavior is guaranteed to improve monotonically as the symmetric rates increase for the group families covered by the paper.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Regularize hidden-state trajectories so that their temporal statistics match the moments of an isotropic Haar-distributed state up to order k, while deliberately leaving moments above k unconstrained. Use k as a controllable mixing knob: k=1 or 2 suppresses drift and anisotropic variance, whereas larger k imposes stronger distributional invariance and may remove useful temporal information.
Useful5/10
Difficulty4/10
Novelty7/10
Unverified
2026
Replace the fixed decay coefficient of a stochastic recurrent or state-space layer by an adaptive mean-reversion coefficient driven by the cumulative squared hidden-state energy. The controller approximates conditioning the latent trajectory on a small L2 norm: high-energy trajectories receive stronger restoring drift, whereas low-energy trajectories retain the base dynamics and noise.
Useful5/10
Difficulty5/10
Novelty6/10
Unverified
2026
For a neural module that forms causal or statistical ratios from minibatch covariances, replace raw denominator penalties and raw-scale uncertainty weights with a log-denominator or relative-error objective. The front-door covariance minor has variance proportional to its squared magnitude, so a small denominator is not intrinsically evidence of poor estimation under the Gaussian model. This should prevent the network from spuriously avoiding valid representations merely because their…
Useful5/10
Difficulty4/10
Novelty7/10