✗ Mechanism failed
2026
Replace an unconstrained softmax gate over a finite set of neural experts with exponential weights whose temperature is chosen to satisfy the paper's explicit stability condition. The goal is to prevent low-temperature expert collapse while retaining the model-selection rate when the expert losses are bounded and strongly convex in the prediction.
Useful6/10
Difficulty4/10
Novelty3/10
Unverified
2026
Track the implicit l2 regularization induced by adversarial SGD and explicitly correct it when the optimizer drifts toward an undesirable ridge strength. Apply the correction first to the final linear head or a low-dimensional adapter, where feature covariance and ridge estimates are tractable.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Attach predictive distributions to successive information-update steps of a recurrent, state-space, iterative, or diffusion model and penalize violations of the measure-valued martingale condition. The model may become more certain as information arrives, but its later forecasts must not exhibit systematic conditional bias relative to earlier forecasts.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Choose the retained context length by balancing the statistical complexity of adding lag j against the squared prediction bias from discarding it. Unlike a fixed context window, the rule uses both the remaining-horizon spectrum and the estimated tail energy, allowing a model to expand or shrink its memory online.
Useful6/10
Difficulty5/10
Novelty7/10
Unverified
2026
Estimate the temporal spectrum of each sequence channel using a locally private procedure, then apply a regularized inverse-square-root spectral filter before the sequence enters attention or an SSM. The filter removes predictable low-frequency or narrow-band redundancy while avoiding unstable amplification at frequencies where the private estimate is small.
Useful6/10
Difficulty5/10
Novelty7/10
Audited (legacy)
2026
Train a classifier or encoder to distinguish shared latent corruption from fresh per-view noise instead of treating repeated observations as conditionally independent given the target. A single persistent state corrupts all views, while each view may additionally receive independent observation noise; the fusion loss marginalizes the persistent state exactly. This should reduce overconfident predictions from repeated but systematically biased augmentations, sensor readings, or retrieved…
Useful6/10
Difficulty4/10
Novelty7/10
Unverified
2026
Use a constant-sum point vector to encode ordered pairwise outcomes and train a neural scorer with an adjacent-categories ordinal likelihood whose slope parameters are tied to those points. The accumulated point score is then a theoretically motivated compressed statistic for repeated comparisons, rather than an arbitrary regression target or one-hot label.
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Add the paper's local Sine_beta fusion law as an analytic score prior for diffusion models that generate unordered point configurations. The model is trained to match both the usual diffusion score and an explicit short-range repulsion score, including the second-order correction that describes finite-scale fused configurations.
Useful6/10
Difficulty5/10
Novelty6/10
Unverified
2026
Replace Gaussian perturbations in a low-dimensional neural-network optimizer with independent double-geometric integer mutations and adapt each mutation scale using its exponential-family natural gradient. Apply the method to layerwise quantization scales, adapter coefficients, pruning thresholds, or other integer/discrete hyperparameters rather than to every individual weight.
Useful6/10
Difficulty5/10
Novelty7/10
✓ Mechanism works
2026
Replace disjoint-pair estimates of embedding covariance moments with a complete U-statistic over every distinct pair in a minibatch. For embeddings z, the degree-two kernel h(z_i,z_j)=(z_i^T z_j)^2 estimates the spectral moment tr(M^2), where M=E[zz^T]; complete symmetrization reduces the degenerate component of estimator variance from O(1/B) to O(1/B^2).
Useful6/10
Difficulty4/10
Novelty5/10
Unverified
2026
Use the observed label-availability indicator as an auxiliary supervision signal when labels are preferentially missing for uncertain or difficult examples. Train the classifier with a joint likelihood containing both the class-label likelihood for labeled examples and a missingness likelihood whose probability depends on the classifier's posterior uncertainty.
Useful6/10
Difficulty4/10
Novelty5/10
✗ Failed on benchmark
2026
Replace the usual hand-designed expert-load penalty with a heterogeneous survival penalty derived from a susceptibility distribution. Each expert receives an availability factor q_e=G(A_e), where A_e is its cumulative recent routing pressure and G_e is a learned or fixed mixture of exponentials; highly used experts are suppressed smoothly, while heterogeneous experts can have different resistance to pressure. The mixture produces adaptive curvature and long-tailed penalties that may reduce…
Useful6/10
Difficulty4/10
Novelty6/10
Unverified
2026
Use the Gaussian approximation of a high-dimensional maximum to set a simultaneous coordinate-clipping threshold for minibatch gradients or activations. The threshold is sampled from a correlated Gaussian with the observed batch covariance, rather than treating coordinates as independent or estimating an unstable extreme quantile directly.
Useful5/10
Difficulty6/10
Novelty7/10
Unverified
2026
For a neural module that forms causal or statistical ratios from minibatch covariances, replace raw denominator penalties and raw-scale uncertainty weights with a log-denominator or relative-error objective. The front-door covariance minor has variance proportional to its squared magnitude, so a small denominator is not intrinsically evidence of poor estimation under the Gaussian model. This should prevent the network from spuriously avoiding valid representations merely because their…
Useful5/10
Difficulty4/10
Novelty7/10
Unverified
2026
Add a weak regularizer that keeps categorical representations away from both uniformity and deterministic collapse by targeting an empirically selected information-variance level. Unlike entropy maximization, this objective does not reward the uniform distribution, because information-content variance is exactly zero at uniformity.
Useful5/10
Difficulty3/10
Novelty6/10
Unverified
2026
Construct one empirical-likelihood-weighted outcome distribution per treatment or domain group, with weights chosen to match the global mean of selected covariates exactly. Use this shared weighted empirical measure as the target for a neural CDF, survival, or quantile head rather than fitting separately adjusted targets at each threshold or quantile. The target is automatically a valid probability distribution, so its CDF is monotone and its quantiles cannot cross.
Useful5/10
Difficulty4/10
Novelty5/10
Unverified
2026
Replace a single Gaussian, Laplace, or Huber residual model with a conditional mixture containing an inlier component, a body component, and an explicit generalized-Pareto tail. The network learns both the prediction and the probability that an error belongs to the extreme tail, allowing rare large errors to be modeled without making the entire loss excessively sensitive to ordinary noise.
Useful5/10
Difficulty5/10
Novelty6/10
Unverified
2026
Use a pressure objective to select expert-routing distributions by balancing task reward against route entropy, rather than optimizing task loss alone. The resulting router behaves like an equilibrium-state estimator: it should retain multiple high-performing branches when their combined entropy outweighs the advantage of a single branch.
Useful5/10
Difficulty5/10
Novelty5/10
Unverified
2026
Add an auxiliary loss that makes selected representation coordinates insensitive to all subsets of fewer than d variables while retaining a d-way parity statistic. The objective discourages the network from solving a task through pairwise shortcuts and explicitly rewards a controlled high-order interaction.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Use spatially correlated training points whose low-frequency structure factor vanishes instead of iid points. For neural fields, PINNs, image-coordinate MLPs, or spatially indexed minibatches, this should suppress long-wavelength quadrature and gradient-estimation noise while preserving the represented target dynamics. The finite-order prediction is that a design with structure factor S(k)=O(|k|^{2q}) produces lower variance for smooth losses than iid sampling, especially as the domain or batch…
Useful5/10
Difficulty5/10
Novelty6/10
Unverified
2026
For a neural model predicting a scalar response as a function of a continuous dynamical parameter, replace an unconstrained MLP output head by an analyticity-constrained spectral head. Train it on observations covering a positive-measure subset of the parameter interval and regularize the remaining coefficients so that the learned response satisfies a quasi-analytic derivative-growth bound; the intended benefit is reliable continuation from sparse parameter coverage rather than ordinary…
Useful5/10
Difficulty4/10
Novelty8/10
Unverified
2026
Train a neural predictor with a blended objective containing both ordinary outcome prediction error and downstream decision regret. The prediction term prevents a decision-focused objective from accepting degenerate predictors that induce the same in-sample decision, while the regret term biases the network toward errors that matter for the actual optimization problem.
Useful5/10
Difficulty4/10
Novelty3/10
Unverified
2026
Use multiplier bootstrap on minibatch activation covariances to determine whether a large top eigenvalue is a genuine representation direction or merely a high-dimensional bulk fluctuation. When a spike is repeatedly significant, apply a low-rank whitening or shrinkage correction to that activation subspace; otherwise leave the layer unchanged, avoiding destructive whitening of ordinary bulk variation.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Adapt the slope of each spiking neuron's surrogate derivative using the normalized entropy of its block's attention distribution. High centered entropy uncertainty increases the slope, while low uncertainty decreases it, and a dead zone holds the default slope fixed for ordinary fluctuations. The adaptation exists only in backpropagation, so the forward spike function, parameter count, and inference cost remain unchanged.
Useful5/10
Difficulty4/10
Novelty5/10