✗ Failed on benchmark
2026
Replace an opaque adaptive-optimizer state update with a small controller variable obtained by minimizing a strongly convex energy jointly associated with the proposed parameter motion. The controller is allowed to relax toward the current gradient before the parameter update, while the visible update uses the reduced energy and its envelope gradient. This creates an optimizer whose hidden geometry is optimized rather than inherited from a fixed exponential-moving-average recurrence.
Useful7/10
Difficulty6/10
Novelty6/10
✗ Failed on benchmark
2026
Replace an unconstrained covariance or dependency module with a topologically ordered linear-Gaussian DAG whose edge transforms and innovation covariances are neural-network parameters. The layer computes a joint covariance by a differentiable triangular solve, allowing downstream losses to use uncertainty, conditional prediction, or dependency penalties while preserving positive semidefiniteness by construction. This is especially suitable for graph neural networks, structured VAEs, and…
Useful7/10
Difficulty5/10
Novelty6/10
✗ Failed on benchmark
2026
Use the Gaussian mass of the local inward tangent cone to construct an analytic score target for noisy points lying within O(\sigma) of a support boundary or corner. This prevents a score network from learning an incorrect full-manifold or Euclidean approximation in the region where diffusion sampling is most sensitive to support truncation.
Useful7/10
Difficulty6/10
Novelty6/10
✗ Failed on benchmark
2026
Use the paper's parameterized invariant-torus residual and pseudo-arclength Newton correction to train a neural ODE across a continuous family of latent dynamical regimes. The continuation constraint allows the solver to pass through saddle-node folds, where stepping a physical control parameter alone would fail or jump to a different branch.
Useful7/10
Difficulty7/10
Novelty8/10
✗ Failed on benchmark
2026
Represent the physical wavefunction as a fixed cusp factor multiplied by a neural residual, rather than forcing the network to learn Coulomb singularities from data. Use cutoff distance features so the factor is nontrivial only near coalescences and remains numerically bounded at long range. The residual should have substantially lighter Fourier tails and therefore require less network capacity to attain a given energy or local-energy accuracy.
Useful7/10
Difficulty4/10
Novelty6/10
✗ Failed on benchmark
2026
Use separate measurement-domain and target-domain token sets so a network can infer a field on one spatial domain from sparse observations on another in one forward pass. The same decoder can answer arbitrary target query points, avoiding an optimization loop for each inverse instance.
Useful7/10
Difficulty5/10
Novelty6/10
✗ Failed on benchmark
2026
Add a latent mode bank whose coordinates are learned by neural power iteration on observed state transitions rather than by jointly fitting an unconstrained latent dynamics model. Each mode is repeatedly regressed toward its one-step pushforward, normalized under the data distribution, and deflated against previously learned modes. The resulting latent coordinates are constrained to have approximately linear, diagonal dynamics, which should improve long-horizon prediction and make the…
Useful7/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Replace or augment geometric attention on spatial or point-cloud tokens with a positive fractional kernel containing the paper's inverse-square origin factor. This gives tokens near a designated singular center a controlled increase in receptive-field influence while preserving a scale-invariant distance decay, which may help models represent cusp-like fields, radial singularities, and multiscale spatial interactions.
Useful6/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Insert a differentiable intersection-body-inspired map on positive spherical feature fields. The map contracts high-order angular variation while leaving degree-two ellipsoidal structure neutral, providing a principled alternative to generic smoothing that does not erase global anisotropy.
Useful6/10
Difficulty6/10
Novelty6/10
✗ Failed on benchmark
2026
Replace a purely pairwise embedding similarity used for set alignment with a sum of rooted-tree contraction scores. Each tree feature aggregates products of several coordinate-level interactions and can preserve correspondence information under an unknown orthogonal transformation, allowing matching from moderate correlation rather than nearly identical embeddings. Use the resulting score matrix for Hungarian matching, contrastive loss, or a differentiable Sinkhorn assignment.
Useful6/10
Difficulty6/10
Novelty7/10
✗ Failed on benchmark
2026
Augment a neural router with the age of its current expert or latent regime and use an age-dependent hazard to determine when switching is likely. Unlike ordinary token-wise softmax routing, the router can learn non-geometric residence times, suppressing unstable expert oscillations while still allowing rapid transitions when the current regime becomes inappropriate.
Useful6/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Attach a model-free residual-dynamics observer to a neural multi-step forecaster. Instead of asking the network to relearn persistent periodic or autoregressive disturbances, maintain a Hankel dictionary of recent forecast errors and use ridge reconstruction to predict the next residual sequence online. Add the predicted residual to the network forecast with a confidence-dependent correction gain.
Useful6/10
Difficulty4/10
Novelty7/10
✗ Failed on benchmark
2026
Track an exponentially discounted approximation to the current min-max saddle gap and use it to control the optimizer of a GAN or adversarial learner. If the recent gap rises, reduce both players' step sizes and clear stale momentum; if it falls consistently, cautiously increase the step sizes. Unlike ordinary loss EMAs, this signal measures whether each player is close to a recent best response and can detect equilibrium-tracking failure even when generator and discriminator losses look benign.
Useful6/10
Difficulty4/10
Novelty7/10
✗ Failed on benchmark
2026
Represent a set of neural prototypes, mixture components, or latent particles by N points in R^2, and initialize or refresh them with Langevin dynamics targeting a quadratically confined logarithmic Coulomb gas. The logarithmic repulsion prevents particle collapse, while the paper's N-uniform logarithmic Sobolev inequality predicts that mixing need not degrade as the particle bank grows.
Useful6/10
Difficulty5/10
Novelty7/10
✗ Failed on benchmark
2026
Add the paper's local Sine_beta fusion law as an analytic score prior for diffusion models that generate unordered point configurations. The model is trained to match both the usual diffusion score and an explicit short-range repulsion score, including the second-order correction that describes finite-scale fused configurations.
Useful6/10
Difficulty5/10
Novelty6/10
✗ Failed on benchmark
2026
Replace Gaussian perturbations in a low-dimensional neural-network optimizer with independent double-geometric integer mutations and adapt each mutation scale using its exponential-family natural gradient. Apply the method to layerwise quantization scales, adapter coefficients, pruning thresholds, or other integer/discrete hyperparameters rather than to every individual weight.
Useful6/10
Difficulty5/10
Novelty7/10