Research ideas

Every idea extracted from recent arXiv mathematics papers — verified and unverified. Click an idea to open its full card; badges show the empirical verdict.

2 ideas found

Status: Mechanism works Solves: Generalization Math: Probability Clear all

✓ Mechanism works 2026

Latent Bayesian Discovery of Symbolic Optimizers

Search for a compact symbolic optimizer instead of selecting among fixed AdamW-like formulas. Encode optimizer programs as token sequences, learn a continuous variational representation of those sequences, and use a Gaussian-process Bayesian optimizer to propose promising update rules based on short neural-network training rollouts.

Useful7/10

Difficulty6/10

Novelty6/10

Optimization Speedup Stability Generalization

Paper: Symbolic Discovery of Iterative Algorithms: A Continuous Latent Space Bayesian Optimization Framework arXiv:2607.01552

✓ Mechanism works 2026

Lorentz-Gram-preserving hyperbolic attention

Replace an unconstrained nonlinearity on hyperbolic pairwise similarities with a function from the paper's exact Lorentz–Gram preserver family. The transformed similarity matrix remains realizable as Lorentz inner products of future-directed unit timelike vectors, allowing a network to sharpen or smooth hyperbolic neighborhoods without introducing geometrically impossible pairwise relations.

Useful7/10

Difficulty5/10

Novelty7/10

Geometry Accuracy Stability Generalization

Paper: Distance preservers for Lobachevsky space arXiv:2608.22568