Research ideas

Every idea extracted from recent arXiv mathematics papers — verified and unverified. Click an idea to open its full card; badges show the empirical verdict.

2 ideas found

Solves: Generalization ML: Attention Math: Numerical analysis Clear all

✗ Failed on benchmark 2026

Hard-Constrained Bernstein Memory Head

Add a causal memory branch whose lag-response function is represented by a Bernstein polynomial with coefficients constrained to produce a nonnegative, decreasing, convex kernel. The branch aggregates past hidden states using this kernel, giving the model a learnable long-memory profile while preventing oscillatory, negative, or increasing historical influence.

Useful7/10

Difficulty4/10

Novelty7/10

Architecture Stability Accuracy Generalization

Paper: Neural Discovery of Memory and Nonlocal Kernels in Integro-Differential Equations with Constrained Kolmogorov--Arnold Networks arXiv:2607.11110

Unverified 2026

Metric-magnitude pooling

Replace mean or max pooling over a set of learned element embeddings with pooling based on the metric-magnitude weighting. Pairwise distances create a globally coupled correction for redundancy, so geometrically isolated or boundary elements can contribute differently from dense clusters of nearly duplicate elements.

Useful5/10

Difficulty5/10

Novelty8/10

Architecture Accuracy Generalization Sample efficiency

Paper: Scalably computing metric magnitude arXiv:2607.23354