Research ideas

Every idea extracted from recent arXiv mathematics papers — verified and unverified. Click an idea to open its full card; badges show the empirical verdict.

2 ideas found

Status: Beats tuned baseline ML: Transformer Math: Spectral theory Clear all

✓✓ Beats tuned baseline 2026

Spectral Memory-Lift Ensemble

Replace or augment a recurrent or state-space block with a small ensemble of stable linear memory lifts. Each lift stores a low-dimensional state whose repeated matrix powers generate a structured long-range convolution, and a learned gate mixes the experts using both their current predictions and their slowest block-operator mode. The module can represent multiple memory timescales without explicitly storing a long token history.

Useful7/10

Difficulty6/10

Novelty5/10

Architecture Accuracy Stability Scalability

Paper: Memory operator ensembles indicate proximity to criticality in simulated AMOC transitions arXiv:2607.24310

✓✓ Beats tuned baseline 2026

Private spectral whitening front-end

Estimate the temporal spectrum of each sequence channel using a locally private procedure, then apply a regularized inverse-square-root spectral filter before the sequence enters attention or an SSM. The filter removes predictable low-frequency or narrow-band redundancy while avoiding unstable amplification at frequencies where the private estimate is small.

Useful6/10

Difficulty5/10

Novelty7/10

Architecture Stability Sample efficiency Accuracy

Paper: On the privacy cost for dependent Gaussian data: spectral density estimation under local differential privacy arXiv:2608.24847