Research ideas

Every idea extracted from recent arXiv mathematics papers — verified and unverified. Click an idea to open its full card; badges show the empirical verdict.

2 ideas found

Solves: Generalization ML: Attention Math: Control theory Clear all

△ Mechanism confirmed, baseline not beaten 2026

Fading-Memory Habituation Gate

Add a per-feature or per-token state that accumulates recent stimulation and decays when stimulation is absent, then use a nonlinear decreasing gain to suppress repeatedly activated features. This creates short-term adaptation without changing the core transformer or recurrent weights: familiar inputs are processed with reduced gain, while novel inputs recover their full response.

Useful7/10

Difficulty4/10

Novelty6/10

Dynamics Stability Generalization Inference speedup

Paper: Dynamical principles of habituation across substrates and scales arXiv:2608.00249

Unverified 2026

Damped Spherical Momentum

Replace unconstrained momentum updates for selected neural-network parameter blocks by damped second-order motion on a unit sphere. The update learns directions while preserving the block norm exactly, and includes the centripetal term required for a valid acceleration constrained to the sphere rather than merely projecting gradients after an unconstrained step.

Useful6/10

Difficulty5/10

Novelty6/10

Dynamics Stability Generalization Accuracy

Paper: Global Well-posedness and Asymptotic Analysis of a Damped Nonlinear Wave Equation with a Codimension-One Constraint arXiv:2609.02842