Math: Singular perturbation

Machine-learning ideas tagged Singular perturbation in the Math taxonomy of the Math2NN corpus.

2 ideas found

ML: Mlp Math: Singular perturbation Clear all

✗ Failed on benchmark 2026

Ghost-State Adaptive Recurrent Cell

Replace a single recurrent state update with fast feature relaxation, activity evolution, and a slow adaptive state that modulates the activity vector field. Tune the activity subsystem near a controllable saddle-node so that it retains a useful transient regime for a predictable number of steps, enabling delayed switching and long-horizon memory without requiring a large hidden state.

Useful8/10

Difficulty6/10

Novelty7/10

Architecture Stability Accuracy Memory

Paper: Ghost Dynamics in Receptor Signalling Networks: A Fast--Slow Adaptive Extension of Competitive Cancer Inhibition Models arXiv:2608.15300

Unverified 2026

Singularly Perturbed Hierarchical Training

Train the output layer on a fast timescale and the hidden feature layer on a slow timescale, so output coefficients first fit the components representable by the current features before hidden directions move. Use residual plateaus to detect when the fast subsystem has approximately equilibrated, then increase the hidden-layer learning rate to begin the next feature-learning stage.

Useful6/10

Difficulty4/10

Novelty5/10

Dynamics Stability Sample efficiency Accuracy

Paper: Singular perturbations and hierarchical learning in two-layer neural networks arXiv:2607.10869